[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 17:13:53 dist-test-slave-1x1f krb5kdc[12189](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 17:13:53 dist-test-slave-1x1f krb5kdc[12189](info): set up 2 sockets
Sep 23 17:13:53 dist-test-slave-1x1f krb5kdc[12189](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260923 17:13:54.822794 12182 mini_kdc.cc:121] Time spent starting KDC: real 1.045s user 0.008s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Sep 23 17:13:54 dist-test-slave-1x1f krb5kdc[12189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183634, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T17:13:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:13:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.229.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
I20260923 17:13:54.950944 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:37811
--webserver_interface=127.11.229.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:42759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:37811
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:13:55.065943 12202 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:13:55.066298 12202 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:13:55.066359 12202 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:13:55.070472 12202 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:13:55.070531 12202 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:13:55.070550 12202 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:13:55.070567 12202 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:13:55.070582 12202 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:13:55.075947 12202 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:42759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:37811
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:37811
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.229.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12202
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:13:55.077024 12202 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:13:55.078050 12202 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:13:55.087163 12210 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:13:55.087184 12208 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:13:55.087226 12202 server_base.cc:1034] running on GCE node
W20260923 17:13:55.087184 12207 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:13:55.088044 12202 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:13:55.089112 12202 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:13:55.090309 12202 hybrid_clock.cc:648] HybridClock initialized: now 1790183635090278 us; error 49 us; skew 500 ppm
Sep 23 17:13:55 dist-test-slave-1x1f krb5kdc[12189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183635, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:13:55.093173 12202 init.cc:377] Logged in from keytab as kudu/127.11.229.190@KRBTEST.COM (short username kudu)
I20260923 17:13:55.094091 12202 webserver.cc:460] Webserver started at http://127.11.229.190:42623/ using document root <none> and password file <none>
I20260923 17:13:55.094703 12202 fs_manager.cc:359] Metadata directory not provided
I20260923 17:13:55.094801 12202 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:13:55.095031 12202 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:13:55.097028 12202 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "2e2f33907c8a4b9f883241ec1c2be5ef"
format_stamp: "Formatted at 2026-09-23 17:13:55 on dist-test-slave-1x1f"
server_key: "a91f82dd47c1ea862d7de88fc0584f21"
server_key_iv: "1890053c0b7c50fed3752d29c883917c"
server_key_version: "encryptionkey@0"
I20260923 17:13:55.097605 12202 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "2e2f33907c8a4b9f883241ec1c2be5ef"
format_stamp: "Formatted at 2026-09-23 17:13:55 on dist-test-slave-1x1f"
server_key: "a91f82dd47c1ea862d7de88fc0584f21"
server_key_iv: "1890053c0b7c50fed3752d29c883917c"
server_key_version: "encryptionkey@0"
I20260923 17:13:55.101548 12202 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260923 17:13:55.104130 12217 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:13:55.105487 12202 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 17:13:55.105645 12202 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "2e2f33907c8a4b9f883241ec1c2be5ef"
format_stamp: "Formatted at 2026-09-23 17:13:55 on dist-test-slave-1x1f"
server_key: "a91f82dd47c1ea862d7de88fc0584f21"
server_key_iv: "1890053c0b7c50fed3752d29c883917c"
server_key_version: "encryptionkey@0"
I20260923 17:13:55.105827 12202 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:13:55.147826 12202 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:13:55.151187 12202 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:13:55.151402 12202 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:13:55.158427 12202 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.190:37811
I20260923 17:13:55.158458 12269 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.190:37811 every 8 connection(s)
I20260923 17:13:55.159376 12202 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:13:55.162187 12270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:13:55.167591 12270 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e2f33907c8a4b9f883241ec1c2be5ef: Bootstrap starting.
I20260923 17:13:55.168653 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 12202
I20260923 17:13:55.168848 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:13:55.170164 12182 external_mini_cluster.cc:1428] Setting key 8335a8f76debc0ac0757c2a5ea72650b
I20260923 17:13:55.170185 12270 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2e2f33907c8a4b9f883241ec1c2be5ef: Neither blocks nor log segments found. Creating new log.
I20260923 17:13:55.170957 12270 log.cc:824] T 00000000000000000000000000000000 P 2e2f33907c8a4b9f883241ec1c2be5ef: Log is configured to *not* fsync() on all Append() calls
I20260923 17:13:55.173225 12270 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2e2f33907c8a4b9f883241ec1c2be5ef: No bootstrap required, opened a new log
I20260923 17:13:55.178653 12270 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2e2f33907c8a4b9f883241ec1c2be5ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e2f33907c8a4b9f883241ec1c2be5ef" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 37811 } }
I20260923 17:13:55.178967 12270 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2e2f33907c8a4b9f883241ec1c2be5ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:13:55.179030 12270 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2e2f33907c8a4b9f883241ec1c2be5ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e2f33907c8a4b9f883241ec1c2be5ef, State: Initialized, Role: FOLLOWER
I20260923 17:13:55.179450 12270 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2e2f33907c8a4b9f883241ec1c2be5ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e2f33907c8a4b9f883241ec1c2be5ef" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 37811 } }
I20260923 17:13:55.179643 12270 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2e2f33907c8a4b9f883241ec1c2be5ef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:13:55.179711 12270 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2e2f33907c8a4b9f883241ec1c2be5ef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:13:55.179807 12270 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2e2f33907c8a4b9f883241ec1c2be5ef [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:13:55.181070 12270 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2e2f33907c8a4b9f883241ec1c2be5ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e2f33907c8a4b9f883241ec1c2be5ef" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 37811 } }
I20260923 17:13:55.181458 12270 leader_election.cc:302] T 00000000000000000000000000000000 P 2e2f33907c8a4b9f883241ec1c2be5ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2e2f33907c8a4b9f883241ec1c2be5ef; no voters:
I20260923 17:13:55.181862 12270 leader_election.cc:288] T 00000000000000000000000000000000 P 2e2f33907c8a4b9f883241ec1c2be5ef [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 17:13:55.181980 12275 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2e2f33907c8a4b9f883241ec1c2be5ef [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:13:55.182263 12275 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2e2f33907c8a4b9f883241ec1c2be5ef [term 1 LEADER]: Becoming Leader. State: Replica: 2e2f33907c8a4b9f883241ec1c2be5ef, State: Running, Role: LEADER
I20260923 17:13:55.182574 12275 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2e2f33907c8a4b9f883241ec1c2be5ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e2f33907c8a4b9f883241ec1c2be5ef" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 37811 } }
I20260923 17:13:55.183168 12270 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2e2f33907c8a4b9f883241ec1c2be5ef [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:13:55.184221 12276 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e2f33907c8a4b9f883241ec1c2be5ef [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2e2f33907c8a4b9f883241ec1c2be5ef. Latest consensus state: current_term: 1 leader_uuid: "2e2f33907c8a4b9f883241ec1c2be5ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e2f33907c8a4b9f883241ec1c2be5ef" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 37811 } } }
I20260923 17:13:55.184340 12276 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e2f33907c8a4b9f883241ec1c2be5ef [sys.catalog]: This master's current role is: LEADER
I20260923 17:13:55.184662 12277 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2e2f33907c8a4b9f883241ec1c2be5ef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2e2f33907c8a4b9f883241ec1c2be5ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2e2f33907c8a4b9f883241ec1c2be5ef" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 37811 } } }
I20260923 17:13:55.184752 12277 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2e2f33907c8a4b9f883241ec1c2be5ef [sys.catalog]: This master's current role is: LEADER
W20260923 17:13:55.188400 12290 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2e2f33907c8a4b9f883241ec1c2be5ef: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 17:13:55.188494 12290 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 17:13:55.188573 12284 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:13:55.189527 12284 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Sep 23 17:13:55 dist-test-slave-1x1f krb5kdc[12189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183634, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:13:55.196161 12284 catalog_manager.cc:1347] Generated new cluster ID: 80e03454496848c99a5d19438723ad7d
I20260923 17:13:55.196229 12284 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:13:55.197147 12273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:13:55.173281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40410 (local address 127.11.229.190:37811)
0923 17:13:55.173759 (+ 478us) server_negotiation.cc:206] Beginning negotiation
0923 17:13:55.173777 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0923 17:13:55.175039 (+ 1262us) server_negotiation.cc:407] Connection header received
0923 17:13:55.178819 (+ 3780us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:13:55.178833 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:13:55.179261 (+ 428us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:13:55.179561 (+ 300us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:13:55.182618 (+ 3057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:13:55.184176 (+ 1558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:13:55.186007 (+ 1831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:13:55.186569 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:13:55.186747 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:13:55.190843 (+ 4096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:13:55.190849 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:13:55.190872 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:13:55.190898 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:13:55.193099 (+ 2201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:13:55.193859 (+ 760us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:13:55.193865 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:13:55.193871 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:13:55.194013 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:13:55.194488 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:13:55.194495 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:13:55.194497 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:13:55.194909 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:13:55.195156 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0923 17:13:55.195720 (+ 564us) server_negotiation.cc:299] Negotiation successful
0923 17:13:55.195997 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":323,"thread_start_us":143,"threads_started":1}
I20260923 17:13:55.214570 12284 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:13:55.215945 12284 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:13:55.221251 12284 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2e2f33907c8a4b9f883241ec1c2be5ef: Generated new TSK 0
I20260923 17:13:55.221978 12284 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.229.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab.
Entry for principal kudu/127.11.229.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab.
I20260923 17:13:55.261835 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.129:0
--local_ip_for_outbound_sockets=127.11.229.129
--webserver_interface=127.11.229.129
--webserver_port=0
--tserver_master_addrs=127.11.229.190:37811
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab
--principal=kudu/127.11.229.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:42759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:13:55.387883 12296 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:13:55.388142 12296 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:13:55.388185 12296 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:13:55.392216 12296 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:13:55.392299 12296 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:13:55.392360 12296 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.129
I20260923 17:13:55.397460 12296 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:42759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab
--principal=kudu/127.11.229.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.229.129
--webserver_port=0
--tserver_master_addrs=127.11.229.190:37811
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12296
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.129
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:13:55.398437 12296 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:13:55.399366 12296 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:13:55.408913 12302 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:13:55.408906 12304 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:13:55.408969 12301 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:13:55.409298 12296 server_base.cc:1034] running on GCE node
I20260923 17:13:55.409677 12296 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:13:55.410552 12296 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:13:55.411731 12296 hybrid_clock.cc:648] HybridClock initialized: now 1790183635411711 us; error 31 us; skew 500 ppm
Sep 23 17:13:55 dist-test-slave-1x1f krb5kdc[12189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183635, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:13:55.414907 12296 init.cc:377] Logged in from keytab as kudu/127.11.229.129@KRBTEST.COM (short username kudu)
I20260923 17:13:55.415954 12296 webserver.cc:460] Webserver started at http://127.11.229.129:37033/ using document root <none> and password file <none>
I20260923 17:13:55.416682 12296 fs_manager.cc:359] Metadata directory not provided
I20260923 17:13:55.416764 12296 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:13:55.417001 12296 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:13:55.419202 12296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/ts-0/data/instance:
uuid: "040d88b53be443fe8ea0554cc0108005"
format_stamp: "Formatted at 2026-09-23 17:13:55 on dist-test-slave-1x1f"
server_key: "08dc9e46141ce45c05ce123ab6d52c4e"
server_key_iv: "3a683df0143558e52bfbdd09297455f2"
server_key_version: "encryptionkey@0"
I20260923 17:13:55.419798 12296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance:
uuid: "040d88b53be443fe8ea0554cc0108005"
format_stamp: "Formatted at 2026-09-23 17:13:55 on dist-test-slave-1x1f"
server_key: "08dc9e46141ce45c05ce123ab6d52c4e"
server_key_iv: "3a683df0143558e52bfbdd09297455f2"
server_key_version: "encryptionkey@0"
I20260923 17:13:55.423692 12296 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260923 17:13:55.426285 12311 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:13:55.427634 12296 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260923 17:13:55.427783 12296 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/ts-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/ts-0/wal
uuid: "040d88b53be443fe8ea0554cc0108005"
format_stamp: "Formatted at 2026-09-23 17:13:55 on dist-test-slave-1x1f"
server_key: "08dc9e46141ce45c05ce123ab6d52c4e"
server_key_iv: "3a683df0143558e52bfbdd09297455f2"
server_key_version: "encryptionkey@0"
I20260923 17:13:55.427910 12296 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:13:55.470654 12296 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:13:55.474568 12296 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:13:55.474813 12296 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:13:55.475459 12296 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:13:55.476388 12296 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:13:55.476461 12296 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:13:55.476539 12296 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:13:55.476583 12296 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:13:55.486423 12296 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.129:41469
I20260923 17:13:55.486462 12424 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.129:41469 every 8 connection(s)
I20260923 17:13:55.487388 12296 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
I20260923 17:13:55.489691 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 12296
I20260923 17:13:55.489816 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance
I20260923 17:13:55.490166 12182 external_mini_cluster.cc:1428] Setting key 22f6b46c3e36ce762fe438109cff0664
Sep 23 17:13:55 dist-test-slave-1x1f krb5kdc[12189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183635, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.129@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.229.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.130@KRBTEST.COM" created.
I20260923 17:13:55.503852 12273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:13:55.489336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:33357 (local address 127.11.229.190:37811)
0923 17:13:55.489480 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0923 17:13:55.489485 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:13:55.490978 (+ 1493us) server_negotiation.cc:407] Connection header received
0923 17:13:55.491964 (+ 986us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:13:55.491967 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:13:55.492023 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:13:55.492112 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:13:55.493364 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:13:55.493964 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:13:55.496031 (+ 2067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:13:55.496321 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:13:55.496412 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:13:55.499719 (+ 3307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:13:55.499722 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:13:55.499725 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:13:55.499749 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:13:55.501361 (+ 1612us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:13:55.501925 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:13:55.501928 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:13:55.501929 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:13:55.502028 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:13:55.502489 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:13:55.502492 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:13:55.502493 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:13:55.502697 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:13:55.502781 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0923 17:13:55.503499 (+ 718us) server_negotiation.cc:299] Negotiation successful
0923 17:13:55.503614 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260923 17:13:55.504765 12427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:13:55.489780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:37811 (local address 127.11.229.129:33357)
0923 17:13:55.490824 (+ 1044us) negotiation.cc:107] Waiting for socket to connect
0923 17:13:55.490882 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0923 17:13:55.491748 (+ 866us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:13:55.492255 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:13:55.492262 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:13:55.492672 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:13:55.493194 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:13:55.493207 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:13:55.494114 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:13:55.494118 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:13:55.495863 (+ 1745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:13:55.495879 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:13:55.496512 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:13:55.496517 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:13:55.496778 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:13:55.497558 (+ 780us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:13:55.497589 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:13:55.499506 (+ 1917us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:13:55.501485 (+ 1979us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:13:55.501490 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:13:55.501505 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:13:55.501801 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:13:55.502168 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:13:55.502171 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:13:55.502172 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:13:55.502373 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:13:55.502818 (+ 445us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:13:55.502823 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:13:55.503186 (+ 363us) client_negotiation.cc:769] Sending connection context
0923 17:13:55.503356 (+ 170us) client_negotiation.cc:240] Negotiation successful
0923 17:13:55.503638 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":786,"thread_start_us":224,"threads_started":1}
I20260923 17:13:55.506359 12425 heartbeater.cc:347] Connected to a master server at 127.11.229.190:37811
I20260923 17:13:55.506634 12425 heartbeater.cc:464] Registering TS with master...
I20260923 17:13:55.507161 12425 heartbeater.cc:511] Master 127.11.229.190:37811 requested a full tablet report, sending...
I20260923 17:13:55.508828 12230 ts_manager.cc:194] Registered new tserver with Master: 040d88b53be443fe8ea0554cc0108005 (127.11.229.129:41469)
I20260923 17:13:55.510092 12230 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.129@KRBTEST.COM'} at 127.11.229.129:33357
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab.
Entry for principal kudu/127.11.229.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab.
I20260923 17:13:55.522933 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.130:0
--local_ip_for_outbound_sockets=127.11.229.130
--webserver_interface=127.11.229.130
--webserver_port=0
--tserver_master_addrs=127.11.229.190:37811
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab
--principal=kudu/127.11.229.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:42759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:13:55.640995 12430 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:13:55.641286 12430 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:13:55.641374 12430 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:13:55.645515 12430 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:13:55.645588 12430 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:13:55.645651 12430 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.130
I20260923 17:13:55.651057 12430 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:42759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab
--principal=kudu/127.11.229.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.229.130
--webserver_port=0
--tserver_master_addrs=127.11.229.190:37811
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12430
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.130
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:13:55.652231 12430 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:13:55.653311 12430 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:13:55.663053 12438 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:13:55.663178 12430 server_base.cc:1034] running on GCE node
W20260923 17:13:55.663084 12436 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:13:55.663352 12435 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:13:55.663760 12430 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:13:55.664454 12430 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:13:55.665647 12430 hybrid_clock.cc:648] HybridClock initialized: now 1790183635665618 us; error 49 us; skew 500 ppm
Sep 23 17:13:55 dist-test-slave-1x1f krb5kdc[12189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183635, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:13:55.668547 12430 init.cc:377] Logged in from keytab as kudu/127.11.229.130@KRBTEST.COM (short username kudu)
I20260923 17:13:55.669417 12430 webserver.cc:460] Webserver started at http://127.11.229.130:43409/ using document root <none> and password file <none>
I20260923 17:13:55.669937 12430 fs_manager.cc:359] Metadata directory not provided
I20260923 17:13:55.670004 12430 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:13:55.670181 12430 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:13:55.672341 12430 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/ts-1/data/instance:
uuid: "61540981fcf64089a4b427b67e90dcd1"
format_stamp: "Formatted at 2026-09-23 17:13:55 on dist-test-slave-1x1f"
server_key: "1ee21d7227f880889259162d758037f5"
server_key_iv: "d835fcb3fd3a41d84117df54353f8294"
server_key_version: "encryptionkey@0"
I20260923 17:13:55.672844 12430 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance:
uuid: "61540981fcf64089a4b427b67e90dcd1"
format_stamp: "Formatted at 2026-09-23 17:13:55 on dist-test-slave-1x1f"
server_key: "1ee21d7227f880889259162d758037f5"
server_key_iv: "d835fcb3fd3a41d84117df54353f8294"
server_key_version: "encryptionkey@0"
I20260923 17:13:55.676743 12430 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260923 17:13:55.679431 12445 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:13:55.680902 12430 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 17:13:55.681083 12430 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/ts-1/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/ts-1/wal
uuid: "61540981fcf64089a4b427b67e90dcd1"
format_stamp: "Formatted at 2026-09-23 17:13:55 on dist-test-slave-1x1f"
server_key: "1ee21d7227f880889259162d758037f5"
server_key_iv: "d835fcb3fd3a41d84117df54353f8294"
server_key_version: "encryptionkey@0"
I20260923 17:13:55.681195 12430 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:13:55.699395 12430 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:13:55.702975 12430 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:13:55.703147 12430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:13:55.703703 12430 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:13:55.704571 12430 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:13:55.704644 12430 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:13:55.704710 12430 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:13:55.704761 12430 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:13:55.713706 12430 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.130:43239
I20260923 17:13:55.713724 12558 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.130:43239 every 8 connection(s)
I20260923 17:13:55.714694 12430 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
I20260923 17:13:55.720161 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 12430
I20260923 17:13:55.720255 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance
I20260923 17:13:55.720541 12182 external_mini_cluster.cc:1428] Setting key 34c837580dd2aaa2b8733c075faa1ddf
Sep 23 17:13:55 dist-test-slave-1x1f krb5kdc[12189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183635, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.130@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:13:55.729774 12273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:13:55.716559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:40693 (local address 127.11.229.190:37811)
0923 17:13:55.716695 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0923 17:13:55.716699 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:13:55.717724 (+ 1025us) server_negotiation.cc:407] Connection header received
0923 17:13:55.718695 (+ 971us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:13:55.718698 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:13:55.718745 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:13:55.718822 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:13:55.720057 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:13:55.720757 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:13:55.722047 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:13:55.722359 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:13:55.722469 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:13:55.725556 (+ 3087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:13:55.725559 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:13:55.725562 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:13:55.725588 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:13:55.727530 (+ 1942us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:13:55.728082 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:13:55.728089 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:13:55.728094 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:13:55.728193 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:13:55.728543 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:13:55.728549 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:13:55.728552 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:13:55.728797 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:13:55.728907 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0923 17:13:55.729453 (+ 546us) server_negotiation.cc:299] Negotiation successful
0923 17:13:55.729590 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
WARNING: no policy specified for kudu/127.11.229.131@KRBTEST.COM; defaulting to no policy
I20260923 17:13:55.730736 12561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:13:55.716873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:37811 (local address 127.11.229.130:40693)
0923 17:13:55.717575 (+ 702us) negotiation.cc:107] Waiting for socket to connect
0923 17:13:55.717617 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0923 17:13:55.718494 (+ 877us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:13:55.718988 (+ 494us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:13:55.718996 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:13:55.719396 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:13:55.719899 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:13:55.719913 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:13:55.720888 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:13:55.720893 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:13:55.721921 (+ 1028us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:13:55.721930 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:13:55.722506 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:13:55.722510 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:13:55.722682 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:13:55.723297 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:13:55.723313 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:13:55.725315 (+ 2002us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:13:55.727669 (+ 2354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:13:55.727674 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:13:55.727686 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:13:55.727956 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:13:55.728288 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:13:55.728290 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:13:55.728299 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:13:55.728443 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:13:55.728917 (+ 474us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:13:55.728926 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:13:55.729194 (+ 268us) client_negotiation.cc:769] Sending connection context
0923 17:13:55.729366 (+ 172us) client_negotiation.cc:240] Negotiation successful
0923 17:13:55.729638 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":516,"thread_start_us":125,"threads_started":1}
I20260923 17:13:55.732023 12559 heartbeater.cc:347] Connected to a master server at 127.11.229.190:37811
I20260923 17:13:55.732301 12559 heartbeater.cc:464] Registering TS with master...
I20260923 17:13:55.732900 12559 heartbeater.cc:511] Master 127.11.229.190:37811 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.131@KRBTEST.COM" created.
I20260923 17:13:55.734058 12230 ts_manager.cc:194] Registered new tserver with Master: 61540981fcf64089a4b427b67e90dcd1 (127.11.229.130:43239)
I20260923 17:13:55.734709 12230 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.130@KRBTEST.COM'} at 127.11.229.130:40693
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab.
Entry for principal kudu/127.11.229.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab.
I20260923 17:13:55.749931 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.131:0
--local_ip_for_outbound_sockets=127.11.229.131
--webserver_interface=127.11.229.131
--webserver_port=0
--tserver_master_addrs=127.11.229.190:37811
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab
--principal=kudu/127.11.229.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:42759
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:13:55.863020 12564 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:13:55.863281 12564 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:13:55.863325 12564 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:13:55.867377 12564 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:13:55.867432 12564 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:13:55.867534 12564 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.131
I20260923 17:13:55.872805 12564 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:42759
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab
--principal=kudu/127.11.229.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.229.131
--webserver_port=0
--tserver_master_addrs=127.11.229.190:37811
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12564
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.131
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:13:55.873876 12564 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:13:55.874944 12564 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:13:55.884740 12570 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:13:55.884717 12572 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:13:55.884717 12569 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:13:55.885062 12564 server_base.cc:1034] running on GCE node
I20260923 17:13:55.885463 12564 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:13:55.886195 12564 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:13:55.887403 12564 hybrid_clock.cc:648] HybridClock initialized: now 1790183635887379 us; error 36 us; skew 500 ppm
Sep 23 17:13:55 dist-test-slave-1x1f krb5kdc[12189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183635, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:13:55.890026 12564 init.cc:377] Logged in from keytab as kudu/127.11.229.131@KRBTEST.COM (short username kudu)
I20260923 17:13:55.890923 12564 webserver.cc:460] Webserver started at http://127.11.229.131:46459/ using document root <none> and password file <none>
I20260923 17:13:55.891476 12564 fs_manager.cc:359] Metadata directory not provided
I20260923 17:13:55.891541 12564 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:13:55.891705 12564 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:13:55.893664 12564 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/ts-2/data/instance:
uuid: "27fa48d48d284c23893a6197149c31cb"
format_stamp: "Formatted at 2026-09-23 17:13:55 on dist-test-slave-1x1f"
server_key: "1276a34089f1e5544f8ca7ec26534849"
server_key_iv: "8a69ba7f7ff05772de1c96b88079bb83"
server_key_version: "encryptionkey@0"
I20260923 17:13:55.894158 12564 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance:
uuid: "27fa48d48d284c23893a6197149c31cb"
format_stamp: "Formatted at 2026-09-23 17:13:55 on dist-test-slave-1x1f"
server_key: "1276a34089f1e5544f8ca7ec26534849"
server_key_iv: "8a69ba7f7ff05772de1c96b88079bb83"
server_key_version: "encryptionkey@0"
I20260923 17:13:55.897850 12564 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260923 17:13:55.900280 12579 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:13:55.901572 12564 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 17:13:55.901693 12564 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/ts-2/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/ts-2/wal
uuid: "27fa48d48d284c23893a6197149c31cb"
format_stamp: "Formatted at 2026-09-23 17:13:55 on dist-test-slave-1x1f"
server_key: "1276a34089f1e5544f8ca7ec26534849"
server_key_iv: "8a69ba7f7ff05772de1c96b88079bb83"
server_key_version: "encryptionkey@0"
I20260923 17:13:55.901808 12564 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:13:55.943776 12564 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:13:55.946873 12564 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:13:55.947098 12564 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:13:55.947945 12564 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:13:55.948907 12564 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:13:55.948961 12564 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:13:55.949052 12564 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:13:55.949096 12564 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:13:55.959270 12564 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.131:42135
I20260923 17:13:55.959419 12692 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.131:42135 every 8 connection(s)
I20260923 17:13:55.960547 12564 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
I20260923 17:13:55.967186 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 12564
I20260923 17:13:55.967345 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance
I20260923 17:13:55.967612 12182 external_mini_cluster.cc:1428] Setting key 385c896aa3dbcf7e65a68dc60c796263
Sep 23 17:13:55 dist-test-slave-1x1f krb5kdc[12189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183635, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.131@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:13:55.976179 12273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:13:55.963220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:53531 (local address 127.11.229.190:37811)
0923 17:13:55.963352 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0923 17:13:55.963363 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 17:13:55.964250 (+ 887us) server_negotiation.cc:407] Connection header received
0923 17:13:55.965627 (+ 1377us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:13:55.965630 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:13:55.965688 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:13:55.965770 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:13:55.967106 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:13:55.967783 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:13:55.969216 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:13:55.969483 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:13:55.969574 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:13:55.972356 (+ 2782us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:13:55.972359 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:13:55.972361 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:13:55.972385 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:13:55.973879 (+ 1494us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:13:55.974524 (+ 645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:13:55.974527 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:13:55.974529 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:13:55.974609 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:13:55.974939 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:13:55.974941 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:13:55.974942 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:13:55.975178 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:13:55.975257 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0923 17:13:55.975928 (+ 671us) server_negotiation.cc:299] Negotiation successful
0923 17:13:55.976052 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260923 17:13:55.977182 12695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:13:55.963586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:37811 (local address 127.11.229.131:53531)
0923 17:13:55.964065 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0923 17:13:55.964122 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0923 17:13:55.965373 (+ 1251us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:13:55.965955 (+ 582us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:13:55.965962 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:13:55.966407 (+ 445us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:13:55.966947 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:13:55.966962 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:13:55.967904 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:13:55.967908 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:13:55.969057 (+ 1149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:13:55.969067 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:13:55.969643 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:13:55.969647 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:13:55.969829 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:13:55.970577 (+ 748us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:13:55.970594 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:13:55.972179 (+ 1585us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:13:55.974026 (+ 1847us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:13:55.974031 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:13:55.974050 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:13:55.974422 (+ 372us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:13:55.974692 (+ 270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:13:55.974694 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:13:55.974696 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:13:55.974850 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:13:55.975296 (+ 446us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:13:55.975301 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:13:55.975631 (+ 330us) client_negotiation.cc:769] Sending connection context
0923 17:13:55.975802 (+ 171us) client_negotiation.cc:240] Negotiation successful
0923 17:13:55.976083 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":121,"threads_started":1}
I20260923 17:13:55.978489 12693 heartbeater.cc:347] Connected to a master server at 127.11.229.190:37811
I20260923 17:13:55.978765 12693 heartbeater.cc:464] Registering TS with master...
I20260923 17:13:55.979282 12693 heartbeater.cc:511] Master 127.11.229.190:37811 requested a full tablet report, sending...
I20260923 17:13:55.980532 12230 ts_manager.cc:194] Registered new tserver with Master: 27fa48d48d284c23893a6197149c31cb (127.11.229.131:42135)
I20260923 17:13:55.981343 12230 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.131@KRBTEST.COM'} at 127.11.229.131:53531
I20260923 17:13:55.983469 12182 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 23 17:13:55 dist-test-slave-1x1f krb5kdc[12189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183635, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 23 17:13:56 dist-test-slave-1x1f krb5kdc[12189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183635, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.229.129@KRBTEST.COM
I20260923 17:13:56.021473 12700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:13:56.007543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53194 (local address 127.11.229.129:41469)
0923 17:13:56.007997 (+ 454us) server_negotiation.cc:206] Beginning negotiation
0923 17:13:56.008006 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 17:13:56.008038 (+ 32us) server_negotiation.cc:407] Connection header received
0923 17:13:56.008224 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:13:56.008234 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:13:56.008514 (+ 280us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:13:56.008702 (+ 188us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:13:56.009656 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:13:56.010994 (+ 1338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:13:56.011920 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:13:56.012549 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:13:56.012681 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:13:56.016786 (+ 4105us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:13:56.016806 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:13:56.016829 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:13:56.016872 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:13:56.019107 (+ 2235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:13:56.019770 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:13:56.019779 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:13:56.019783 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:13:56.019881 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:13:56.020218 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:13:56.020222 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:13:56.020223 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:13:56.020593 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:13:56.020839 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0923 17:13:56.021089 (+ 250us) server_negotiation.cc:299] Negotiation successful
0923 17:13:56.021256 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":346,"thread_start_us":102,"threads_started":1}
W20260923 17:13:56.022508 12339 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53194
Sep 23 17:13:56 dist-test-slave-1x1f krb5kdc[12189](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183636, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 23 17:13:56 dist-test-slave-1x1f krb5kdc[12189](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183636, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.229.129@KRBTEST.COM
I20260923 17:13:56.050088 12700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:13:56.041311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53208 (local address 127.11.229.129:41469)
0923 17:13:56.041445 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0923 17:13:56.041453 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 17:13:56.041571 (+ 118us) server_negotiation.cc:407] Connection header received
0923 17:13:56.041703 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:13:56.041706 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:13:56.041747 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:13:56.041824 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:13:56.042745 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:13:56.043256 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:13:56.044088 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:13:56.044316 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:13:56.044396 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:13:56.046786 (+ 2390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:13:56.046789 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:13:56.046791 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:13:56.046814 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:13:56.048244 (+ 1430us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:13:56.048730 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:13:56.048735 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:13:56.048737 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:13:56.048824 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:13:56.049142 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:13:56.049147 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:13:56.049149 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:13:56.049333 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:13:56.049531 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0923 17:13:56.049771 (+ 240us) server_negotiation.cc:299] Negotiation successful
0923 17:13:56.049907 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260923 17:13:56.051311 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 12296
I20260923 17:13:56.057296 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 12430
I20260923 17:13:56.064625 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 12564
I20260923 17:13:56.069796 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 12202
2026-09-23T17:13:56Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2325 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 17:13:56 dist-test-slave-1x1f krb5kdc[12707](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 17:13:56 dist-test-slave-1x1f krb5kdc[12707](info): set up 2 sockets
Sep 23 17:13:56 dist-test-slave-1x1f krb5kdc[12707](info): commencing operation
krb5kdc: starting...
W20260923 17:13:57.130462 12182 mini_kdc.cc:121] Time spent starting KDC: real 1.038s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/krb5kdc/test-user.keytab.
W20260923 17:13:57.914585 12182 mini_kdc.cc:302] Time spent creating keytab for test-user: real 0.665s user 0.000s sys 0.002s
Sep 23 17:13:57 dist-test-slave-1x1f krb5kdc[12707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183637, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T17:13:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:13:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.229.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
W20260923 17:13:59.170868 12182 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.11.229.190: real 1.233s user 0.000s sys 0.003s
I20260923 17:13:59.171509 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:34003
--webserver_interface=127.11.229.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:35271
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:34003
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:13:59.289518 12720 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:13:59.289816 12720 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:13:59.289891 12720 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:13:59.294015 12720 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:13:59.294075 12720 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:13:59.294094 12720 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:13:59.294111 12720 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:13:59.294158 12720 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:13:59.299675 12720 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:35271
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:34003
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:34003
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.229.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12720
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:13:59.300747 12720 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:13:59.301807 12720 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:13:59.310438 12726 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:13:59.310487 12728 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:13:59.310490 12725 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:13:59.310570 12720 server_base.cc:1034] running on GCE node
I20260923 17:13:59.311239 12720 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:13:59.312376 12720 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:13:59.313546 12720 hybrid_clock.cc:648] HybridClock initialized: now 1790183639313529 us; error 29 us; skew 500 ppm
Sep 23 17:13:59 dist-test-slave-1x1f krb5kdc[12707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183639, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:13:59.325321 12720 init.cc:377] Logged in from keytab as kudu/127.11.229.190@KRBTEST.COM (short username kudu)
I20260923 17:13:59.326400 12720 webserver.cc:460] Webserver started at http://127.11.229.190:39455/ using document root <none> and password file <none>
I20260923 17:13:59.326987 12720 fs_manager.cc:359] Metadata directory not provided
I20260923 17:13:59.327046 12720 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:13:59.327221 12720 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:13:59.329339 12720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "7d27810dbf334b46adba8668b6d1f314"
format_stamp: "Formatted at 2026-09-23 17:13:59 on dist-test-slave-1x1f"
server_key: "c186a8cffc639b68deacafaaa0c465d6"
server_key_iv: "8aafb3399ae0dd670189f490b04bf0d4"
server_key_version: "encryptionkey@0"
I20260923 17:13:59.329865 12720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "7d27810dbf334b46adba8668b6d1f314"
format_stamp: "Formatted at 2026-09-23 17:13:59 on dist-test-slave-1x1f"
server_key: "c186a8cffc639b68deacafaaa0c465d6"
server_key_iv: "8aafb3399ae0dd670189f490b04bf0d4"
server_key_version: "encryptionkey@0"
I20260923 17:13:59.333767 12720 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260923 17:13:59.336513 12735 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:13:59.337998 12720 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 17:13:59.338147 12720 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "7d27810dbf334b46adba8668b6d1f314"
format_stamp: "Formatted at 2026-09-23 17:13:59 on dist-test-slave-1x1f"
server_key: "c186a8cffc639b68deacafaaa0c465d6"
server_key_iv: "8aafb3399ae0dd670189f490b04bf0d4"
server_key_version: "encryptionkey@0"
I20260923 17:13:59.338346 12720 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:13:59.350512 12720 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:13:59.353912 12720 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:13:59.354144 12720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:13:59.361441 12720 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.190:34003
I20260923 17:13:59.361469 12787 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.190:34003 every 8 connection(s)
I20260923 17:13:59.362396 12720 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:13:59.365170 12788 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:13:59.368350 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 12720
I20260923 17:13:59.368466 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:13:59.368748 12182 external_mini_cluster.cc:1428] Setting key ebac82e5d649b142f48685808aee4ffc
I20260923 17:13:59.371881 12788 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d27810dbf334b46adba8668b6d1f314: Bootstrap starting.
I20260923 17:13:59.374046 12788 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7d27810dbf334b46adba8668b6d1f314: Neither blocks nor log segments found. Creating new log.
I20260923 17:13:59.374823 12788 log.cc:824] T 00000000000000000000000000000000 P 7d27810dbf334b46adba8668b6d1f314: Log is configured to *not* fsync() on all Append() calls
I20260923 17:13:59.377250 12788 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d27810dbf334b46adba8668b6d1f314: No bootstrap required, opened a new log
Sep 23 17:13:59 dist-test-slave-1x1f krb5kdc[12707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183637, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:13:59.382004 12788 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7d27810dbf334b46adba8668b6d1f314 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d27810dbf334b46adba8668b6d1f314" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 34003 } }
I20260923 17:13:59.382349 12788 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7d27810dbf334b46adba8668b6d1f314 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:13:59.382414 12788 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7d27810dbf334b46adba8668b6d1f314 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d27810dbf334b46adba8668b6d1f314, State: Initialized, Role: FOLLOWER
I20260923 17:13:59.383016 12788 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7d27810dbf334b46adba8668b6d1f314 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d27810dbf334b46adba8668b6d1f314" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 34003 } }
I20260923 17:13:59.383214 12788 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7d27810dbf334b46adba8668b6d1f314 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:13:59.383315 12788 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7d27810dbf334b46adba8668b6d1f314 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:13:59.383471 12788 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7d27810dbf334b46adba8668b6d1f314 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:13:59.385591 12791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:13:59.370311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51374 (local address 127.11.229.190:34003)
0923 17:13:59.370763 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0923 17:13:59.370779 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0923 17:13:59.370815 (+ 36us) server_negotiation.cc:407] Connection header received
0923 17:13:59.371491 (+ 676us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:13:59.371509 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:13:59.371854 (+ 345us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:13:59.372262 (+ 408us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:13:59.373073 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:13:59.374402 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:13:59.375399 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:13:59.376134 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:13:59.376306 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:13:59.379306 (+ 3000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:13:59.379314 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:13:59.379335 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:13:59.379374 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:13:59.382371 (+ 2997us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:13:59.382918 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:13:59.382923 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:13:59.382928 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:13:59.383041 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:13:59.383638 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:13:59.383642 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:13:59.383644 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:13:59.384095 (+ 451us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:13:59.384259 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0923 17:13:59.384603 (+ 344us) server_negotiation.cc:299] Negotiation successful
0923 17:13:59.384860 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":132,"threads_started":1}
I20260923 17:13:59.387845 12788 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7d27810dbf334b46adba8668b6d1f314 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d27810dbf334b46adba8668b6d1f314" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 34003 } }
I20260923 17:13:59.388252 12788 leader_election.cc:302] T 00000000000000000000000000000000 P 7d27810dbf334b46adba8668b6d1f314 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7d27810dbf334b46adba8668b6d1f314; no voters:
I20260923 17:13:59.388605 12788 leader_election.cc:288] T 00000000000000000000000000000000 P 7d27810dbf334b46adba8668b6d1f314 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 17:13:59.388988 12794 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7d27810dbf334b46adba8668b6d1f314 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:13:59.389484 12794 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7d27810dbf334b46adba8668b6d1f314 [term 1 LEADER]: Becoming Leader. State: Replica: 7d27810dbf334b46adba8668b6d1f314, State: Running, Role: LEADER
I20260923 17:13:59.389923 12788 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7d27810dbf334b46adba8668b6d1f314 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:13:59.389889 12794 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7d27810dbf334b46adba8668b6d1f314 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d27810dbf334b46adba8668b6d1f314" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 34003 } }
I20260923 17:13:59.391992 12795 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d27810dbf334b46adba8668b6d1f314 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7d27810dbf334b46adba8668b6d1f314. Latest consensus state: current_term: 1 leader_uuid: "7d27810dbf334b46adba8668b6d1f314" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d27810dbf334b46adba8668b6d1f314" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 34003 } } }
I20260923 17:13:59.392166 12795 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d27810dbf334b46adba8668b6d1f314 [sys.catalog]: This master's current role is: LEADER
I20260923 17:13:59.392006 12793 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d27810dbf334b46adba8668b6d1f314 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7d27810dbf334b46adba8668b6d1f314" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d27810dbf334b46adba8668b6d1f314" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 34003 } } }
I20260923 17:13:59.392665 12793 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d27810dbf334b46adba8668b6d1f314 [sys.catalog]: This master's current role is: LEADER
W20260923 17:13:59.395063 12807 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7d27810dbf334b46adba8668b6d1f314: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 17:13:59.395155 12807 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 17:13:59.395269 12808 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:13:59.396206 12808 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:13:59.401652 12808 catalog_manager.cc:1347] Generated new cluster ID: b3a87eef803e4829ac67a85b0ff67a01
I20260923 17:13:59.401719 12808 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:13:59.429695 12808 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:13:59.431068 12808 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:13:59.439015 12808 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7d27810dbf334b46adba8668b6d1f314: Generated new TSK 0
I20260923 17:13:59.439827 12808 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.229.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab.
Entry for principal kudu/127.11.229.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab.
W20260923 17:14:00.531812 12182 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.11.229.129: real 1.085s user 0.000s sys 0.004s
I20260923 17:14:00.532315 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.129:0
--local_ip_for_outbound_sockets=127.11.229.129
--webserver_interface=127.11.229.129
--webserver_port=0
--tserver_master_addrs=127.11.229.190:34003
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab
--principal=kudu/127.11.229.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:35271
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:14:00.644460 12814 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:00.644721 12814 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:00.644763 12814 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:00.648838 12814 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:00.648898 12814 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:00.648957 12814 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.129
I20260923 17:14:00.654064 12814 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:35271
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab
--principal=kudu/127.11.229.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.229.129
--webserver_port=0
--tserver_master_addrs=127.11.229.190:34003
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12814
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.129
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:00.655119 12814 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:00.656055 12814 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:00.665863 12820 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:00.665863 12822 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:00.665863 12819 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:00.666401 12814 server_base.cc:1034] running on GCE node
I20260923 17:14:00.666836 12814 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:00.667472 12814 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:00.668659 12814 hybrid_clock.cc:648] HybridClock initialized: now 1790183640668635 us; error 45 us; skew 500 ppm
Sep 23 17:14:00 dist-test-slave-1x1f krb5kdc[12707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183640, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:00.671536 12814 init.cc:377] Logged in from keytab as kudu/127.11.229.129@KRBTEST.COM (short username kudu)
I20260923 17:14:00.672483 12814 webserver.cc:460] Webserver started at http://127.11.229.129:44405/ using document root <none> and password file <none>
I20260923 17:14:00.673053 12814 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:00.673148 12814 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:00.673377 12814 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:00.675411 12814 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/ts-0/data/instance:
uuid: "da973531bb7346dbb0b76e62171177c1"
format_stamp: "Formatted at 2026-09-23 17:14:00 on dist-test-slave-1x1f"
server_key: "a002e7d373c3cc18209a78314c7719f8"
server_key_iv: "0388c6a02f3d92b2905a7016046748ca"
server_key_version: "encryptionkey@0"
I20260923 17:14:00.675967 12814 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance:
uuid: "da973531bb7346dbb0b76e62171177c1"
format_stamp: "Formatted at 2026-09-23 17:14:00 on dist-test-slave-1x1f"
server_key: "a002e7d373c3cc18209a78314c7719f8"
server_key_iv: "0388c6a02f3d92b2905a7016046748ca"
server_key_version: "encryptionkey@0"
I20260923 17:14:00.679780 12814 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260923 17:14:00.682385 12829 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:00.683640 12814 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 17:14:00.683774 12814 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/ts-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/ts-0/wal
uuid: "da973531bb7346dbb0b76e62171177c1"
format_stamp: "Formatted at 2026-09-23 17:14:00 on dist-test-slave-1x1f"
server_key: "a002e7d373c3cc18209a78314c7719f8"
server_key_iv: "0388c6a02f3d92b2905a7016046748ca"
server_key_version: "encryptionkey@0"
I20260923 17:14:00.683889 12814 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:00.698931 12814 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:00.702052 12814 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:00.702320 12814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:00.702950 12814 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:14:00.703778 12814 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:14:00.703848 12814 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:00.703922 12814 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:14:00.703966 12814 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:00.713424 12814 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.129:35407
I20260923 17:14:00.713464 12942 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.129:35407 every 8 connection(s)
I20260923 17:14:00.714421 12814 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
I20260923 17:14:00.718746 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 12814
I20260923 17:14:00.718832 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance
I20260923 17:14:00.719108 12182 external_mini_cluster.cc:1428] Setting key 8a28cdf959e9e6320ab0521b665d33d2
Sep 23 17:14:00 dist-test-slave-1x1f krb5kdc[12707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183640, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.129@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.229.130@KRBTEST.COM; defaulting to no policy
I20260923 17:14:00.730194 12945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:00.716358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:45911 (local address 127.11.229.190:34003)
0923 17:14:00.716614 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:00.716618 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:00.717336 (+ 718us) server_negotiation.cc:407] Connection header received
0923 17:14:00.718399 (+ 1063us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:00.718402 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:00.718465 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:00.718589 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:00.720111 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:00.720719 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:00.722573 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:00.722971 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:00.723138 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:00.725938 (+ 2800us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:00.725946 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:00.725951 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:00.725986 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:00.727803 (+ 1817us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:00.728406 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:00.728413 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:00.728417 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:00.728506 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:00.728938 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:00.728942 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:00.728944 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:00.729147 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:00.729290 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:00.729862 (+ 572us) server_negotiation.cc:299] Negotiation successful
0923 17:14:00.729998 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":109,"threads_started":1}
I20260923 17:14:00.731096 12946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:00.716678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34003 (local address 127.11.229.129:45911)
0923 17:14:00.717187 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:00.717230 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:00.718136 (+ 906us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:00.718768 (+ 632us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:00.718776 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:00.719361 (+ 585us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:00.719948 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:00.719966 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:00.720900 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:00.720905 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:00.722455 (+ 1550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:00.722465 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:00.723301 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:00.723305 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:00.723472 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:00.724145 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:00.724161 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:00.725753 (+ 1592us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:00.727928 (+ 2175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:00.727933 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:00.727945 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:00.728294 (+ 349us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:00.728660 (+ 366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:00.728662 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:00.728664 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:00.728808 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:00.729302 (+ 494us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:00.729310 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:00.729609 (+ 299us) client_negotiation.cc:769] Sending connection context
0923 17:14:00.729822 (+ 213us) client_negotiation.cc:240] Negotiation successful
0923 17:14:00.730169 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":105,"threads_started":1}
I20260923 17:14:00.732565 12943 heartbeater.cc:347] Connected to a master server at 127.11.229.190:34003
I20260923 17:14:00.732832 12943 heartbeater.cc:464] Registering TS with master...
I20260923 17:14:00.733352 12943 heartbeater.cc:511] Master 127.11.229.190:34003 requested a full tablet report, sending...
I20260923 17:14:00.734973 12752 ts_manager.cc:194] Registered new tserver with Master: da973531bb7346dbb0b76e62171177c1 (127.11.229.129:35407)
I20260923 17:14:00.736290 12752 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.129@KRBTEST.COM'} at 127.11.229.129:45911
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab.
Entry for principal kudu/127.11.229.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab.
W20260923 17:14:01.573097 12182 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.11.229.130: real 0.852s user 0.001s sys 0.003s
I20260923 17:14:01.573833 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.130:0
--local_ip_for_outbound_sockets=127.11.229.130
--webserver_interface=127.11.229.130
--webserver_port=0
--tserver_master_addrs=127.11.229.190:34003
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab
--principal=kudu/127.11.229.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:35271
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:14:01.684424 12949 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:01.684748 12949 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:01.684831 12949 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:01.689229 12949 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:01.689327 12949 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:01.689419 12949 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.130
I20260923 17:14:01.695086 12949 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:35271
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab
--principal=kudu/127.11.229.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.229.130
--webserver_port=0
--tserver_master_addrs=127.11.229.190:34003
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12949
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.130
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:01.696139 12949 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:01.697152 12949 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:01.707270 12954 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:01.707245 12957 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:01.707245 12955 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:01.707711 12949 server_base.cc:1034] running on GCE node
I20260923 17:14:01.708148 12949 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:01.708781 12949 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:01.709975 12949 hybrid_clock.cc:648] HybridClock initialized: now 1790183641709954 us; error 34 us; skew 500 ppm
Sep 23 17:14:01 dist-test-slave-1x1f krb5kdc[12707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183641, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:01.712924 12949 init.cc:377] Logged in from keytab as kudu/127.11.229.130@KRBTEST.COM (short username kudu)
I20260923 17:14:01.714051 12949 webserver.cc:460] Webserver started at http://127.11.229.130:40051/ using document root <none> and password file <none>
I20260923 17:14:01.714737 12949 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:01.714840 12949 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:01.715097 12949 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:01.717301 12949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/ts-1/data/instance:
uuid: "148053c8764c4fec8af4bf2f211fdc6d"
format_stamp: "Formatted at 2026-09-23 17:14:01 on dist-test-slave-1x1f"
server_key: "839b90efd397b9e9e913009da69dd195"
server_key_iv: "dd722fafbf23d22b48af2419f1d5fce3"
server_key_version: "encryptionkey@0"
I20260923 17:14:01.717911 12949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance:
uuid: "148053c8764c4fec8af4bf2f211fdc6d"
format_stamp: "Formatted at 2026-09-23 17:14:01 on dist-test-slave-1x1f"
server_key: "839b90efd397b9e9e913009da69dd195"
server_key_iv: "dd722fafbf23d22b48af2419f1d5fce3"
server_key_version: "encryptionkey@0"
I20260923 17:14:01.721799 12949 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260923 17:14:01.724475 12964 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:01.725853 12949 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 17:14:01.726012 12949 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/ts-1/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/ts-1/wal
uuid: "148053c8764c4fec8af4bf2f211fdc6d"
format_stamp: "Formatted at 2026-09-23 17:14:01 on dist-test-slave-1x1f"
server_key: "839b90efd397b9e9e913009da69dd195"
server_key_iv: "dd722fafbf23d22b48af2419f1d5fce3"
server_key_version: "encryptionkey@0"
I20260923 17:14:01.726146 12949 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:01.738966 12943 heartbeater.cc:503] Master 127.11.229.190:34003 was elected leader, sending a full tablet report...
I20260923 17:14:01.768972 12949 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:01.772564 12949 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:01.772791 12949 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:01.773454 12949 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:14:01.774374 12949 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:14:01.774447 12949 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:01.774529 12949 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:14:01.774583 12949 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:01.784449 12949 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.130:32919
I20260923 17:14:01.784488 13077 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.130:32919 every 8 connection(s)
I20260923 17:14:01.785488 12949 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
I20260923 17:14:01.790771 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 12949
I20260923 17:14:01.790890 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance
I20260923 17:14:01.791203 12182 external_mini_cluster.cc:1428] Setting key a9b1bac5f9bd93c3c3392ab78cb7fbbf
Sep 23 17:14:01 dist-test-slave-1x1f krb5kdc[12707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183641, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.130@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.229.131@KRBTEST.COM; defaulting to no policy
I20260923 17:14:01.801553 13080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:01.787382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:47585 (local address 127.11.229.190:34003)
0923 17:14:01.787634 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:01.787638 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:01.788465 (+ 827us) server_negotiation.cc:407] Connection header received
0923 17:14:01.789751 (+ 1286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:01.789755 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:01.789812 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:01.789886 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:01.792243 (+ 2357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:01.792836 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:01.794357 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:01.794685 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:01.794750 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:01.797665 (+ 2915us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:01.797669 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:01.797671 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:01.797694 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:01.799313 (+ 1619us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:01.799857 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:01.799863 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:01.799865 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:01.799954 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:01.800334 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:01.800341 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:01.800343 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:01.800587 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:01.800706 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:01.801219 (+ 513us) server_negotiation.cc:299] Negotiation successful
0923 17:14:01.801353 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":87,"threads_started":1}
I20260923 17:14:01.802467 13081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:01.787792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34003 (local address 127.11.229.130:47585)
0923 17:14:01.788287 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:01.788328 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:01.789537 (+ 1209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:01.790952 (+ 1415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:01.790961 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:01.791493 (+ 532us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:01.792097 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:01.792112 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:01.792974 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:01.792977 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:01.794163 (+ 1186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:01.794178 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:01.794920 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:01.794922 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:01.795067 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:01.795657 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:01.795673 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:01.797473 (+ 1800us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:01.799439 (+ 1966us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:01.799446 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:01.799460 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:01.799744 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:01.800064 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:01.800067 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:01.800070 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:01.800232 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:01.800704 (+ 472us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:01.800711 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:01.800966 (+ 255us) client_negotiation.cc:769] Sending connection context
0923 17:14:01.801177 (+ 211us) client_negotiation.cc:240] Negotiation successful
0923 17:14:01.801508 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":143,"threads_started":1}
I20260923 17:14:01.803690 13078 heartbeater.cc:347] Connected to a master server at 127.11.229.190:34003
I20260923 17:14:01.803969 13078 heartbeater.cc:464] Registering TS with master...
I20260923 17:14:01.804476 13078 heartbeater.cc:511] Master 127.11.229.190:34003 requested a full tablet report, sending...
I20260923 17:14:01.805540 12752 ts_manager.cc:194] Registered new tserver with Master: 148053c8764c4fec8af4bf2f211fdc6d (127.11.229.130:32919)
I20260923 17:14:01.806144 12752 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.130@KRBTEST.COM'} at 127.11.229.130:47585
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab.
Entry for principal kudu/127.11.229.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab.
W20260923 17:14:02.730480 12182 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.11.229.131: real 0.937s user 0.000s sys 0.003s
I20260923 17:14:02.731081 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.131:0
--local_ip_for_outbound_sockets=127.11.229.131
--webserver_interface=127.11.229.131
--webserver_port=0
--tserver_master_addrs=127.11.229.190:34003
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab
--principal=kudu/127.11.229.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:35271
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 17:14:02.808336 13078 heartbeater.cc:503] Master 127.11.229.190:34003 was elected leader, sending a full tablet report...
W20260923 17:14:02.843533 13084 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:02.843827 13084 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:02.843899 13084 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:02.847978 13084 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:02.848065 13084 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:02.848155 13084 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.131
I20260923 17:14:02.853766 13084 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:35271
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab
--principal=kudu/127.11.229.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.229.131
--webserver_port=0
--tserver_master_addrs=127.11.229.190:34003
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13084
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.131
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:02.854874 13084 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:02.855903 13084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:02.865341 13092 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:02.865351 13090 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:02.865348 13089 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:02.865710 13084 server_base.cc:1034] running on GCE node
I20260923 17:14:02.866083 13084 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:02.866737 13084 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:02.868017 13084 hybrid_clock.cc:648] HybridClock initialized: now 1790183642867923 us; error 47 us; skew 500 ppm
Sep 23 17:14:02 dist-test-slave-1x1f krb5kdc[12707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183642, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:02.871157 13084 init.cc:377] Logged in from keytab as kudu/127.11.229.131@KRBTEST.COM (short username kudu)
I20260923 17:14:02.872088 13084 webserver.cc:460] Webserver started at http://127.11.229.131:36811/ using document root <none> and password file <none>
I20260923 17:14:02.872684 13084 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:02.872784 13084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:02.873034 13084 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:02.875228 13084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/ts-2/data/instance:
uuid: "22301aea826e49be89a6183447908e1b"
format_stamp: "Formatted at 2026-09-23 17:14:02 on dist-test-slave-1x1f"
server_key: "26975235978b7e44e2019f6a5e3f27fc"
server_key_iv: "b845a60a15eabbcdeea62c3cc09b637f"
server_key_version: "encryptionkey@0"
I20260923 17:14:02.875840 13084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance:
uuid: "22301aea826e49be89a6183447908e1b"
format_stamp: "Formatted at 2026-09-23 17:14:02 on dist-test-slave-1x1f"
server_key: "26975235978b7e44e2019f6a5e3f27fc"
server_key_iv: "b845a60a15eabbcdeea62c3cc09b637f"
server_key_version: "encryptionkey@0"
I20260923 17:14:02.879709 13084 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260923 17:14:02.882160 13099 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:02.883489 13084 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 17:14:02.883656 13084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/ts-2/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/ts-2/wal
uuid: "22301aea826e49be89a6183447908e1b"
format_stamp: "Formatted at 2026-09-23 17:14:02 on dist-test-slave-1x1f"
server_key: "26975235978b7e44e2019f6a5e3f27fc"
server_key_iv: "b845a60a15eabbcdeea62c3cc09b637f"
server_key_version: "encryptionkey@0"
I20260923 17:14:02.883778 13084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:02.901250 13084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:02.904703 13084 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:02.904909 13084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:02.905519 13084 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:14:02.906392 13084 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:14:02.906466 13084 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:02.906535 13084 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:14:02.906589 13084 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:02.916780 13084 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.131:41959
I20260923 17:14:02.916800 13212 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.131:41959 every 8 connection(s)
I20260923 17:14:02.917779 13084 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
Sep 23 17:14:02 dist-test-slave-1x1f krb5kdc[12707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183642, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.131@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:14:02.927788 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 13084
I20260923 17:14:02.927927 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance
I20260923 17:14:02.928265 12182 external_mini_cluster.cc:1428] Setting key 0cbd781fbda1546ec82bb54074150dd6
I20260923 17:14:02.932606 13215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:02.919720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:41097 (local address 127.11.229.190:34003)
0923 17:14:02.919990 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:02.919994 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:02.920845 (+ 851us) server_negotiation.cc:407] Connection header received
0923 17:14:02.921752 (+ 907us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:02.921756 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:02.921832 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:02.921972 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:02.923348 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:02.923897 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:02.925043 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:02.925279 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:02.925366 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:02.928136 (+ 2770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:02.928140 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:02.928143 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:02.928172 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:02.930143 (+ 1971us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:02.930866 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:02.930872 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:02.930874 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:02.930977 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:02.931411 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:02.931415 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:02.931417 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:02.931622 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:02.931738 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:02.932282 (+ 544us) server_negotiation.cc:299] Negotiation successful
0923 17:14:02.932416 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":78,"threads_started":1}
I20260923 17:14:02.933468 13216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:02.920221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34003 (local address 127.11.229.131:41097)
0923 17:14:02.920688 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:02.920732 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:02.921471 (+ 739us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:02.922174 (+ 703us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:02.922186 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:02.922735 (+ 549us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:02.923218 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:02.923230 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:02.924018 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:02.924021 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:02.924920 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:02.924928 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:02.925446 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:02.925450 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:02.925627 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:02.926307 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:02.926324 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:02.927914 (+ 1590us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:02.930310 (+ 2396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:02.930316 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:02.930334 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:02.930757 (+ 423us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:02.931092 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:02.931096 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:02.931098 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:02.931272 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:02.931748 (+ 476us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:02.931758 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:02.932024 (+ 266us) client_negotiation.cc:769] Sending connection context
0923 17:14:02.932219 (+ 195us) client_negotiation.cc:240] Negotiation successful
0923 17:14:02.932583 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":119,"threads_started":1}
I20260923 17:14:02.934708 13213 heartbeater.cc:347] Connected to a master server at 127.11.229.190:34003
I20260923 17:14:02.934944 13213 heartbeater.cc:464] Registering TS with master...
I20260923 17:14:02.935420 13213 heartbeater.cc:511] Master 127.11.229.190:34003 requested a full tablet report, sending...
I20260923 17:14:02.936424 12752 ts_manager.cc:194] Registered new tserver with Master: 22301aea826e49be89a6183447908e1b (127.11.229.131:41959)
I20260923 17:14:02.936981 12752 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.131@KRBTEST.COM'} at 127.11.229.131:41097
I20260923 17:14:02.942838 12182 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 17:14:02.953203 13215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:02.946320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58532 (local address 127.11.229.190:34003)
0923 17:14:02.946440 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:02.946444 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:02.946634 (+ 190us) server_negotiation.cc:407] Connection header received
0923 17:14:02.946724 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:02.946727 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:02.946766 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:02.946833 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:02.947518 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:02.948051 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:02.948846 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:02.949060 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:02.949134 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:02.950465 (+ 1331us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:02.950468 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:02.950470 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:02.950491 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:02.951807 (+ 1316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:02.952170 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:02.952173 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:02.952174 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:02.952247 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:02.952462 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:02.952464 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:02.952465 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:02.952692 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:02.952797 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:02.952986 (+ 189us) server_negotiation.cc:299] Negotiation successful
0923 17:14:02.953081 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260923 17:14:02.958401 12752 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58532:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 17:14:02.961350 12752 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 17:14:02.976116 13228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:02.970243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55012 (local address 127.11.229.130:32919)
0923 17:14:02.971125 (+ 882us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:02.971134 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:02.971158 (+ 24us) server_negotiation.cc:407] Connection header received
0923 17:14:02.971239 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:02.971247 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:02.971489 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:02.971652 (+ 163us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:14:02.971986 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:02.973125 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:02.974742 (+ 1617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:02.975335 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:02.975519 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:02.975657 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:02.975853 (+ 196us) server_negotiation.cc:299] Negotiation successful
0923 17:14:02.975947 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":775,"thread_start_us":64,"threads_started":1}
I20260923 17:14:02.976130 13227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:02.970120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.130:32919 (local address 127.0.0.1:55012)
0923 17:14:02.970591 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:02.970602 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:02.970673 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:02.971687 (+ 1014us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:02.971693 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:02.971719 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:14:02.971858 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:02.971865 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:02.973252 (+ 1387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:02.973255 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:02.974601 (+ 1346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:02.974613 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:02.975530 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:02.975533 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:02.975645 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:02.975688 (+ 43us) client_negotiation.cc:769] Sending connection context
0923 17:14:02.975818 (+ 130us) client_negotiation.cc:240] Negotiation successful
0923 17:14:02.975948 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":401,"mutex_wait_us":27,"thread_start_us":121,"threads_started":1}
I20260923 17:14:02.976511 13226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:02.970083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:35407 (local address 127.0.0.1:47988)
0923 17:14:02.970482 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:02.970537 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:02.970673 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:02.972182 (+ 1509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:02.972184 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:02.972199 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:14:02.972275 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:02.972280 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:02.973309 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:02.973316 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:02.974667 (+ 1351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:02.974679 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:02.976077 (+ 1398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:02.976081 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:02.976180 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:02.976210 (+ 30us) client_negotiation.cc:769] Sending connection context
0923 17:14:02.976294 (+ 84us) client_negotiation.cc:240] Negotiation successful
0923 17:14:02.976362 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":216,"mutex_wait_us":115,"thread_start_us":138,"threads_started":1}
I20260923 17:14:02.976728 13229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:02.970917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.131:41959 (local address 127.0.0.1:52832)
0923 17:14:02.971248 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:02.971263 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:02.971359 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:02.972414 (+ 1055us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:02.972418 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:02.972435 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:14:02.972531 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:02.972537 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:02.974006 (+ 1469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:02.974010 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:02.975298 (+ 1288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:02.975308 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:02.976374 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:02.976378 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:02.976457 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:02.976479 (+ 22us) client_negotiation.cc:769] Sending connection context
0923 17:14:02.976535 (+ 56us) client_negotiation.cc:240] Negotiation successful
0923 17:14:02.976609 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"mutex_wait_us":3,"thread_start_us":110,"threads_started":1}
I20260923 17:14:02.977125 13230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:02.971106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47988 (local address 127.11.229.129:35407)
0923 17:14:02.971613 (+ 507us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:02.971621 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:02.971644 (+ 23us) server_negotiation.cc:407] Connection header received
0923 17:14:02.971716 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:02.971722 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:02.971909 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:02.972053 (+ 144us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:14:02.972399 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:02.973182 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:02.974814 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:02.975771 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:02.975888 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:02.976013 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:02.976898 (+ 885us) server_negotiation.cc:299] Negotiation successful
0923 17:14:02.977008 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":69,"threads_started":1}
I20260923 17:14:02.977294 13231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:02.971102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52832 (local address 127.11.229.131:41959)
0923 17:14:02.971987 (+ 885us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:02.971999 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:02.972020 (+ 21us) server_negotiation.cc:407] Connection header received
0923 17:14:02.972091 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:02.972096 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:02.972262 (+ 166us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:02.972670 (+ 408us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:14:02.972807 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:02.973856 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:02.975431 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:02.976223 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:02.976919 (+ 696us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:02.977031 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:02.977076 (+ 45us) server_negotiation.cc:299] Negotiation successful
0923 17:14:02.977154 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":762,"thread_start_us":140,"threads_started":1}
I20260923 17:14:02.979782 13147 tablet_service.cc:1467] Processing CreateTablet for tablet 3d840141a8dc45b0a854a7bf343e37be (DEFAULT_TABLE table=test-table [id=eb1eea70c8c8412ea66a3829a852f078]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:14:02.979812 12877 tablet_service.cc:1467] Processing CreateTablet for tablet 3d840141a8dc45b0a854a7bf343e37be (DEFAULT_TABLE table=test-table [id=eb1eea70c8c8412ea66a3829a852f078]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:14:02.979812 13012 tablet_service.cc:1467] Processing CreateTablet for tablet 3d840141a8dc45b0a854a7bf343e37be (DEFAULT_TABLE table=test-table [id=eb1eea70c8c8412ea66a3829a852f078]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:14:02.980793 13147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d840141a8dc45b0a854a7bf343e37be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:02.980870 12877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d840141a8dc45b0a854a7bf343e37be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:02.980870 13012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3d840141a8dc45b0a854a7bf343e37be. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:02.989427 13233 tablet_bootstrap.cc:492] T 3d840141a8dc45b0a854a7bf343e37be P 148053c8764c4fec8af4bf2f211fdc6d: Bootstrap starting.
I20260923 17:14:02.989933 13232 tablet_bootstrap.cc:492] T 3d840141a8dc45b0a854a7bf343e37be P 22301aea826e49be89a6183447908e1b: Bootstrap starting.
I20260923 17:14:02.990549 13234 tablet_bootstrap.cc:492] T 3d840141a8dc45b0a854a7bf343e37be P da973531bb7346dbb0b76e62171177c1: Bootstrap starting.
I20260923 17:14:02.992092 13232 tablet_bootstrap.cc:654] T 3d840141a8dc45b0a854a7bf343e37be P 22301aea826e49be89a6183447908e1b: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:02.992177 13233 tablet_bootstrap.cc:654] T 3d840141a8dc45b0a854a7bf343e37be P 148053c8764c4fec8af4bf2f211fdc6d: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:02.992726 13234 tablet_bootstrap.cc:654] T 3d840141a8dc45b0a854a7bf343e37be P da973531bb7346dbb0b76e62171177c1: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:02.993109 13233 log.cc:824] T 3d840141a8dc45b0a854a7bf343e37be P 148053c8764c4fec8af4bf2f211fdc6d: Log is configured to *not* fsync() on all Append() calls
I20260923 17:14:02.993161 13232 log.cc:824] T 3d840141a8dc45b0a854a7bf343e37be P 22301aea826e49be89a6183447908e1b: Log is configured to *not* fsync() on all Append() calls
I20260923 17:14:02.993520 13234 log.cc:824] T 3d840141a8dc45b0a854a7bf343e37be P da973531bb7346dbb0b76e62171177c1: Log is configured to *not* fsync() on all Append() calls
I20260923 17:14:02.995169 13232 tablet_bootstrap.cc:492] T 3d840141a8dc45b0a854a7bf343e37be P 22301aea826e49be89a6183447908e1b: No bootstrap required, opened a new log
I20260923 17:14:02.995323 13233 tablet_bootstrap.cc:492] T 3d840141a8dc45b0a854a7bf343e37be P 148053c8764c4fec8af4bf2f211fdc6d: No bootstrap required, opened a new log
I20260923 17:14:02.995410 13232 ts_tablet_manager.cc:1397] T 3d840141a8dc45b0a854a7bf343e37be P 22301aea826e49be89a6183447908e1b: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260923 17:14:02.995512 13233 ts_tablet_manager.cc:1397] T 3d840141a8dc45b0a854a7bf343e37be P 148053c8764c4fec8af4bf2f211fdc6d: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260923 17:14:02.995568 13234 tablet_bootstrap.cc:492] T 3d840141a8dc45b0a854a7bf343e37be P da973531bb7346dbb0b76e62171177c1: No bootstrap required, opened a new log
I20260923 17:14:02.995719 13234 ts_tablet_manager.cc:1397] T 3d840141a8dc45b0a854a7bf343e37be P da973531bb7346dbb0b76e62171177c1: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260923 17:14:02.998396 13232 raft_consensus.cc:348] T 3d840141a8dc45b0a854a7bf343e37be P 22301aea826e49be89a6183447908e1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "148053c8764c4fec8af4bf2f211fdc6d" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 32919 } } peers { permanent_uuid: "da973531bb7346dbb0b76e62171177c1" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 35407 } } peers { permanent_uuid: "22301aea826e49be89a6183447908e1b" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 41959 } }
I20260923 17:14:02.998651 13232 raft_consensus.cc:374] T 3d840141a8dc45b0a854a7bf343e37be P 22301aea826e49be89a6183447908e1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:02.998730 13232 raft_consensus.cc:729] T 3d840141a8dc45b0a854a7bf343e37be P 22301aea826e49be89a6183447908e1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22301aea826e49be89a6183447908e1b, State: Initialized, Role: FOLLOWER
I20260923 17:14:02.999186 13232 consensus_queue.cc:260] T 3d840141a8dc45b0a854a7bf343e37be P 22301aea826e49be89a6183447908e1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "148053c8764c4fec8af4bf2f211fdc6d" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 32919 } } peers { permanent_uuid: "da973531bb7346dbb0b76e62171177c1" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 35407 } } peers { permanent_uuid: "22301aea826e49be89a6183447908e1b" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 41959 } }
I20260923 17:14:02.999835 13213 heartbeater.cc:503] Master 127.11.229.190:34003 was elected leader, sending a full tablet report...
I20260923 17:14:03.000214 13232 ts_tablet_manager.cc:1428] T 3d840141a8dc45b0a854a7bf343e37be P 22301aea826e49be89a6183447908e1b: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260923 17:14:03.000069 13234 raft_consensus.cc:348] T 3d840141a8dc45b0a854a7bf343e37be P da973531bb7346dbb0b76e62171177c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "148053c8764c4fec8af4bf2f211fdc6d" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 32919 } } peers { permanent_uuid: "da973531bb7346dbb0b76e62171177c1" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 35407 } } peers { permanent_uuid: "22301aea826e49be89a6183447908e1b" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 41959 } }
I20260923 17:14:03.000062 13233 raft_consensus.cc:348] T 3d840141a8dc45b0a854a7bf343e37be P 148053c8764c4fec8af4bf2f211fdc6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "148053c8764c4fec8af4bf2f211fdc6d" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 32919 } } peers { permanent_uuid: "da973531bb7346dbb0b76e62171177c1" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 35407 } } peers { permanent_uuid: "22301aea826e49be89a6183447908e1b" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 41959 } }
I20260923 17:14:03.000308 13233 raft_consensus.cc:374] T 3d840141a8dc45b0a854a7bf343e37be P 148053c8764c4fec8af4bf2f211fdc6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:03.000308 13234 raft_consensus.cc:374] T 3d840141a8dc45b0a854a7bf343e37be P da973531bb7346dbb0b76e62171177c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:03.000357 13233 raft_consensus.cc:729] T 3d840141a8dc45b0a854a7bf343e37be P 148053c8764c4fec8af4bf2f211fdc6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148053c8764c4fec8af4bf2f211fdc6d, State: Initialized, Role: FOLLOWER
I20260923 17:14:03.000363 13234 raft_consensus.cc:729] T 3d840141a8dc45b0a854a7bf343e37be P da973531bb7346dbb0b76e62171177c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da973531bb7346dbb0b76e62171177c1, State: Initialized, Role: FOLLOWER
I20260923 17:14:03.000808 13233 consensus_queue.cc:260] T 3d840141a8dc45b0a854a7bf343e37be P 148053c8764c4fec8af4bf2f211fdc6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "148053c8764c4fec8af4bf2f211fdc6d" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 32919 } } peers { permanent_uuid: "da973531bb7346dbb0b76e62171177c1" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 35407 } } peers { permanent_uuid: "22301aea826e49be89a6183447908e1b" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 41959 } }
I20260923 17:14:03.000981 13234 consensus_queue.cc:260] T 3d840141a8dc45b0a854a7bf343e37be P da973531bb7346dbb0b76e62171177c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "148053c8764c4fec8af4bf2f211fdc6d" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 32919 } } peers { permanent_uuid: "da973531bb7346dbb0b76e62171177c1" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 35407 } } peers { permanent_uuid: "22301aea826e49be89a6183447908e1b" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 41959 } }
I20260923 17:14:03.001760 13233 ts_tablet_manager.cc:1428] T 3d840141a8dc45b0a854a7bf343e37be P 148053c8764c4fec8af4bf2f211fdc6d: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260923 17:14:03.001900 13234 ts_tablet_manager.cc:1428] T 3d840141a8dc45b0a854a7bf343e37be P da973531bb7346dbb0b76e62171177c1: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
W20260923 17:14:03.037357 13079 tablet.cc:2369] T 3d840141a8dc45b0a854a7bf343e37be P 148053c8764c4fec8af4bf2f211fdc6d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 17:14:03.149974 13240 raft_consensus.cc:482] T 3d840141a8dc45b0a854a7bf343e37be P da973531bb7346dbb0b76e62171177c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 17:14:03.150226 13240 raft_consensus.cc:504] T 3d840141a8dc45b0a854a7bf343e37be P da973531bb7346dbb0b76e62171177c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "148053c8764c4fec8af4bf2f211fdc6d" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 32919 } } peers { permanent_uuid: "da973531bb7346dbb0b76e62171177c1" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 35407 } } peers { permanent_uuid: "22301aea826e49be89a6183447908e1b" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 41959 } }
I20260923 17:14:03.151521 13240 leader_election.cc:288] T 3d840141a8dc45b0a854a7bf343e37be P da973531bb7346dbb0b76e62171177c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 148053c8764c4fec8af4bf2f211fdc6d (127.11.229.130:32919), 22301aea826e49be89a6183447908e1b (127.11.229.131:41959)
I20260923 17:14:03.157240 13228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:03.151906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:40515 (local address 127.11.229.130:32919)
0923 17:14:03.152042 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:03.152047 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:03.152345 (+ 298us) server_negotiation.cc:407] Connection header received
0923 17:14:03.152534 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:03.152539 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:03.152599 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:03.152711 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:14:03.153172 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:03.154085 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:03.155914 (+ 1829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:03.156554 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:03.156682 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:03.156733 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:03.157036 (+ 303us) server_negotiation.cc:299] Negotiation successful
0923 17:14:03.157109 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260923 17:14:03.157240 13231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:03.151933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:38241 (local address 127.11.229.131:41959)
0923 17:14:03.152092 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:03.152097 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:03.152343 (+ 246us) server_negotiation.cc:407] Connection header received
0923 17:14:03.152571 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:03.152574 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:03.152636 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:03.152719 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:14:03.153172 (+ 453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:03.154153 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:03.155914 (+ 1761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:03.156549 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:03.156682 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:03.156733 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:03.157036 (+ 303us) server_negotiation.cc:299] Negotiation successful
0923 17:14:03.157108 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260923 17:14:03.157303 13242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:03.151829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.131:41959 (local address 127.11.229.129:38241)
0923 17:14:03.152215 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:03.152231 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:03.152374 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:03.152741 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:03.152744 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:03.152773 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:14:03.153037 (+ 264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:03.153043 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:03.154368 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:03.154372 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:03.155760 (+ 1388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:03.155771 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:03.156698 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:03.156702 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:03.156845 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:03.156919 (+ 74us) client_negotiation.cc:769] Sending connection context
0923 17:14:03.156999 (+ 80us) client_negotiation.cc:240] Negotiation successful
0923 17:14:03.157110 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":315,"mutex_wait_us":210,"spinlock_wait_cycles":21248,"thread_start_us":156,"threads_started":1}
I20260923 17:14:03.157308 13241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:03.151840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.130:32919 (local address 127.11.229.129:40515)
0923 17:14:03.152215 (+ 375us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:03.152231 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:03.152374 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:03.152741 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:03.152744 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:03.152770 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:14:03.153031 (+ 261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:03.153040 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:03.154275 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:03.154279 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:03.155764 (+ 1485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:03.155771 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:03.156698 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:03.156702 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:03.156863 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:03.156922 (+ 59us) client_negotiation.cc:769] Sending connection context
0923 17:14:03.156999 (+ 77us) client_negotiation.cc:240] Negotiation successful
0923 17:14:03.157110 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":327,"mutex_wait_us":255,"spinlock_wait_cycles":24576,"thread_start_us":158,"threads_started":1}
I20260923 17:14:03.158015 13167 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d840141a8dc45b0a854a7bf343e37be" candidate_uuid: "da973531bb7346dbb0b76e62171177c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22301aea826e49be89a6183447908e1b" is_pre_election: true
I20260923 17:14:03.158270 13032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d840141a8dc45b0a854a7bf343e37be" candidate_uuid: "da973531bb7346dbb0b76e62171177c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148053c8764c4fec8af4bf2f211fdc6d" is_pre_election: true
I20260923 17:14:03.158430 13167 raft_consensus.cc:2454] T 3d840141a8dc45b0a854a7bf343e37be P 22301aea826e49be89a6183447908e1b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da973531bb7346dbb0b76e62171177c1 in term 0.
I20260923 17:14:03.158555 13032 raft_consensus.cc:2454] T 3d840141a8dc45b0a854a7bf343e37be P 148053c8764c4fec8af4bf2f211fdc6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate da973531bb7346dbb0b76e62171177c1 in term 0.
I20260923 17:14:03.158998 12832 leader_election.cc:302] T 3d840141a8dc45b0a854a7bf343e37be P da973531bb7346dbb0b76e62171177c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 148053c8764c4fec8af4bf2f211fdc6d, 22301aea826e49be89a6183447908e1b, da973531bb7346dbb0b76e62171177c1; no voters:
I20260923 17:14:03.159409 13240 raft_consensus.cc:2781] T 3d840141a8dc45b0a854a7bf343e37be P da973531bb7346dbb0b76e62171177c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 17:14:03.159519 13240 raft_consensus.cc:482] T 3d840141a8dc45b0a854a7bf343e37be P da973531bb7346dbb0b76e62171177c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 17:14:03.159593 13240 raft_consensus.cc:3037] T 3d840141a8dc45b0a854a7bf343e37be P da973531bb7346dbb0b76e62171177c1 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:03.160635 13240 raft_consensus.cc:504] T 3d840141a8dc45b0a854a7bf343e37be P da973531bb7346dbb0b76e62171177c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "148053c8764c4fec8af4bf2f211fdc6d" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 32919 } } peers { permanent_uuid: "da973531bb7346dbb0b76e62171177c1" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 35407 } } peers { permanent_uuid: "22301aea826e49be89a6183447908e1b" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 41959 } }
I20260923 17:14:03.161012 13240 leader_election.cc:288] T 3d840141a8dc45b0a854a7bf343e37be P da973531bb7346dbb0b76e62171177c1 [CANDIDATE]: Term 1 election: Requested vote from peers 148053c8764c4fec8af4bf2f211fdc6d (127.11.229.130:32919), 22301aea826e49be89a6183447908e1b (127.11.229.131:41959)
I20260923 17:14:03.161383 13167 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d840141a8dc45b0a854a7bf343e37be" candidate_uuid: "da973531bb7346dbb0b76e62171177c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22301aea826e49be89a6183447908e1b"
I20260923 17:14:03.161423 13032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3d840141a8dc45b0a854a7bf343e37be" candidate_uuid: "da973531bb7346dbb0b76e62171177c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "148053c8764c4fec8af4bf2f211fdc6d"
I20260923 17:14:03.161523 13167 raft_consensus.cc:3037] T 3d840141a8dc45b0a854a7bf343e37be P 22301aea826e49be89a6183447908e1b [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:03.161537 13032 raft_consensus.cc:3037] T 3d840141a8dc45b0a854a7bf343e37be P 148053c8764c4fec8af4bf2f211fdc6d [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:03.162613 13032 raft_consensus.cc:2454] T 3d840141a8dc45b0a854a7bf343e37be P 148053c8764c4fec8af4bf2f211fdc6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da973531bb7346dbb0b76e62171177c1 in term 1.
I20260923 17:14:03.162643 13167 raft_consensus.cc:2454] T 3d840141a8dc45b0a854a7bf343e37be P 22301aea826e49be89a6183447908e1b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate da973531bb7346dbb0b76e62171177c1 in term 1.
I20260923 17:14:03.162948 12833 leader_election.cc:302] T 3d840141a8dc45b0a854a7bf343e37be P da973531bb7346dbb0b76e62171177c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148053c8764c4fec8af4bf2f211fdc6d, da973531bb7346dbb0b76e62171177c1; no voters:
I20260923 17:14:03.163127 13240 raft_consensus.cc:2781] T 3d840141a8dc45b0a854a7bf343e37be P da973531bb7346dbb0b76e62171177c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:14:03.163362 13240 raft_consensus.cc:686] T 3d840141a8dc45b0a854a7bf343e37be P da973531bb7346dbb0b76e62171177c1 [term 1 LEADER]: Becoming Leader. State: Replica: da973531bb7346dbb0b76e62171177c1, State: Running, Role: LEADER
I20260923 17:14:03.163697 13240 consensus_queue.cc:237] T 3d840141a8dc45b0a854a7bf343e37be P da973531bb7346dbb0b76e62171177c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "148053c8764c4fec8af4bf2f211fdc6d" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 32919 } } peers { permanent_uuid: "da973531bb7346dbb0b76e62171177c1" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 35407 } } peers { permanent_uuid: "22301aea826e49be89a6183447908e1b" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 41959 } }
I20260923 17:14:03.166950 12751 catalog_manager.cc:5495] T 3d840141a8dc45b0a854a7bf343e37be P da973531bb7346dbb0b76e62171177c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to da973531bb7346dbb0b76e62171177c1 (127.11.229.129). New cstate: current_term: 1 leader_uuid: "da973531bb7346dbb0b76e62171177c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "148053c8764c4fec8af4bf2f211fdc6d" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 32919 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da973531bb7346dbb0b76e62171177c1" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 35407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22301aea826e49be89a6183447908e1b" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 41959 } health_report { overall_health: UNKNOWN } } }
W20260923 17:14:03.168812 13214 tablet.cc:2369] T 3d840141a8dc45b0a854a7bf343e37be P 22301aea826e49be89a6183447908e1b: Can't schedule compaction. Clean time has not been advanced past its initial value.
Sep 23 17:14:03 dist-test-slave-1x1f krb5kdc[12707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183637, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.229.129@KRBTEST.COM
I20260923 17:14:03.216452 13230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:03.206960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47990 (local address 127.11.229.129:35407)
0923 17:14:03.207245 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:03.207249 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:03.207340 (+ 91us) server_negotiation.cc:407] Connection header received
0923 17:14:03.207457 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:03.207460 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:03.207501 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:03.207571 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:03.208437 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:03.208964 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:03.209817 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:03.210030 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:03.210103 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:03.212590 (+ 2487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:03.212601 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:03.212617 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:03.212645 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:03.214468 (+ 1823us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:03.214894 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:03.214900 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:03.214901 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:03.214986 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:03.215359 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:03.215361 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:03.215363 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:03.215639 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:03.215822 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:03.216070 (+ 248us) server_negotiation.cc:299] Negotiation successful
0923 17:14:03.216221 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186}
W20260923 17:14:03.217294 12944 tablet.cc:2369] T 3d840141a8dc45b0a854a7bf343e37be P da973531bb7346dbb0b76e62171177c1: Can't schedule compaction. Clean time has not been advanced past its initial value.
Sep 23 17:14:03 dist-test-slave-1x1f krb5kdc[12707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183643, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 23 17:14:03 dist-test-slave-1x1f krb5kdc[12707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183643, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.229.129@KRBTEST.COM
I20260923 17:14:03.244988 13230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:03.235502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48006 (local address 127.11.229.129:35407)
0923 17:14:03.235644 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:03.235649 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:03.235807 (+ 158us) server_negotiation.cc:407] Connection header received
0923 17:14:03.235975 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:03.235979 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:03.236022 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:03.236109 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:03.236826 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:03.237349 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:03.238207 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:03.238497 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:03.238609 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:03.240958 (+ 2349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:03.240961 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:03.240963 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:03.240988 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:03.243065 (+ 2077us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:03.243553 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:03.243559 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:03.243561 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:03.243649 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:03.243976 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:03.243981 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:03.243983 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:03.244206 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:03.244357 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:03.244666 (+ 309us) server_negotiation.cc:299] Negotiation successful
0923 17:14:03.244800 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
Sep 23 17:14:03 dist-test-slave-1x1f krb5kdc[12707](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183643, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 23 17:14:03 dist-test-slave-1x1f krb5kdc[12707](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183643, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.229.129@KRBTEST.COM
I20260923 17:14:03.272233 13230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:03.263314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48016 (local address 127.11.229.129:35407)
0923 17:14:03.263479 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:03.263484 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:03.263500 (+ 16us) server_negotiation.cc:407] Connection header received
0923 17:14:03.263666 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:03.263670 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:03.263720 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:03.263814 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:03.264543 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:03.265151 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:03.266081 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:03.266370 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:03.266455 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:03.268890 (+ 2435us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:03.268893 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:03.268896 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:03.268920 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:03.270568 (+ 1648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:03.271051 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:03.271054 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:03.271056 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:03.271134 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:03.271394 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:03.271397 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:03.271398 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:03.271564 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:03.271669 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:03.271876 (+ 207us) server_negotiation.cc:299] Negotiation successful
0923 17:14:03.271970 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
W20260923 17:14:03.273765 12857 tablet_service.cc:2908] Rejecting scan request for tablet 3d840141a8dc45b0a854a7bf343e37be: Uninitialized: clean time has not yet been initialized
I20260923 17:14:03.276119 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 12814
I20260923 17:14:03.282698 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 12949
I20260923 17:14:03.288689 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 13084
I20260923 17:14:03.294668 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 12720
2026-09-23T17:14:03Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (7226 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 17:14:03 dist-test-slave-1x1f krb5kdc[13257](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 17:14:03 dist-test-slave-1x1f krb5kdc[13257](info): set up 2 sockets
Sep 23 17:14:03 dist-test-slave-1x1f krb5kdc[13257](info): commencing operation
krb5kdc: starting...
W20260923 17:14:04.382623 12182 mini_kdc.cc:121] Time spent starting KDC: real 1.064s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Sep 23 17:14:04 dist-test-slave-1x1f krb5kdc[13257](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183644, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T17:14:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:14:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.229.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
I20260923 17:14:04.509648 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:43857
--webserver_interface=127.11.229.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:38991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:43857
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:14:04.618806 13270 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:04.619098 13270 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:04.619202 13270 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:04.623572 13270 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:14:04.623656 13270 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260923 17:14:04.623687 13270 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:04.623750 13270 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:04.623805 13270 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:14:04.623843 13270 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:14:04.629251 13270 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:38991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:43857
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:43857
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.229.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13270
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:04.630380 13270 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:04.631431 13270 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:04.640041 13275 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:04.640166 13278 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:04.640041 13276 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:04.640277 13270 server_base.cc:1034] running on GCE node
I20260923 17:14:04.640956 13270 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:04.642217 13270 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:04.643448 13270 hybrid_clock.cc:648] HybridClock initialized: now 1790183644643430 us; error 29 us; skew 500 ppm
Sep 23 17:14:04 dist-test-slave-1x1f krb5kdc[13257](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183644, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:04.650751 13270 init.cc:377] Logged in from keytab as kudu/127.11.229.190@KRBTEST.COM (short username kudu)
I20260923 17:14:04.651700 13270 webserver.cc:460] Webserver started at http://127.11.229.190:32907/ using document root <none> and password file <none>
I20260923 17:14:04.652295 13270 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:04.652390 13270 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:04.652627 13270 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:04.654851 13270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "6112ca0421594b58a0155fb655bbbd75"
format_stamp: "Formatted at 2026-09-23 17:14:04 on dist-test-slave-1x1f"
server_key: "13a3618cff41b093f3e43aef185e2757"
server_key_iv: "dd637c82ac5d398ac8741cae56d0e223"
server_key_version: "encryptionkey@0"
I20260923 17:14:04.655429 13270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "6112ca0421594b58a0155fb655bbbd75"
format_stamp: "Formatted at 2026-09-23 17:14:04 on dist-test-slave-1x1f"
server_key: "13a3618cff41b093f3e43aef185e2757"
server_key_iv: "dd637c82ac5d398ac8741cae56d0e223"
server_key_version: "encryptionkey@0"
I20260923 17:14:04.659246 13270 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260923 17:14:04.661665 13285 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:04.662961 13270 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260923 17:14:04.663100 13270 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "6112ca0421594b58a0155fb655bbbd75"
format_stamp: "Formatted at 2026-09-23 17:14:04 on dist-test-slave-1x1f"
server_key: "13a3618cff41b093f3e43aef185e2757"
server_key_iv: "dd637c82ac5d398ac8741cae56d0e223"
server_key_version: "encryptionkey@0"
I20260923 17:14:04.663213 13270 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:04.676460 13270 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:04.679453 13270 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:04.679662 13270 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:04.687425 13270 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.190:43857
I20260923 17:14:04.687441 13347 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.190:43857 every 8 connection(s)
I20260923 17:14:04.688519 13270 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:14:04.691407 13348 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:04.696002 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 13270
I20260923 17:14:04.696136 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:14:04.696383 12182 external_mini_cluster.cc:1428] Setting key 39894ba6d56b9ab9d9ce10c532740d7d
I20260923 17:14:04.696966 13348 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6112ca0421594b58a0155fb655bbbd75: Bootstrap starting.
I20260923 17:14:04.699430 13348 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6112ca0421594b58a0155fb655bbbd75: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:04.700179 13348 log.cc:824] T 00000000000000000000000000000000 P 6112ca0421594b58a0155fb655bbbd75: Log is configured to *not* fsync() on all Append() calls
I20260923 17:14:04.702023 13348 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6112ca0421594b58a0155fb655bbbd75: No bootstrap required, opened a new log
Sep 23 17:14:04 dist-test-slave-1x1f krb5kdc[13257](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183644, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:14:04.705250 13348 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6112ca0421594b58a0155fb655bbbd75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6112ca0421594b58a0155fb655bbbd75" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43857 } }
I20260923 17:14:04.705515 13348 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6112ca0421594b58a0155fb655bbbd75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:04.705590 13348 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6112ca0421594b58a0155fb655bbbd75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6112ca0421594b58a0155fb655bbbd75, State: Initialized, Role: FOLLOWER
I20260923 17:14:04.706048 13348 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6112ca0421594b58a0155fb655bbbd75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6112ca0421594b58a0155fb655bbbd75" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43857 } }
I20260923 17:14:04.706214 13348 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6112ca0421594b58a0155fb655bbbd75 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:14:04.706310 13348 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6112ca0421594b58a0155fb655bbbd75 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:14:04.706440 13348 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6112ca0421594b58a0155fb655bbbd75 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:04.707477 13348 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6112ca0421594b58a0155fb655bbbd75 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6112ca0421594b58a0155fb655bbbd75" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43857 } }
I20260923 17:14:04.707860 13348 leader_election.cc:302] T 00000000000000000000000000000000 P 6112ca0421594b58a0155fb655bbbd75 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6112ca0421594b58a0155fb655bbbd75; no voters:
I20260923 17:14:04.708189 13348 leader_election.cc:288] T 00000000000000000000000000000000 P 6112ca0421594b58a0155fb655bbbd75 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 17:14:04.708263 13353 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6112ca0421594b58a0155fb655bbbd75 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:14:04.708473 13353 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6112ca0421594b58a0155fb655bbbd75 [term 1 LEADER]: Becoming Leader. State: Replica: 6112ca0421594b58a0155fb655bbbd75, State: Running, Role: LEADER
I20260923 17:14:04.708762 13353 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6112ca0421594b58a0155fb655bbbd75 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6112ca0421594b58a0155fb655bbbd75" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43857 } }
I20260923 17:14:04.709496 13348 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6112ca0421594b58a0155fb655bbbd75 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:14:04.710691 13355 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6112ca0421594b58a0155fb655bbbd75 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6112ca0421594b58a0155fb655bbbd75. Latest consensus state: current_term: 1 leader_uuid: "6112ca0421594b58a0155fb655bbbd75" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6112ca0421594b58a0155fb655bbbd75" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43857 } } }
I20260923 17:14:04.710691 13354 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6112ca0421594b58a0155fb655bbbd75 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6112ca0421594b58a0155fb655bbbd75" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6112ca0421594b58a0155fb655bbbd75" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43857 } } }
I20260923 17:14:04.710845 13355 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6112ca0421594b58a0155fb655bbbd75 [sys.catalog]: This master's current role is: LEADER
I20260923 17:14:04.710845 13354 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6112ca0421594b58a0155fb655bbbd75 [sys.catalog]: This master's current role is: LEADER
I20260923 17:14:04.711280 13362 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:14:04.711294 13351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:04.697781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44776 (local address 127.11.229.190:43857)
0923 17:14:04.698206 (+ 425us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:04.698221 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:04.698309 (+ 88us) server_negotiation.cc:407] Connection header received
0923 17:14:04.698938 (+ 629us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:04.698955 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:04.699289 (+ 334us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:04.699627 (+ 338us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:04.700467 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:04.701429 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:04.702408 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:04.702874 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:04.703497 (+ 623us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:04.705667 (+ 2170us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:04.705673 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:04.705692 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:04.705724 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:04.707652 (+ 1928us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:04.708165 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:04.708171 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:04.708177 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:04.708350 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:04.708721 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:04.708725 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:04.708726 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:04.709203 (+ 477us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:04.709325 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:04.709833 (+ 508us) server_negotiation.cc:299] Negotiation successful
0923 17:14:04.710186 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":138,"threads_started":1}
I20260923 17:14:04.715261 13362 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:14:04.720883 13362 catalog_manager.cc:1347] Generated new cluster ID: 1b5d84d3a9f244799c4757a6bfcb57e1
I20260923 17:14:04.720953 13362 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:14:04.741438 13362 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:14:04.742553 13362 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:14:04.752420 13362 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6112ca0421594b58a0155fb655bbbd75: Generated new TSK 0
I20260923 17:14:04.753261 13362 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.229.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab.
Entry for principal kudu/127.11.229.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab.
I20260923 17:14:04.790292 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.129:0
--local_ip_for_outbound_sockets=127.11.229.129
--webserver_interface=127.11.229.129
--webserver_port=0
--tserver_master_addrs=127.11.229.190:43857
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab
--principal=kudu/127.11.229.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:38991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:14:04.905875 13374 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:04.906153 13374 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:04.906199 13374 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:04.910374 13374 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:04.910434 13374 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:04.910473 13374 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260923 17:14:04.910507 13374 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.129
I20260923 17:14:04.916052 13374 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:38991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab
--principal=kudu/127.11.229.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.229.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.229.190:43857
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13374
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.129
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:04.917071 13374 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:04.918220 13374 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:04.927924 13382 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:04.927968 13380 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:04.927959 13379 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:04.928866 13374 server_base.cc:1034] running on GCE node
I20260923 17:14:04.929346 13374 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:04.929984 13374 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:04.931218 13374 hybrid_clock.cc:648] HybridClock initialized: now 1790183644931227 us; error 50 us; skew 500 ppm
Sep 23 17:14:04 dist-test-slave-1x1f krb5kdc[13257](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183644, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:04.934027 13374 init.cc:377] Logged in from keytab as kudu/127.11.229.129@KRBTEST.COM (short username kudu)
I20260923 17:14:04.934964 13374 webserver.cc:460] Webserver started at http://127.11.229.129:46857/ using document root <none> and password file <none>
I20260923 17:14:04.935503 13374 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:04.935561 13374 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:04.935727 13374 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:04.937737 13374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-0/data/instance:
uuid: "5dabc71dec514792b9847ee6647a152f"
format_stamp: "Formatted at 2026-09-23 17:14:04 on dist-test-slave-1x1f"
server_key: "4dd201cc7fdaf0bb4ce5d5f616233e80"
server_key_iv: "1401d78c249c0490cc8d754a24b7023d"
server_key_version: "encryptionkey@0"
I20260923 17:14:04.938297 13374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance:
uuid: "5dabc71dec514792b9847ee6647a152f"
format_stamp: "Formatted at 2026-09-23 17:14:04 on dist-test-slave-1x1f"
server_key: "4dd201cc7fdaf0bb4ce5d5f616233e80"
server_key_iv: "1401d78c249c0490cc8d754a24b7023d"
server_key_version: "encryptionkey@0"
I20260923 17:14:04.941874 13374 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.000s sys 0.003s
I20260923 17:14:04.944310 13389 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:04.945492 13374 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260923 17:14:04.945583 13374 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-0/wal
uuid: "5dabc71dec514792b9847ee6647a152f"
format_stamp: "Formatted at 2026-09-23 17:14:04 on dist-test-slave-1x1f"
server_key: "4dd201cc7fdaf0bb4ce5d5f616233e80"
server_key_iv: "1401d78c249c0490cc8d754a24b7023d"
server_key_version: "encryptionkey@0"
I20260923 17:14:04.945678 13374 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:04.957494 13374 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:04.960592 13374 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:04.960804 13374 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:04.962373 13374 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:14:04.962442 13374 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:04.962507 13374 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:14:04.962566 13374 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 23 17:14:04 dist-test-slave-1x1f krb5kdc[13257](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183644, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.129@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:14:04.973500 13374 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.129:34671
I20260923 17:14:04.973629 13504 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.129:34671 every 8 connection(s)
I20260923 17:14:04.974614 13374 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
I20260923 17:14:04.976735 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 13374
I20260923 17:14:04.976861 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance
I20260923 17:14:04.977290 12182 external_mini_cluster.cc:1428] Setting key 67f82be655f0da9166cfffdc3c0914aa
I20260923 17:14:04.977527 13351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:04.963190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:47799 (local address 127.11.229.190:43857)
0923 17:14:04.963355 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:04.963362 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:04.964282 (+ 920us) server_negotiation.cc:407] Connection header received
0923 17:14:04.965374 (+ 1092us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:04.965382 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:04.965449 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:04.965498 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:04.967333 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:04.968281 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:04.969777 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:04.970069 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:04.970199 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:04.973106 (+ 2907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:04.973110 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:04.973113 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:04.973172 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:04.974958 (+ 1786us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:04.975703 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:04.975706 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:04.975707 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:04.975781 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:04.976154 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:04.976157 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:04.976159 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:04.976364 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:04.976453 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:04.977236 (+ 783us) server_negotiation.cc:299] Negotiation successful
0923 17:14:04.977373 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260923 17:14:04.978434 13398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:04.963635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:43857 (local address 127.11.229.129:47799)
0923 17:14:04.964107 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:04.964160 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:04.965079 (+ 919us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:04.965837 (+ 758us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:04.965845 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:04.966441 (+ 596us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:04.967123 (+ 682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:04.967139 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:04.968430 (+ 1291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:04.968437 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:04.969641 (+ 1204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:04.969651 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:04.970275 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:04.970280 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:04.970469 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:04.971145 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:04.971163 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:04.972898 (+ 1735us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:04.975181 (+ 2283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:04.975188 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:04.975204 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:04.975598 (+ 394us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:04.975866 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:04.975868 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:04.975870 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:04.976004 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:04.976544 (+ 540us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:04.976554 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:04.976898 (+ 344us) client_negotiation.cc:769] Sending connection context
0923 17:14:04.977129 (+ 231us) client_negotiation.cc:240] Negotiation successful
0923 17:14:04.977493 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":143,"threads_started":1}
I20260923 17:14:04.979880 13505 heartbeater.cc:347] Connected to a master server at 127.11.229.190:43857
I20260923 17:14:04.980034 13505 heartbeater.cc:464] Registering TS with master...
I20260923 17:14:04.980616 13505 heartbeater.cc:511] Master 127.11.229.190:43857 requested a full tablet report, sending...
I20260923 17:14:04.982184 13302 ts_manager.cc:194] Registered new tserver with Master: 5dabc71dec514792b9847ee6647a152f (127.11.229.129:34671)
I20260923 17:14:04.983670 13302 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.129@KRBTEST.COM'} at 127.11.229.129:47799
WARNING: no policy specified for kudu/127.11.229.130@KRBTEST.COM; defaulting to no policy
I20260923 17:14:04.990851 13351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:04.982341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:56363 (local address 127.11.229.190:43857)
0923 17:14:04.982475 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:04.982482 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:04.982653 (+ 171us) server_negotiation.cc:407] Connection header received
0923 17:14:04.982765 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:04.982768 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:04.982806 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:04.982877 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:04.983398 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:04.984057 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:04.985427 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:04.985774 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:04.985890 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:04.987348 (+ 1458us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:04.987351 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:04.987354 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:04.987376 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:04.988978 (+ 1602us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:04.989501 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:04.989504 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:04.989506 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:04.989585 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:04.989928 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:04.989931 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:04.989932 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:04.990120 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:04.990200 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:04.990632 (+ 432us) server_negotiation.cc:299] Negotiation successful
0923 17:14:04.990738 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260923 17:14:04.990873 13512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:04.982201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:43857 (local address 127.11.229.129:56363)
0923 17:14:04.982561 (+ 360us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:04.982575 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:04.982682 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:04.982921 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:04.982924 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:04.983140 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:04.983259 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:04.983266 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:04.984204 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:04.984209 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:04.985289 (+ 1080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:04.985303 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:04.985912 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:04.985919 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:04.986052 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:04.986643 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:04.986664 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:04.987194 (+ 530us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:04.989104 (+ 1910us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:04.989109 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:04.989114 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:04.989367 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:04.989688 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:04.989693 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:04.989696 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:04.989799 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:04.990221 (+ 422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:04.990255 (+ 34us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:04.990370 (+ 115us) client_negotiation.cc:769] Sending connection context
0923 17:14:04.990537 (+ 167us) client_negotiation.cc:240] Negotiation successful
0923 17:14:04.990712 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"mutex_wait_us":1,"thread_start_us":112,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab.
Entry for principal kudu/127.11.229.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab.
I20260923 17:14:05.009869 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.130:0
--local_ip_for_outbound_sockets=127.11.229.130
--webserver_interface=127.11.229.130
--webserver_port=0
--tserver_master_addrs=127.11.229.190:43857
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab
--principal=kudu/127.11.229.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:38991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:14:05.118259 13514 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:05.118533 13514 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:05.118609 13514 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:05.123059 13514 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:05.123148 13514 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:05.123214 13514 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260923 17:14:05.123283 13514 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.130
I20260923 17:14:05.128350 13514 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:38991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab
--principal=kudu/127.11.229.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.229.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.229.190:43857
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13514
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.130
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:05.129390 13514 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:05.130442 13514 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:05.139974 13519 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:05.139961 13520 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:05.140110 13514 server_base.cc:1034] running on GCE node
W20260923 17:14:05.139945 13522 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:05.140516 13514 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:05.141158 13514 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:05.142347 13514 hybrid_clock.cc:648] HybridClock initialized: now 1790183645142298 us; error 50 us; skew 500 ppm
Sep 23 17:14:05 dist-test-slave-1x1f krb5kdc[13257](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183645, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:05.145085 13514 init.cc:377] Logged in from keytab as kudu/127.11.229.130@KRBTEST.COM (short username kudu)
I20260923 17:14:05.145941 13514 webserver.cc:460] Webserver started at http://127.11.229.130:43677/ using document root <none> and password file <none>
I20260923 17:14:05.146584 13514 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:05.146677 13514 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:05.146898 13514 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:05.148939 13514 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-1/data/instance:
uuid: "51297d6562284245b52294527ff846d1"
format_stamp: "Formatted at 2026-09-23 17:14:05 on dist-test-slave-1x1f"
server_key: "3bb8173dd7353b2b4a591e641cf68f0d"
server_key_iv: "02db56b094d10bff4104d7bad25b26b4"
server_key_version: "encryptionkey@0"
I20260923 17:14:05.149569 13514 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance:
uuid: "51297d6562284245b52294527ff846d1"
format_stamp: "Formatted at 2026-09-23 17:14:05 on dist-test-slave-1x1f"
server_key: "3bb8173dd7353b2b4a591e641cf68f0d"
server_key_iv: "02db56b094d10bff4104d7bad25b26b4"
server_key_version: "encryptionkey@0"
I20260923 17:14:05.153254 13514 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260923 17:14:05.155717 13529 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:05.156863 13514 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260923 17:14:05.156991 13514 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-1/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-1/wal
uuid: "51297d6562284245b52294527ff846d1"
format_stamp: "Formatted at 2026-09-23 17:14:05 on dist-test-slave-1x1f"
server_key: "3bb8173dd7353b2b4a591e641cf68f0d"
server_key_iv: "02db56b094d10bff4104d7bad25b26b4"
server_key_version: "encryptionkey@0"
I20260923 17:14:05.157096 13514 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:05.171072 13514 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:05.173946 13514 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:05.174158 13514 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:05.175623 13514 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:14:05.175700 13514 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:05.175779 13514 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:14:05.175829 13514 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 23 17:14:05 dist-test-slave-1x1f krb5kdc[13257](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183645, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.130@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:14:05.187476 13514 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.130:44687
I20260923 17:14:05.187481 13644 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.130:44687 every 8 connection(s)
I20260923 17:14:05.188704 13514 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
I20260923 17:14:05.190620 13351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:05.176556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:35197 (local address 127.11.229.190:43857)
0923 17:14:05.176735 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:05.176742 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:05.177633 (+ 891us) server_negotiation.cc:407] Connection header received
0923 17:14:05.179026 (+ 1393us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:05.179042 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:05.179115 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:05.179227 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:05.180578 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.181220 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.182519 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.182751 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.182859 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:05.186005 (+ 3146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:05.186008 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:05.186010 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:05.186033 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:05.187884 (+ 1851us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:05.188371 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:05.188375 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:05.188377 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:05.188473 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:05.188820 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:05.188824 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:05.188826 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:05.189028 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:05.189141 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:05.190358 (+ 1217us) server_negotiation.cc:299] Negotiation successful
0923 17:14:05.190472 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260923 17:14:05.190901 13538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:05.176889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:43857 (local address 127.11.229.130:35197)
0923 17:14:05.177458 (+ 569us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:05.177511 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:05.178767 (+ 1256us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:05.179409 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:05.179416 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:05.179865 (+ 449us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:05.180437 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:05.180451 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.181341 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.181345 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:05.182391 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:05.182400 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.182894 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.182899 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:05.183089 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:05.183689 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:05.183705 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:05.185833 (+ 2128us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:05.187998 (+ 2165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:05.188002 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:05.188013 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:05.188262 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:05.188570 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:05.188572 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:05.188573 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:05.188707 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:05.189208 (+ 501us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:05.189213 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:05.189513 (+ 300us) client_negotiation.cc:769] Sending connection context
0923 17:14:05.189702 (+ 189us) client_negotiation.cc:240] Negotiation successful
0923 17:14:05.189977 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":363,"thread_start_us":240,"threads_started":1}
I20260923 17:14:05.192165 13645 heartbeater.cc:347] Connected to a master server at 127.11.229.190:43857
I20260923 17:14:05.192324 13645 heartbeater.cc:464] Registering TS with master...
I20260923 17:14:05.192886 13645 heartbeater.cc:511] Master 127.11.229.190:43857 requested a full tablet report, sending...
I20260923 17:14:05.194136 13301 ts_manager.cc:194] Registered new tserver with Master: 51297d6562284245b52294527ff846d1 (127.11.229.130:44687)
I20260923 17:14:05.194774 13301 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.130@KRBTEST.COM'} at 127.11.229.130:35197
I20260923 17:14:05.196465 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 13514
I20260923 17:14:05.196583 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance
I20260923 17:14:05.196861 12182 external_mini_cluster.cc:1428] Setting key 11923d17fd1f11016073344e36dca527
I20260923 17:14:05.202008 13351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:05.194291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:34603 (local address 127.11.229.190:43857)
0923 17:14:05.194386 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:05.194392 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:05.195221 (+ 829us) server_negotiation.cc:407] Connection header received
0923 17:14:05.195301 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:05.195306 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:05.195359 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:05.195423 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:05.195940 (+ 517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.196477 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.197417 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.197634 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.197739 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:05.198762 (+ 1023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:05.198768 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:05.198774 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:05.198803 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:05.200327 (+ 1524us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:05.200846 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:05.200849 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:05.200850 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:05.200922 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:05.201245 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:05.201247 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:05.201248 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:05.201435 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:05.201521 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:05.201819 (+ 298us) server_negotiation.cc:299] Negotiation successful
0923 17:14:05.201902 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260923 17:14:05.202200 13651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:05.194144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:43857 (local address 127.11.229.130:34603)
0923 17:14:05.195138 (+ 994us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:05.195151 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:05.195224 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:05.195467 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:05.195469 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:05.195706 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:05.195817 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:05.195824 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.196599 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.196604 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:05.197312 (+ 708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:05.197325 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.197739 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.197743 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:05.197833 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:05.198333 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:05.198344 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:05.198628 (+ 284us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:05.200443 (+ 1815us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:05.200449 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:05.200452 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:05.200738 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:05.201035 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:05.201038 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:05.201040 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:05.201142 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:05.201538 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:05.201544 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:05.201655 (+ 111us) client_negotiation.cc:769] Sending connection context
0923 17:14:05.201770 (+ 115us) client_negotiation.cc:240] Negotiation successful
0923 17:14:05.201932 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":903,"thread_start_us":120,"threads_started":1}
WARNING: no policy specified for kudu/127.11.229.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab.
Entry for principal kudu/127.11.229.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab.
I20260923 17:14:05.225865 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.131:0
--local_ip_for_outbound_sockets=127.11.229.131
--webserver_interface=127.11.229.131
--webserver_port=0
--tserver_master_addrs=127.11.229.190:43857
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab
--principal=kudu/127.11.229.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:38991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:14:05.337307 13654 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:05.337551 13654 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:05.337595 13654 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:05.341604 13654 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:05.341660 13654 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:05.341701 13654 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260923 17:14:05.341733 13654 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.131
I20260923 17:14:05.346869 13654 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:38991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab
--principal=kudu/127.11.229.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.229.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.229.190:43857
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13654
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.131
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:05.347836 13654 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:05.348762 13654 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:05.358129 13662 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:05.358182 13660 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:05.358181 13659 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:05.358270 13654 server_base.cc:1034] running on GCE node
I20260923 17:14:05.358815 13654 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:05.359421 13654 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:05.360607 13654 hybrid_clock.cc:648] HybridClock initialized: now 1790183645360563 us; error 55 us; skew 500 ppm
Sep 23 17:14:05 dist-test-slave-1x1f krb5kdc[13257](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183645, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:05.363492 13654 init.cc:377] Logged in from keytab as kudu/127.11.229.131@KRBTEST.COM (short username kudu)
I20260923 17:14:05.364346 13654 webserver.cc:460] Webserver started at http://127.11.229.131:46647/ using document root <none> and password file <none>
I20260923 17:14:05.364848 13654 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:05.364905 13654 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:05.365067 13654 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:05.367077 13654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-2/data/instance:
uuid: "5f57262c9aef494b9e98d7e2fec6b631"
format_stamp: "Formatted at 2026-09-23 17:14:05 on dist-test-slave-1x1f"
server_key: "e3464ea6b8e88f46e3e8f85795445677"
server_key_iv: "5347355c5c001726b4f601285a832c87"
server_key_version: "encryptionkey@0"
I20260923 17:14:05.367660 13654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance:
uuid: "5f57262c9aef494b9e98d7e2fec6b631"
format_stamp: "Formatted at 2026-09-23 17:14:05 on dist-test-slave-1x1f"
server_key: "e3464ea6b8e88f46e3e8f85795445677"
server_key_iv: "5347355c5c001726b4f601285a832c87"
server_key_version: "encryptionkey@0"
I20260923 17:14:05.371285 13654 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260923 17:14:05.373708 13669 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:05.375002 13654 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 17:14:05.375142 13654 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-2/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-2/wal
uuid: "5f57262c9aef494b9e98d7e2fec6b631"
format_stamp: "Formatted at 2026-09-23 17:14:05 on dist-test-slave-1x1f"
server_key: "e3464ea6b8e88f46e3e8f85795445677"
server_key_iv: "5347355c5c001726b4f601285a832c87"
server_key_version: "encryptionkey@0"
I20260923 17:14:05.375269 13654 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:05.396082 13654 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:05.398973 13654 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:05.399184 13654 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:05.400616 13654 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:14:05.400689 13654 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:05.400759 13654 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:14:05.400810 13654 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 23 17:14:05 dist-test-slave-1x1f krb5kdc[13257](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183645, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.131@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:14:05.411321 13654 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.131:38577
I20260923 17:14:05.411552 13784 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.131:38577 every 8 connection(s)
I20260923 17:14:05.412300 13654 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
I20260923 17:14:05.414693 13351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:05.401468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:55121 (local address 127.11.229.190:43857)
0923 17:14:05.401616 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:05.401628 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:05.402520 (+ 892us) server_negotiation.cc:407] Connection header received
0923 17:14:05.403599 (+ 1079us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:05.403603 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:05.403676 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:05.403755 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:05.405085 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.405669 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.407614 (+ 1945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.407981 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.408087 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:05.410891 (+ 2804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:05.410895 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:05.410897 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:05.410927 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:05.412556 (+ 1629us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:05.413296 (+ 740us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:05.413299 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:05.413300 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:05.413377 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:05.413699 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:05.413702 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:05.413703 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:05.413871 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:05.413942 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:05.414465 (+ 523us) server_negotiation.cc:299] Negotiation successful
0923 17:14:05.414562 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260923 17:14:05.415527 13678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:05.401882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:43857 (local address 127.11.229.131:55121)
0923 17:14:05.402364 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:05.402412 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:05.403351 (+ 939us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:05.404152 (+ 801us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:05.404158 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:05.404473 (+ 315us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:05.404933 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:05.404946 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.405807 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.405813 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:05.407455 (+ 1642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:05.407469 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.408133 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.408137 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:05.408308 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:05.408927 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:05.408942 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:05.410719 (+ 1777us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:05.412701 (+ 1982us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:05.412707 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:05.412722 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:05.413197 (+ 475us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:05.413462 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:05.413464 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:05.413465 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:05.413592 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:05.413953 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:05.413958 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:05.414187 (+ 229us) client_negotiation.cc:769] Sending connection context
0923 17:14:05.414402 (+ 215us) client_negotiation.cc:240] Negotiation successful
0923 17:14:05.414665 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":136,"threads_started":1}
I20260923 17:14:05.416744 13785 heartbeater.cc:347] Connected to a master server at 127.11.229.190:43857
I20260923 17:14:05.416887 13785 heartbeater.cc:464] Registering TS with master...
I20260923 17:14:05.417356 13785 heartbeater.cc:511] Master 127.11.229.190:43857 requested a full tablet report, sending...
I20260923 17:14:05.418445 13302 ts_manager.cc:194] Registered new tserver with Master: 5f57262c9aef494b9e98d7e2fec6b631 (127.11.229.131:38577)
I20260923 17:14:05.419200 13302 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.131@KRBTEST.COM'} at 127.11.229.131:55121
I20260923 17:14:05.422115 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 13654
I20260923 17:14:05.422264 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance
I20260923 17:14:05.422539 12182 external_mini_cluster.cc:1428] Setting key c96c648c92c2a56cc9c2d27dbf6e7c5d
I20260923 17:14:05.424731 12182 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 17:14:05.426501 13351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:05.418906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:47919 (local address 127.11.229.190:43857)
0923 17:14:05.419004 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:05.419007 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:05.419681 (+ 674us) server_negotiation.cc:407] Connection header received
0923 17:14:05.419791 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:05.419794 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:05.419829 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:05.419893 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:05.420383 (+ 490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.420878 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.421726 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.421931 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.422052 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:05.423287 (+ 1235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:05.423292 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:05.423295 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:05.423322 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:05.424912 (+ 1590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:05.425387 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:05.425389 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:05.425391 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:05.425460 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:05.425739 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:05.425741 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:05.425742 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:05.425890 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:05.425962 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:05.426304 (+ 342us) server_negotiation.cc:299] Negotiation successful
0923 17:14:05.426392 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260923 17:14:05.426669 13791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:05.418820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:43857 (local address 127.11.229.131:47919)
0923 17:14:05.419596 (+ 776us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:05.419608 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:05.419692 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:05.419938 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:05.419940 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:05.420154 (+ 214us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:05.420270 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:05.420277 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.421006 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.421009 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:05.421604 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:05.421613 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.422069 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.422072 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:05.422265 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:05.422794 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:05.422807 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:05.423124 (+ 317us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:05.425006 (+ 1882us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:05.425009 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:05.425012 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:05.425294 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:05.425551 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:05.425554 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:05.425555 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:05.425652 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:05.425979 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:05.425985 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:05.426091 (+ 106us) client_negotiation.cc:769] Sending connection context
0923 17:14:05.426209 (+ 118us) client_negotiation.cc:240] Negotiation successful
0923 17:14:05.426397 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":689,"thread_start_us":111,"threads_started":1}
Sep 23 17:14:05 dist-test-slave-1x1f krb5kdc[13257](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183645, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 23 17:14:05 dist-test-slave-1x1f krb5kdc[13257](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183645, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:14:05.450902 13351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:05.442409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44778 (local address 127.11.229.190:43857)
0923 17:14:05.442551 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:05.442555 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:05.442567 (+ 12us) server_negotiation.cc:407] Connection header received
0923 17:14:05.442606 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:05.442609 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:05.442655 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:05.442748 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:05.443458 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.443986 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.444822 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.445041 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.445155 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:05.447715 (+ 2560us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:05.447718 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:05.447720 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:05.447744 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:05.449156 (+ 1412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:05.449566 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:05.449570 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:05.449572 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:05.449662 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:05.449959 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:05.449964 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:05.449966 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:05.450200 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:05.450365 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:05.450607 (+ 242us) server_negotiation.cc:299] Negotiation successful
0923 17:14:05.450732 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260923 17:14:05.453851 13302 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44778:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 17:14:05.456904 13302 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 17:14:05.471129 13805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:05.465782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.130:44687 (local address 127.0.0.1:60142)
0923 17:14:05.466074 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:05.466088 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:05.466172 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:05.467118 (+ 946us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:05.467121 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:05.467140 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:14:05.467215 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:05.467220 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.468629 (+ 1409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.468634 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:05.469764 (+ 1130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:05.469772 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.470670 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.470673 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:05.470741 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:05.470757 (+ 16us) client_negotiation.cc:769] Sending connection context
0923 17:14:05.470811 (+ 54us) client_negotiation.cc:240] Negotiation successful
0923 17:14:05.470962 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"mutex_wait_us":91,"thread_start_us":104,"threads_started":1}
I20260923 17:14:05.471365 13804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:05.465357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.131:38577 (local address 127.0.0.1:60894)
0923 17:14:05.465584 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:05.465598 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:05.465725 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:05.466938 (+ 1213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:05.466958 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:05.466975 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:14:05.467097 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:05.467104 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.468601 (+ 1497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.468604 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:05.469823 (+ 1219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:05.469832 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.470973 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.470976 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:05.471061 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:05.471084 (+ 23us) client_negotiation.cc:769] Sending connection context
0923 17:14:05.471148 (+ 64us) client_negotiation.cc:240] Negotiation successful
0923 17:14:05.471219 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"mutex_wait_us":60,"thread_start_us":108,"threads_started":1}
I20260923 17:14:05.471367 13807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:05.466206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60142 (local address 127.11.229.130:44687)
0923 17:14:05.466704 (+ 498us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:05.466716 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:05.466738 (+ 22us) server_negotiation.cc:407] Connection header received
0923 17:14:05.466807 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:05.466812 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:05.467000 (+ 188us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:05.467146 (+ 146us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:14:05.467314 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.468481 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.469881 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.470543 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.470965 (+ 422us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:05.471090 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:05.471139 (+ 49us) server_negotiation.cc:299] Negotiation successful
0923 17:14:05.471233 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":405,"thread_start_us":103,"threads_started":1}
I20260923 17:14:05.471424 13802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:05.465030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:34671 (local address 127.0.0.1:46436)
0923 17:14:05.465457 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:05.465508 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:05.465638 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:05.466732 (+ 1094us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:05.466739 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:05.466763 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:14:05.466901 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:05.466911 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.468123 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.468128 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:05.469391 (+ 1263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:05.469402 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.470547 (+ 1145us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.470550 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:05.470683 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:05.470728 (+ 45us) client_negotiation.cc:769] Sending connection context
0923 17:14:05.470836 (+ 108us) client_negotiation.cc:240] Negotiation successful
0923 17:14:05.471304 (+ 468us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"mutex_wait_us":25,"thread_start_us":119,"threads_started":1}
I20260923 17:14:05.471948 13806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:05.465860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60894 (local address 127.11.229.131:38577)
0923 17:14:05.466430 (+ 570us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:05.466443 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:05.466463 (+ 20us) server_negotiation.cc:407] Connection header received
0923 17:14:05.466536 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:05.466544 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:05.466795 (+ 251us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:05.467224 (+ 429us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:14:05.467349 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.468481 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.469952 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.470838 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.471675 (+ 837us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:05.471755 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:05.471791 (+ 36us) server_negotiation.cc:299] Negotiation successful
0923 17:14:05.471850 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":466,"thread_start_us":126,"threads_started":1}
I20260923 17:14:05.471151 13803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:05.465241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46436 (local address 127.11.229.129:34671)
0923 17:14:05.465957 (+ 716us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:05.465973 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:05.466000 (+ 27us) server_negotiation.cc:407] Connection header received
0923 17:14:05.466080 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:05.466087 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:05.466326 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:05.466483 (+ 157us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:14:05.467042 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.468022 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.469528 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.470393 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.470568 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:05.470711 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:05.470883 (+ 172us) server_negotiation.cc:299] Negotiation successful
0923 17:14:05.470992 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":614,"thread_start_us":73,"threads_started":1}
I20260923 17:14:05.474406 13719 tablet_service.cc:1467] Processing CreateTablet for tablet 973df157f1ea480bbc995b26d8430be8 (DEFAULT_TABLE table=test-table [id=77cd13b2b3344532ae7d06d3ac53c174]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:14:05.474408 13439 tablet_service.cc:1467] Processing CreateTablet for tablet 973df157f1ea480bbc995b26d8430be8 (DEFAULT_TABLE table=test-table [id=77cd13b2b3344532ae7d06d3ac53c174]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:14:05.474407 13579 tablet_service.cc:1467] Processing CreateTablet for tablet 973df157f1ea480bbc995b26d8430be8 (DEFAULT_TABLE table=test-table [id=77cd13b2b3344532ae7d06d3ac53c174]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:14:05.475361 13719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 973df157f1ea480bbc995b26d8430be8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:05.475379 13579 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 973df157f1ea480bbc995b26d8430be8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:05.475379 13439 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 973df157f1ea480bbc995b26d8430be8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:05.482532 13808 tablet_bootstrap.cc:492] T 973df157f1ea480bbc995b26d8430be8 P 5f57262c9aef494b9e98d7e2fec6b631: Bootstrap starting.
I20260923 17:14:05.483350 13810 tablet_bootstrap.cc:492] T 973df157f1ea480bbc995b26d8430be8 P 51297d6562284245b52294527ff846d1: Bootstrap starting.
I20260923 17:14:05.483855 13809 tablet_bootstrap.cc:492] T 973df157f1ea480bbc995b26d8430be8 P 5dabc71dec514792b9847ee6647a152f: Bootstrap starting.
I20260923 17:14:05.484566 13808 tablet_bootstrap.cc:654] T 973df157f1ea480bbc995b26d8430be8 P 5f57262c9aef494b9e98d7e2fec6b631: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:05.485270 13808 log.cc:824] T 973df157f1ea480bbc995b26d8430be8 P 5f57262c9aef494b9e98d7e2fec6b631: Log is configured to *not* fsync() on all Append() calls
I20260923 17:14:05.485553 13810 tablet_bootstrap.cc:654] T 973df157f1ea480bbc995b26d8430be8 P 51297d6562284245b52294527ff846d1: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:05.486336 13809 tablet_bootstrap.cc:654] T 973df157f1ea480bbc995b26d8430be8 P 5dabc71dec514792b9847ee6647a152f: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:05.486382 13810 log.cc:824] T 973df157f1ea480bbc995b26d8430be8 P 51297d6562284245b52294527ff846d1: Log is configured to *not* fsync() on all Append() calls
I20260923 17:14:05.487164 13809 log.cc:824] T 973df157f1ea480bbc995b26d8430be8 P 5dabc71dec514792b9847ee6647a152f: Log is configured to *not* fsync() on all Append() calls
I20260923 17:14:05.487468 13808 tablet_bootstrap.cc:492] T 973df157f1ea480bbc995b26d8430be8 P 5f57262c9aef494b9e98d7e2fec6b631: No bootstrap required, opened a new log
I20260923 17:14:05.487674 13808 ts_tablet_manager.cc:1397] T 973df157f1ea480bbc995b26d8430be8 P 5f57262c9aef494b9e98d7e2fec6b631: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260923 17:14:05.488370 13810 tablet_bootstrap.cc:492] T 973df157f1ea480bbc995b26d8430be8 P 51297d6562284245b52294527ff846d1: No bootstrap required, opened a new log
I20260923 17:14:05.488569 13810 ts_tablet_manager.cc:1397] T 973df157f1ea480bbc995b26d8430be8 P 51297d6562284245b52294527ff846d1: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s
I20260923 17:14:05.489025 13809 tablet_bootstrap.cc:492] T 973df157f1ea480bbc995b26d8430be8 P 5dabc71dec514792b9847ee6647a152f: No bootstrap required, opened a new log
I20260923 17:14:05.489188 13809 ts_tablet_manager.cc:1397] T 973df157f1ea480bbc995b26d8430be8 P 5dabc71dec514792b9847ee6647a152f: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260923 17:14:05.490793 13808 raft_consensus.cc:348] T 973df157f1ea480bbc995b26d8430be8 P 5f57262c9aef494b9e98d7e2fec6b631 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dabc71dec514792b9847ee6647a152f" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 34671 } } peers { permanent_uuid: "51297d6562284245b52294527ff846d1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44687 } } peers { permanent_uuid: "5f57262c9aef494b9e98d7e2fec6b631" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38577 } }
I20260923 17:14:05.491027 13808 raft_consensus.cc:374] T 973df157f1ea480bbc995b26d8430be8 P 5f57262c9aef494b9e98d7e2fec6b631 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:05.491248 13808 raft_consensus.cc:729] T 973df157f1ea480bbc995b26d8430be8 P 5f57262c9aef494b9e98d7e2fec6b631 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f57262c9aef494b9e98d7e2fec6b631, State: Initialized, Role: FOLLOWER
I20260923 17:14:05.491750 13808 consensus_queue.cc:260] T 973df157f1ea480bbc995b26d8430be8 P 5f57262c9aef494b9e98d7e2fec6b631 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dabc71dec514792b9847ee6647a152f" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 34671 } } peers { permanent_uuid: "51297d6562284245b52294527ff846d1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44687 } } peers { permanent_uuid: "5f57262c9aef494b9e98d7e2fec6b631" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38577 } }
I20260923 17:14:05.492353 13785 heartbeater.cc:503] Master 127.11.229.190:43857 was elected leader, sending a full tablet report...
I20260923 17:14:05.492731 13808 ts_tablet_manager.cc:1428] T 973df157f1ea480bbc995b26d8430be8 P 5f57262c9aef494b9e98d7e2fec6b631: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260923 17:14:05.492918 13809 raft_consensus.cc:348] T 973df157f1ea480bbc995b26d8430be8 P 5dabc71dec514792b9847ee6647a152f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dabc71dec514792b9847ee6647a152f" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 34671 } } peers { permanent_uuid: "51297d6562284245b52294527ff846d1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44687 } } peers { permanent_uuid: "5f57262c9aef494b9e98d7e2fec6b631" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38577 } }
I20260923 17:14:05.493175 13809 raft_consensus.cc:374] T 973df157f1ea480bbc995b26d8430be8 P 5dabc71dec514792b9847ee6647a152f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:05.493232 13809 raft_consensus.cc:729] T 973df157f1ea480bbc995b26d8430be8 P 5dabc71dec514792b9847ee6647a152f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dabc71dec514792b9847ee6647a152f, State: Initialized, Role: FOLLOWER
I20260923 17:14:05.493816 13809 consensus_queue.cc:260] T 973df157f1ea480bbc995b26d8430be8 P 5dabc71dec514792b9847ee6647a152f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dabc71dec514792b9847ee6647a152f" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 34671 } } peers { permanent_uuid: "51297d6562284245b52294527ff846d1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44687 } } peers { permanent_uuid: "5f57262c9aef494b9e98d7e2fec6b631" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38577 } }
I20260923 17:14:05.493638 13810 raft_consensus.cc:348] T 973df157f1ea480bbc995b26d8430be8 P 51297d6562284245b52294527ff846d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dabc71dec514792b9847ee6647a152f" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 34671 } } peers { permanent_uuid: "51297d6562284245b52294527ff846d1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44687 } } peers { permanent_uuid: "5f57262c9aef494b9e98d7e2fec6b631" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38577 } }
I20260923 17:14:05.494108 13810 raft_consensus.cc:374] T 973df157f1ea480bbc995b26d8430be8 P 51297d6562284245b52294527ff846d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:05.494171 13810 raft_consensus.cc:729] T 973df157f1ea480bbc995b26d8430be8 P 51297d6562284245b52294527ff846d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51297d6562284245b52294527ff846d1, State: Initialized, Role: FOLLOWER
I20260923 17:14:05.494586 13810 consensus_queue.cc:260] T 973df157f1ea480bbc995b26d8430be8 P 51297d6562284245b52294527ff846d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dabc71dec514792b9847ee6647a152f" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 34671 } } peers { permanent_uuid: "51297d6562284245b52294527ff846d1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44687 } } peers { permanent_uuid: "5f57262c9aef494b9e98d7e2fec6b631" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38577 } }
I20260923 17:14:05.494755 13809 ts_tablet_manager.cc:1428] T 973df157f1ea480bbc995b26d8430be8 P 5dabc71dec514792b9847ee6647a152f: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20260923 17:14:05.495072 13505 heartbeater.cc:503] Master 127.11.229.190:43857 was elected leader, sending a full tablet report...
I20260923 17:14:05.495452 13810 ts_tablet_manager.cc:1428] T 973df157f1ea480bbc995b26d8430be8 P 51297d6562284245b52294527ff846d1: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260923 17:14:05.495977 13645 heartbeater.cc:503] Master 127.11.229.190:43857 was elected leader, sending a full tablet report...
I20260923 17:14:05.564043 13816 raft_consensus.cc:482] T 973df157f1ea480bbc995b26d8430be8 P 51297d6562284245b52294527ff846d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 17:14:05.564298 13816 raft_consensus.cc:504] T 973df157f1ea480bbc995b26d8430be8 P 51297d6562284245b52294527ff846d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dabc71dec514792b9847ee6647a152f" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 34671 } } peers { permanent_uuid: "51297d6562284245b52294527ff846d1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44687 } } peers { permanent_uuid: "5f57262c9aef494b9e98d7e2fec6b631" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38577 } }
I20260923 17:14:05.565430 13816 leader_election.cc:288] T 973df157f1ea480bbc995b26d8430be8 P 51297d6562284245b52294527ff846d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5dabc71dec514792b9847ee6647a152f (127.11.229.129:34671), 5f57262c9aef494b9e98d7e2fec6b631 (127.11.229.131:38577)
I20260923 17:14:05.569205 13806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:05.565907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:35353 (local address 127.11.229.131:38577)
0923 17:14:05.566074 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:05.566081 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:05.566098 (+ 17us) server_negotiation.cc:407] Connection header received
0923 17:14:05.566151 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:05.566154 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:05.566220 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:05.566348 (+ 128us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:14:05.566607 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.567178 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.568245 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.568643 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.568767 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:05.568824 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:05.569029 (+ 205us) server_negotiation.cc:299] Negotiation successful
0923 17:14:05.569094 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260923 17:14:05.569221 13538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:05.565676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.131:38577 (local address 127.11.229.130:35353)
0923 17:14:05.565798 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:05.565811 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:05.565910 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:05.566370 (+ 460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:05.566373 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:05.566391 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:14:05.566503 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:05.566508 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.567281 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.567284 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:05.568126 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:05.568134 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.568758 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.568762 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:05.568892 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:05.568910 (+ 18us) client_negotiation.cc:769] Sending connection context
0923 17:14:05.569003 (+ 93us) client_negotiation.cc:240] Negotiation successful
0923 17:14:05.569072 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260923 17:14:05.569690 13817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:05.565684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:34671 (local address 127.11.229.130:33171)
0923 17:14:05.566167 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:05.566179 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:05.566332 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:05.566595 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:05.566597 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:05.566612 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:14:05.567044 (+ 432us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:05.567051 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.567793 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.567797 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:05.568564 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:05.568572 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.569204 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.569207 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:05.569329 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:05.569360 (+ 31us) client_negotiation.cc:769] Sending connection context
0923 17:14:05.569478 (+ 118us) client_negotiation.cc:240] Negotiation successful
0923 17:14:05.569544 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":384,"mutex_wait_us":101,"thread_start_us":143,"threads_started":1}
I20260923 17:14:05.569720 13803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:05.565722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:33171 (local address 127.11.229.129:34671)
0923 17:14:05.565839 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:05.565846 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:05.566278 (+ 432us) server_negotiation.cc:407] Connection header received
0923 17:14:05.566445 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:05.566456 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:05.566497 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:05.566583 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:14:05.567193 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.567680 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.568693 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.569082 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.569208 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:05.569258 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:05.569521 (+ 263us) server_negotiation.cc:299] Negotiation successful
0923 17:14:05.569608 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260923 17:14:05.569882 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "973df157f1ea480bbc995b26d8430be8" candidate_uuid: "51297d6562284245b52294527ff846d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f57262c9aef494b9e98d7e2fec6b631" is_pre_election: true
I20260923 17:14:05.570199 13739 raft_consensus.cc:2454] T 973df157f1ea480bbc995b26d8430be8 P 5f57262c9aef494b9e98d7e2fec6b631 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51297d6562284245b52294527ff846d1 in term 0.
I20260923 17:14:05.570468 13459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "973df157f1ea480bbc995b26d8430be8" candidate_uuid: "51297d6562284245b52294527ff846d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dabc71dec514792b9847ee6647a152f" is_pre_election: true
I20260923 17:14:05.570694 13530 leader_election.cc:302] T 973df157f1ea480bbc995b26d8430be8 P 51297d6562284245b52294527ff846d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51297d6562284245b52294527ff846d1, 5f57262c9aef494b9e98d7e2fec6b631; no voters:
I20260923 17:14:05.570744 13459 raft_consensus.cc:2454] T 973df157f1ea480bbc995b26d8430be8 P 5dabc71dec514792b9847ee6647a152f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51297d6562284245b52294527ff846d1 in term 0.
I20260923 17:14:05.570987 13816 raft_consensus.cc:2781] T 973df157f1ea480bbc995b26d8430be8 P 51297d6562284245b52294527ff846d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 17:14:05.571098 13816 raft_consensus.cc:482] T 973df157f1ea480bbc995b26d8430be8 P 51297d6562284245b52294527ff846d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 17:14:05.571158 13816 raft_consensus.cc:3037] T 973df157f1ea480bbc995b26d8430be8 P 51297d6562284245b52294527ff846d1 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:05.572177 13816 raft_consensus.cc:504] T 973df157f1ea480bbc995b26d8430be8 P 51297d6562284245b52294527ff846d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dabc71dec514792b9847ee6647a152f" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 34671 } } peers { permanent_uuid: "51297d6562284245b52294527ff846d1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44687 } } peers { permanent_uuid: "5f57262c9aef494b9e98d7e2fec6b631" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38577 } }
I20260923 17:14:05.572522 13816 leader_election.cc:288] T 973df157f1ea480bbc995b26d8430be8 P 51297d6562284245b52294527ff846d1 [CANDIDATE]: Term 1 election: Requested vote from peers 5dabc71dec514792b9847ee6647a152f (127.11.229.129:34671), 5f57262c9aef494b9e98d7e2fec6b631 (127.11.229.131:38577)
I20260923 17:14:05.572880 13459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "973df157f1ea480bbc995b26d8430be8" candidate_uuid: "51297d6562284245b52294527ff846d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dabc71dec514792b9847ee6647a152f"
I20260923 17:14:05.572880 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "973df157f1ea480bbc995b26d8430be8" candidate_uuid: "51297d6562284245b52294527ff846d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f57262c9aef494b9e98d7e2fec6b631"
I20260923 17:14:05.573002 13739 raft_consensus.cc:3037] T 973df157f1ea480bbc995b26d8430be8 P 5f57262c9aef494b9e98d7e2fec6b631 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:05.573010 13459 raft_consensus.cc:3037] T 973df157f1ea480bbc995b26d8430be8 P 5dabc71dec514792b9847ee6647a152f [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:05.574319 13739 raft_consensus.cc:2454] T 973df157f1ea480bbc995b26d8430be8 P 5f57262c9aef494b9e98d7e2fec6b631 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51297d6562284245b52294527ff846d1 in term 1.
I20260923 17:14:05.574365 13459 raft_consensus.cc:2454] T 973df157f1ea480bbc995b26d8430be8 P 5dabc71dec514792b9847ee6647a152f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51297d6562284245b52294527ff846d1 in term 1.
I20260923 17:14:05.574604 13530 leader_election.cc:302] T 973df157f1ea480bbc995b26d8430be8 P 51297d6562284245b52294527ff846d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51297d6562284245b52294527ff846d1, 5f57262c9aef494b9e98d7e2fec6b631; no voters:
I20260923 17:14:05.574836 13816 raft_consensus.cc:2781] T 973df157f1ea480bbc995b26d8430be8 P 51297d6562284245b52294527ff846d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:14:05.575004 13816 raft_consensus.cc:686] T 973df157f1ea480bbc995b26d8430be8 P 51297d6562284245b52294527ff846d1 [term 1 LEADER]: Becoming Leader. State: Replica: 51297d6562284245b52294527ff846d1, State: Running, Role: LEADER
I20260923 17:14:05.575309 13816 consensus_queue.cc:237] T 973df157f1ea480bbc995b26d8430be8 P 51297d6562284245b52294527ff846d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dabc71dec514792b9847ee6647a152f" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 34671 } } peers { permanent_uuid: "51297d6562284245b52294527ff846d1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44687 } } peers { permanent_uuid: "5f57262c9aef494b9e98d7e2fec6b631" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38577 } }
I20260923 17:14:05.578500 13301 catalog_manager.cc:5495] T 973df157f1ea480bbc995b26d8430be8 P 51297d6562284245b52294527ff846d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51297d6562284245b52294527ff846d1 (127.11.229.130). New cstate: current_term: 1 leader_uuid: "51297d6562284245b52294527ff846d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dabc71dec514792b9847ee6647a152f" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 34671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51297d6562284245b52294527ff846d1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44687 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f57262c9aef494b9e98d7e2fec6b631" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38577 } health_report { overall_health: UNKNOWN } } }
I20260923 17:14:05.597563 13807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:05.593715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60156 (local address 127.11.229.130:44687)
0923 17:14:05.593856 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:05.593862 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:05.593935 (+ 73us) server_negotiation.cc:407] Connection header received
0923 17:14:05.594281 (+ 346us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:05.594285 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:05.594340 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:05.594463 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 17:14:05.594711 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.595216 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.596101 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.596332 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.596455 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:05.596760 (+ 305us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 17:14:05.597155 (+ 395us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 17:14:05.597282 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:05.597358 (+ 76us) server_negotiation.cc:299] Negotiation successful
0923 17:14:05.597412 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260923 17:14:05.603322 13459 raft_consensus.cc:1261] T 973df157f1ea480bbc995b26d8430be8 P 5dabc71dec514792b9847ee6647a152f [term 1 FOLLOWER]: Refusing update from remote peer 51297d6562284245b52294527ff846d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:14:05.603585 13739 raft_consensus.cc:1261] T 973df157f1ea480bbc995b26d8430be8 P 5f57262c9aef494b9e98d7e2fec6b631 [term 1 FOLLOWER]: Refusing update from remote peer 51297d6562284245b52294527ff846d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:14:05.604121 13818 consensus_queue.cc:1035] T 973df157f1ea480bbc995b26d8430be8 P 51297d6562284245b52294527ff846d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dabc71dec514792b9847ee6647a152f" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 34671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:14:05.604286 13816 consensus_queue.cc:1035] T 973df157f1ea480bbc995b26d8430be8 P 51297d6562284245b52294527ff846d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f57262c9aef494b9e98d7e2fec6b631" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:14:05.610605 13821 mvcc.cc:205] Tried to move back new op lower bound from 7332592212383100928 to 7332592212278845440. Current Snapshot: MvccSnapshot[applied={T|T < 7332592212383100928}]
I20260923 17:14:05.612448 13822 mvcc.cc:205] Tried to move back new op lower bound from 7332592212383100928 to 7332592212278845440. Current Snapshot: MvccSnapshot[applied={T|T < 7332592212383100928}]
I20260923 17:14:05.613859 13823 mvcc.cc:205] Tried to move back new op lower bound from 7332592212383100928 to 7332592212278845440. Current Snapshot: MvccSnapshot[applied={T|T < 7332592212383100928}]
I20260923 17:14:05.622504 13301 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44778:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:14:05.622670 13301 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44778:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:14:05.625162 13301 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6112ca0421594b58a0155fb655bbbd75: Sending DeleteTablet for 3 replicas of tablet 973df157f1ea480bbc995b26d8430be8
I20260923 17:14:05.626099 13439 tablet_service.cc:1514] Processing DeleteTablet for tablet 973df157f1ea480bbc995b26d8430be8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:14:05 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:46436
I20260923 17:14:05.626159 13579 tablet_service.cc:1514] Processing DeleteTablet for tablet 973df157f1ea480bbc995b26d8430be8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:14:05 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:60142
I20260923 17:14:05.626147 13719 tablet_service.cc:1514] Processing DeleteTablet for tablet 973df157f1ea480bbc995b26d8430be8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:14:05 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:60894
I20260923 17:14:05.627234 13833 tablet_replica.cc:330] T 973df157f1ea480bbc995b26d8430be8 P 5f57262c9aef494b9e98d7e2fec6b631: stopping tablet replica
I20260923 17:14:05.627576 13833 raft_consensus.cc:2229] T 973df157f1ea480bbc995b26d8430be8 P 5f57262c9aef494b9e98d7e2fec6b631 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:14:05.627553 13301 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44778:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 17:14:05.627919 13833 raft_consensus.cc:2258] T 973df157f1ea480bbc995b26d8430be8 P 5f57262c9aef494b9e98d7e2fec6b631 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260923 17:14:05.627956 13301 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 17:14:05.628360 13832 tablet_replica.cc:330] T 973df157f1ea480bbc995b26d8430be8 P 51297d6562284245b52294527ff846d1: stopping tablet replica
I20260923 17:14:05.628647 13832 raft_consensus.cc:2229] T 973df157f1ea480bbc995b26d8430be8 P 51297d6562284245b52294527ff846d1 [term 1 LEADER]: Raft consensus shutting down.
I20260923 17:14:05.628973 13832 raft_consensus.cc:2258] T 973df157f1ea480bbc995b26d8430be8 P 51297d6562284245b52294527ff846d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:14:05.629554 13831 tablet_replica.cc:330] T 973df157f1ea480bbc995b26d8430be8 P 5dabc71dec514792b9847ee6647a152f: stopping tablet replica
I20260923 17:14:05.629999 13831 raft_consensus.cc:2229] T 973df157f1ea480bbc995b26d8430be8 P 5dabc71dec514792b9847ee6647a152f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:14:05.630086 13833 ts_tablet_manager.cc:1905] T 973df157f1ea480bbc995b26d8430be8 P 5f57262c9aef494b9e98d7e2fec6b631: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:14:05.630330 13831 raft_consensus.cc:2258] T 973df157f1ea480bbc995b26d8430be8 P 5dabc71dec514792b9847ee6647a152f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:14:05.631825 13832 ts_tablet_manager.cc:1905] T 973df157f1ea480bbc995b26d8430be8 P 51297d6562284245b52294527ff846d1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:14:05.632550 13833 ts_tablet_manager.cc:1918] T 973df157f1ea480bbc995b26d8430be8 P 5f57262c9aef494b9e98d7e2fec6b631: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 17:14:05.632663 13833 log.cc:1196] T 973df157f1ea480bbc995b26d8430be8 P 5f57262c9aef494b9e98d7e2fec6b631: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-2/wal/wals/973df157f1ea480bbc995b26d8430be8
I20260923 17:14:05.632946 13833 ts_tablet_manager.cc:1939] T 973df157f1ea480bbc995b26d8430be8 P 5f57262c9aef494b9e98d7e2fec6b631: Deleting consensus metadata
I20260923 17:14:05.634109 13286 catalog_manager.cc:4841] TS 5f57262c9aef494b9e98d7e2fec6b631 (127.11.229.131:38577): tablet 973df157f1ea480bbc995b26d8430be8 (table test-table [id=77cd13b2b3344532ae7d06d3ac53c174]) successfully deleted
I20260923 17:14:05.634353 13832 ts_tablet_manager.cc:1918] T 973df157f1ea480bbc995b26d8430be8 P 51297d6562284245b52294527ff846d1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 17:14:05.634449 13832 log.cc:1196] T 973df157f1ea480bbc995b26d8430be8 P 51297d6562284245b52294527ff846d1: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-1/wal/wals/973df157f1ea480bbc995b26d8430be8
I20260923 17:14:05.634761 13832 ts_tablet_manager.cc:1939] T 973df157f1ea480bbc995b26d8430be8 P 51297d6562284245b52294527ff846d1: Deleting consensus metadata
I20260923 17:14:05.636070 13289 catalog_manager.cc:4841] TS 51297d6562284245b52294527ff846d1 (127.11.229.130:44687): tablet 973df157f1ea480bbc995b26d8430be8 (table test-table [id=77cd13b2b3344532ae7d06d3ac53c174]) successfully deleted
I20260923 17:14:05.636616 13831 ts_tablet_manager.cc:1905] T 973df157f1ea480bbc995b26d8430be8 P 5dabc71dec514792b9847ee6647a152f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:14:05.637344 13439 tablet_service.cc:1467] Processing CreateTablet for tablet 4bcaa423a01345c389be17fd5167b8e2 (DEFAULT_TABLE table=test-table [id=b2cb1b1728da44dbad0015d5dbb7cbde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:14:05.637621 13439 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4bcaa423a01345c389be17fd5167b8e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:05.637581 13719 tablet_service.cc:1467] Processing CreateTablet for tablet 4bcaa423a01345c389be17fd5167b8e2 (DEFAULT_TABLE table=test-table [id=b2cb1b1728da44dbad0015d5dbb7cbde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:14:05.637791 13719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4bcaa423a01345c389be17fd5167b8e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:05.639362 13831 ts_tablet_manager.cc:1918] T 973df157f1ea480bbc995b26d8430be8 P 5dabc71dec514792b9847ee6647a152f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 17:14:05.639442 13831 log.cc:1196] T 973df157f1ea480bbc995b26d8430be8 P 5dabc71dec514792b9847ee6647a152f: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-0/wal/wals/973df157f1ea480bbc995b26d8430be8
I20260923 17:14:05.639739 13831 ts_tablet_manager.cc:1939] T 973df157f1ea480bbc995b26d8430be8 P 5dabc71dec514792b9847ee6647a152f: Deleting consensus metadata
I20260923 17:14:05.639882 13808 tablet_bootstrap.cc:492] T 4bcaa423a01345c389be17fd5167b8e2 P 5f57262c9aef494b9e98d7e2fec6b631: Bootstrap starting.
I20260923 17:14:05.640363 13809 tablet_bootstrap.cc:492] T 4bcaa423a01345c389be17fd5167b8e2 P 5dabc71dec514792b9847ee6647a152f: Bootstrap starting.
I20260923 17:14:05.640476 13579 tablet_service.cc:1467] Processing CreateTablet for tablet 4bcaa423a01345c389be17fd5167b8e2 (DEFAULT_TABLE table=test-table [id=b2cb1b1728da44dbad0015d5dbb7cbde]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:14:05.640734 13579 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4bcaa423a01345c389be17fd5167b8e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:05.640810 13808 tablet_bootstrap.cc:654] T 4bcaa423a01345c389be17fd5167b8e2 P 5f57262c9aef494b9e98d7e2fec6b631: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:05.640967 13289 catalog_manager.cc:4841] TS 5dabc71dec514792b9847ee6647a152f (127.11.229.129:34671): tablet 973df157f1ea480bbc995b26d8430be8 (table test-table [id=77cd13b2b3344532ae7d06d3ac53c174]) successfully deleted
I20260923 17:14:05.641305 13809 tablet_bootstrap.cc:654] T 4bcaa423a01345c389be17fd5167b8e2 P 5dabc71dec514792b9847ee6647a152f: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:05.642592 13808 tablet_bootstrap.cc:492] T 4bcaa423a01345c389be17fd5167b8e2 P 5f57262c9aef494b9e98d7e2fec6b631: No bootstrap required, opened a new log
I20260923 17:14:05.642671 13808 ts_tablet_manager.cc:1397] T 4bcaa423a01345c389be17fd5167b8e2 P 5f57262c9aef494b9e98d7e2fec6b631: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260923 17:14:05.642741 13809 tablet_bootstrap.cc:492] T 4bcaa423a01345c389be17fd5167b8e2 P 5dabc71dec514792b9847ee6647a152f: No bootstrap required, opened a new log
I20260923 17:14:05.642814 13809 ts_tablet_manager.cc:1397] T 4bcaa423a01345c389be17fd5167b8e2 P 5dabc71dec514792b9847ee6647a152f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260923 17:14:05.643141 13810 tablet_bootstrap.cc:492] T 4bcaa423a01345c389be17fd5167b8e2 P 51297d6562284245b52294527ff846d1: Bootstrap starting.
I20260923 17:14:05.643090 13808 raft_consensus.cc:348] T 4bcaa423a01345c389be17fd5167b8e2 P 5f57262c9aef494b9e98d7e2fec6b631 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dabc71dec514792b9847ee6647a152f" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 34671 } } peers { permanent_uuid: "51297d6562284245b52294527ff846d1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44687 } } peers { permanent_uuid: "5f57262c9aef494b9e98d7e2fec6b631" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38577 } }
I20260923 17:14:05.643203 13808 raft_consensus.cc:374] T 4bcaa423a01345c389be17fd5167b8e2 P 5f57262c9aef494b9e98d7e2fec6b631 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:05.643234 13808 raft_consensus.cc:729] T 4bcaa423a01345c389be17fd5167b8e2 P 5f57262c9aef494b9e98d7e2fec6b631 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f57262c9aef494b9e98d7e2fec6b631, State: Initialized, Role: FOLLOWER
I20260923 17:14:05.643347 13808 consensus_queue.cc:260] T 4bcaa423a01345c389be17fd5167b8e2 P 5f57262c9aef494b9e98d7e2fec6b631 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dabc71dec514792b9847ee6647a152f" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 34671 } } peers { permanent_uuid: "51297d6562284245b52294527ff846d1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44687 } } peers { permanent_uuid: "5f57262c9aef494b9e98d7e2fec6b631" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38577 } }
I20260923 17:14:05.643386 13809 raft_consensus.cc:348] T 4bcaa423a01345c389be17fd5167b8e2 P 5dabc71dec514792b9847ee6647a152f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dabc71dec514792b9847ee6647a152f" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 34671 } } peers { permanent_uuid: "51297d6562284245b52294527ff846d1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44687 } } peers { permanent_uuid: "5f57262c9aef494b9e98d7e2fec6b631" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38577 } }
I20260923 17:14:05.643487 13809 raft_consensus.cc:374] T 4bcaa423a01345c389be17fd5167b8e2 P 5dabc71dec514792b9847ee6647a152f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:05.643524 13809 raft_consensus.cc:729] T 4bcaa423a01345c389be17fd5167b8e2 P 5dabc71dec514792b9847ee6647a152f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dabc71dec514792b9847ee6647a152f, State: Initialized, Role: FOLLOWER
I20260923 17:14:05.643586 13808 ts_tablet_manager.cc:1428] T 4bcaa423a01345c389be17fd5167b8e2 P 5f57262c9aef494b9e98d7e2fec6b631: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260923 17:14:05.643648 13809 consensus_queue.cc:260] T 4bcaa423a01345c389be17fd5167b8e2 P 5dabc71dec514792b9847ee6647a152f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dabc71dec514792b9847ee6647a152f" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 34671 } } peers { permanent_uuid: "51297d6562284245b52294527ff846d1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44687 } } peers { permanent_uuid: "5f57262c9aef494b9e98d7e2fec6b631" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38577 } }
I20260923 17:14:05.643911 13809 ts_tablet_manager.cc:1428] T 4bcaa423a01345c389be17fd5167b8e2 P 5dabc71dec514792b9847ee6647a152f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260923 17:14:05.644070 13810 tablet_bootstrap.cc:654] T 4bcaa423a01345c389be17fd5167b8e2 P 51297d6562284245b52294527ff846d1: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:05.646770 13810 tablet_bootstrap.cc:492] T 4bcaa423a01345c389be17fd5167b8e2 P 51297d6562284245b52294527ff846d1: No bootstrap required, opened a new log
I20260923 17:14:05.646872 13810 ts_tablet_manager.cc:1397] T 4bcaa423a01345c389be17fd5167b8e2 P 51297d6562284245b52294527ff846d1: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260923 17:14:05.647369 13810 raft_consensus.cc:348] T 4bcaa423a01345c389be17fd5167b8e2 P 51297d6562284245b52294527ff846d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dabc71dec514792b9847ee6647a152f" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 34671 } } peers { permanent_uuid: "51297d6562284245b52294527ff846d1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44687 } } peers { permanent_uuid: "5f57262c9aef494b9e98d7e2fec6b631" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38577 } }
I20260923 17:14:05.647506 13810 raft_consensus.cc:374] T 4bcaa423a01345c389be17fd5167b8e2 P 51297d6562284245b52294527ff846d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:05.647544 13810 raft_consensus.cc:729] T 4bcaa423a01345c389be17fd5167b8e2 P 51297d6562284245b52294527ff846d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51297d6562284245b52294527ff846d1, State: Initialized, Role: FOLLOWER
I20260923 17:14:05.647661 13810 consensus_queue.cc:260] T 4bcaa423a01345c389be17fd5167b8e2 P 51297d6562284245b52294527ff846d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dabc71dec514792b9847ee6647a152f" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 34671 } } peers { permanent_uuid: "51297d6562284245b52294527ff846d1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44687 } } peers { permanent_uuid: "5f57262c9aef494b9e98d7e2fec6b631" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38577 } }
I20260923 17:14:05.647944 13810 ts_tablet_manager.cc:1428] T 4bcaa423a01345c389be17fd5167b8e2 P 51297d6562284245b52294527ff846d1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
W20260923 17:14:05.663354 13786 tablet.cc:2369] T 4bcaa423a01345c389be17fd5167b8e2 P 5f57262c9aef494b9e98d7e2fec6b631: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 17:14:05.676344 13815 raft_consensus.cc:482] T 4bcaa423a01345c389be17fd5167b8e2 P 5dabc71dec514792b9847ee6647a152f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 17:14:05.676589 13815 raft_consensus.cc:504] T 4bcaa423a01345c389be17fd5167b8e2 P 5dabc71dec514792b9847ee6647a152f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dabc71dec514792b9847ee6647a152f" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 34671 } } peers { permanent_uuid: "51297d6562284245b52294527ff846d1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44687 } } peers { permanent_uuid: "5f57262c9aef494b9e98d7e2fec6b631" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38577 } }
I20260923 17:14:05.677825 13815 leader_election.cc:288] T 4bcaa423a01345c389be17fd5167b8e2 P 5dabc71dec514792b9847ee6647a152f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51297d6562284245b52294527ff846d1 (127.11.229.130:44687), 5f57262c9aef494b9e98d7e2fec6b631 (127.11.229.131:38577)
I20260923 17:14:05.682552 13806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:05.678179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:42055 (local address 127.11.229.131:38577)
0923 17:14:05.678453 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:05.678458 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:05.678660 (+ 202us) server_negotiation.cc:407] Connection header received
0923 17:14:05.678855 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:05.678858 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:05.678902 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:05.678951 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:14:05.679383 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.680094 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.681278 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.681867 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.681983 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:05.682035 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:05.682338 (+ 303us) server_negotiation.cc:299] Negotiation successful
0923 17:14:05.682423 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188}
I20260923 17:14:05.682833 13807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:05.678424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:48791 (local address 127.11.229.130:44687)
0923 17:14:05.678567 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:05.678571 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:05.678584 (+ 13us) server_negotiation.cc:407] Connection header received
0923 17:14:05.678636 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:05.678639 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:05.678685 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:05.678765 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:14:05.679092 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.679944 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.681510 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.682129 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.682274 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:05.682321 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:05.682632 (+ 311us) server_negotiation.cc:299] Negotiation successful
0923 17:14:05.682720 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260923 17:14:05.682916 13837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:05.678056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.131:38577 (local address 127.11.229.129:42055)
0923 17:14:05.678584 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:05.678597 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:05.678719 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:05.679081 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:05.679084 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:05.679098 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:14:05.679249 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:05.679257 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.680283 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.680286 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:05.681154 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:05.681163 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.682009 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.682013 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:05.682147 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:05.682174 (+ 27us) client_negotiation.cc:769] Sending connection context
0923 17:14:05.682688 (+ 514us) client_negotiation.cc:240] Negotiation successful
0923 17:14:05.682764 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":447,"thread_start_us":99,"threads_started":1}
I20260923 17:14:05.683295 13838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:05.678041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.130:44687 (local address 127.11.229.129:48791)
0923 17:14:05.678402 (+ 361us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:05.678417 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:05.678522 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:05.678795 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:05.678800 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:05.678819 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:14:05.678965 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:05.678972 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.680111 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.680114 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:05.681374 (+ 1260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:05.681385 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.682378 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.682383 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:05.682500 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:05.682519 (+ 19us) client_negotiation.cc:769] Sending connection context
0923 17:14:05.682853 (+ 334us) client_negotiation.cc:240] Negotiation successful
0923 17:14:05.683162 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":77,"threads_started":1}
I20260923 17:14:05.683378 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcaa423a01345c389be17fd5167b8e2" candidate_uuid: "5dabc71dec514792b9847ee6647a152f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f57262c9aef494b9e98d7e2fec6b631" is_pre_election: true
I20260923 17:14:05.683528 13739 raft_consensus.cc:2454] T 4bcaa423a01345c389be17fd5167b8e2 P 5f57262c9aef494b9e98d7e2fec6b631 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dabc71dec514792b9847ee6647a152f in term 0.
I20260923 17:14:05.683861 13597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcaa423a01345c389be17fd5167b8e2" candidate_uuid: "5dabc71dec514792b9847ee6647a152f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51297d6562284245b52294527ff846d1" is_pre_election: true
I20260923 17:14:05.684068 13597 raft_consensus.cc:2454] T 4bcaa423a01345c389be17fd5167b8e2 P 51297d6562284245b52294527ff846d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5dabc71dec514792b9847ee6647a152f in term 0.
I20260923 17:14:05.684106 13390 leader_election.cc:302] T 4bcaa423a01345c389be17fd5167b8e2 P 5dabc71dec514792b9847ee6647a152f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dabc71dec514792b9847ee6647a152f, 5f57262c9aef494b9e98d7e2fec6b631; no voters:
I20260923 17:14:05.684408 13815 raft_consensus.cc:2781] T 4bcaa423a01345c389be17fd5167b8e2 P 5dabc71dec514792b9847ee6647a152f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 17:14:05.684474 13815 raft_consensus.cc:482] T 4bcaa423a01345c389be17fd5167b8e2 P 5dabc71dec514792b9847ee6647a152f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 17:14:05.684522 13815 raft_consensus.cc:3037] T 4bcaa423a01345c389be17fd5167b8e2 P 5dabc71dec514792b9847ee6647a152f [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:05.685729 13815 raft_consensus.cc:504] T 4bcaa423a01345c389be17fd5167b8e2 P 5dabc71dec514792b9847ee6647a152f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dabc71dec514792b9847ee6647a152f" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 34671 } } peers { permanent_uuid: "51297d6562284245b52294527ff846d1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44687 } } peers { permanent_uuid: "5f57262c9aef494b9e98d7e2fec6b631" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38577 } }
I20260923 17:14:05.686095 13815 leader_election.cc:288] T 4bcaa423a01345c389be17fd5167b8e2 P 5dabc71dec514792b9847ee6647a152f [CANDIDATE]: Term 1 election: Requested vote from peers 51297d6562284245b52294527ff846d1 (127.11.229.130:44687), 5f57262c9aef494b9e98d7e2fec6b631 (127.11.229.131:38577)
I20260923 17:14:05.686491 13739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcaa423a01345c389be17fd5167b8e2" candidate_uuid: "5dabc71dec514792b9847ee6647a152f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f57262c9aef494b9e98d7e2fec6b631"
I20260923 17:14:05.686633 13739 raft_consensus.cc:3037] T 4bcaa423a01345c389be17fd5167b8e2 P 5f57262c9aef494b9e98d7e2fec6b631 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:05.687760 13739 raft_consensus.cc:2454] T 4bcaa423a01345c389be17fd5167b8e2 P 5f57262c9aef494b9e98d7e2fec6b631 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dabc71dec514792b9847ee6647a152f in term 1.
I20260923 17:14:05.688006 13597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcaa423a01345c389be17fd5167b8e2" candidate_uuid: "5dabc71dec514792b9847ee6647a152f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51297d6562284245b52294527ff846d1"
I20260923 17:14:05.688122 13597 raft_consensus.cc:3037] T 4bcaa423a01345c389be17fd5167b8e2 P 51297d6562284245b52294527ff846d1 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:05.689231 13597 raft_consensus.cc:2454] T 4bcaa423a01345c389be17fd5167b8e2 P 51297d6562284245b52294527ff846d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5dabc71dec514792b9847ee6647a152f in term 1.
I20260923 17:14:05.689535 13393 leader_election.cc:302] T 4bcaa423a01345c389be17fd5167b8e2 P 5dabc71dec514792b9847ee6647a152f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51297d6562284245b52294527ff846d1, 5dabc71dec514792b9847ee6647a152f; no voters:
I20260923 17:14:05.689709 13815 raft_consensus.cc:2781] T 4bcaa423a01345c389be17fd5167b8e2 P 5dabc71dec514792b9847ee6647a152f [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:14:05.689906 13815 raft_consensus.cc:686] T 4bcaa423a01345c389be17fd5167b8e2 P 5dabc71dec514792b9847ee6647a152f [term 1 LEADER]: Becoming Leader. State: Replica: 5dabc71dec514792b9847ee6647a152f, State: Running, Role: LEADER
I20260923 17:14:05.690155 13815 consensus_queue.cc:237] T 4bcaa423a01345c389be17fd5167b8e2 P 5dabc71dec514792b9847ee6647a152f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dabc71dec514792b9847ee6647a152f" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 34671 } } peers { permanent_uuid: "51297d6562284245b52294527ff846d1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44687 } } peers { permanent_uuid: "5f57262c9aef494b9e98d7e2fec6b631" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38577 } }
W20260923 17:14:05.690352 13646 tablet.cc:2369] T 4bcaa423a01345c389be17fd5167b8e2 P 51297d6562284245b52294527ff846d1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 17:14:05.692592 13302 catalog_manager.cc:5495] T 4bcaa423a01345c389be17fd5167b8e2 P 5dabc71dec514792b9847ee6647a152f reported cstate change: term changed from 0 to 1, leader changed from <none> to 5dabc71dec514792b9847ee6647a152f (127.11.229.129). New cstate: current_term: 1 leader_uuid: "5dabc71dec514792b9847ee6647a152f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dabc71dec514792b9847ee6647a152f" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 34671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51297d6562284245b52294527ff846d1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f57262c9aef494b9e98d7e2fec6b631" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38577 } health_report { overall_health: UNKNOWN } } }
W20260923 17:14:05.726259 13506 tablet.cc:2369] T 4bcaa423a01345c389be17fd5167b8e2 P 5dabc71dec514792b9847ee6647a152f: Can't schedule compaction. Clean time has not been advanced past its initial value.
Sep 23 17:14:05 dist-test-slave-1x1f krb5kdc[13257](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183644, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:14:05.737372 13846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:05.728026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:43857 (local address 127.0.0.1:44784)
0923 17:14:05.728342 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:05.728358 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:05.728465 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:05.728769 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:05.728771 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:05.729133 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:05.729230 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:05.729236 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.730329 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.730331 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:05.730915 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:05.730923 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.731562 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.731565 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:05.731647 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:05.732292 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:05.732304 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:05.733752 (+ 1448us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:05.735768 (+ 2016us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:05.735775 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:05.735780 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:05.736081 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:05.736365 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:05.736367 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:05.736369 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:05.736446 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:05.736878 (+ 432us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:05.736885 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:05.737016 (+ 131us) client_negotiation.cc:769] Sending connection context
0923 17:14:05.737114 (+ 98us) client_negotiation.cc:240] Negotiation successful
0923 17:14:05.737231 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":109,"threads_started":1}
I20260923 17:14:05.737516 13351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:05.728147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44784 (local address 127.11.229.190:43857)
0923 17:14:05.728293 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:05.728298 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:05.728443 (+ 145us) server_negotiation.cc:407] Connection header received
0923 17:14:05.728567 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:05.728571 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:05.728634 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:05.728734 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:05.729358 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.730181 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.731068 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.731441 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.731550 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:05.733902 (+ 2352us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:05.733906 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:05.733908 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:05.733940 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:05.735652 (+ 1712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:05.736182 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:05.736186 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:05.736188 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:05.736275 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:05.736535 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:05.736537 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:05.736539 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:05.736761 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:05.736863 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:05.737216 (+ 353us) server_negotiation.cc:299] Negotiation successful
0923 17:14:05.737337 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260923 17:14:05.741757 13302 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:44784:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260923 17:14:05.742560 13302 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 17:14:05.747380 13439 tablet_service.cc:1467] Processing CreateTablet for tablet b8265abf3f9a418abf113c3140f68710 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=0d62242ab4d449beaadd9b6bb6295b64]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260923 17:14:05.747507 13579 tablet_service.cc:1467] Processing CreateTablet for tablet b8265abf3f9a418abf113c3140f68710 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=0d62242ab4d449beaadd9b6bb6295b64]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260923 17:14:05.747593 13719 tablet_service.cc:1467] Processing CreateTablet for tablet b8265abf3f9a418abf113c3140f68710 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=0d62242ab4d449beaadd9b6bb6295b64]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260923 17:14:05.747807 13439 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8265abf3f9a418abf113c3140f68710. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:05.747882 13719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8265abf3f9a418abf113c3140f68710. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:05.747884 13579 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8265abf3f9a418abf113c3140f68710. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:05.750741 13810 tablet_bootstrap.cc:492] T b8265abf3f9a418abf113c3140f68710 P 51297d6562284245b52294527ff846d1: Bootstrap starting.
I20260923 17:14:05.750938 13809 tablet_bootstrap.cc:492] T b8265abf3f9a418abf113c3140f68710 P 5dabc71dec514792b9847ee6647a152f: Bootstrap starting.
I20260923 17:14:05.751659 13810 tablet_bootstrap.cc:654] T b8265abf3f9a418abf113c3140f68710 P 51297d6562284245b52294527ff846d1: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:05.751857 13809 tablet_bootstrap.cc:654] T b8265abf3f9a418abf113c3140f68710 P 5dabc71dec514792b9847ee6647a152f: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:05.752594 13808 tablet_bootstrap.cc:492] T b8265abf3f9a418abf113c3140f68710 P 5f57262c9aef494b9e98d7e2fec6b631: Bootstrap starting.
I20260923 17:14:05.753602 13808 tablet_bootstrap.cc:654] T b8265abf3f9a418abf113c3140f68710 P 5f57262c9aef494b9e98d7e2fec6b631: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:05.753620 13810 tablet_bootstrap.cc:492] T b8265abf3f9a418abf113c3140f68710 P 51297d6562284245b52294527ff846d1: No bootstrap required, opened a new log
I20260923 17:14:05.753690 13810 ts_tablet_manager.cc:1397] T b8265abf3f9a418abf113c3140f68710 P 51297d6562284245b52294527ff846d1: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260923 17:14:05.754179 13810 raft_consensus.cc:348] T b8265abf3f9a418abf113c3140f68710 P 51297d6562284245b52294527ff846d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dabc71dec514792b9847ee6647a152f" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 34671 } } peers { permanent_uuid: "51297d6562284245b52294527ff846d1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44687 } } peers { permanent_uuid: "5f57262c9aef494b9e98d7e2fec6b631" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38577 } }
I20260923 17:14:05.754343 13810 raft_consensus.cc:374] T b8265abf3f9a418abf113c3140f68710 P 51297d6562284245b52294527ff846d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:05.754384 13810 raft_consensus.cc:729] T b8265abf3f9a418abf113c3140f68710 P 51297d6562284245b52294527ff846d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51297d6562284245b52294527ff846d1, State: Initialized, Role: FOLLOWER
I20260923 17:14:05.754500 13810 consensus_queue.cc:260] T b8265abf3f9a418abf113c3140f68710 P 51297d6562284245b52294527ff846d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dabc71dec514792b9847ee6647a152f" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 34671 } } peers { permanent_uuid: "51297d6562284245b52294527ff846d1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44687 } } peers { permanent_uuid: "5f57262c9aef494b9e98d7e2fec6b631" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38577 } }
I20260923 17:14:05.754639 13809 tablet_bootstrap.cc:492] T b8265abf3f9a418abf113c3140f68710 P 5dabc71dec514792b9847ee6647a152f: No bootstrap required, opened a new log
I20260923 17:14:05.754711 13809 ts_tablet_manager.cc:1397] T b8265abf3f9a418abf113c3140f68710 P 5dabc71dec514792b9847ee6647a152f: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260923 17:14:05.754784 13810 ts_tablet_manager.cc:1428] T b8265abf3f9a418abf113c3140f68710 P 51297d6562284245b52294527ff846d1: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260923 17:14:05.754801 13828 tablet_replica.cc:439] T b8265abf3f9a418abf113c3140f68710 P 51297d6562284245b52294527ff846d1: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dabc71dec514792b9847ee6647a152f" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 34671 } } peers { permanent_uuid: "51297d6562284245b52294527ff846d1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44687 } } peers { permanent_uuid: "5f57262c9aef494b9e98d7e2fec6b631" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38577 } } }
I20260923 17:14:05.754947 13828 tablet_replica.cc:442] T b8265abf3f9a418abf113c3140f68710 P 51297d6562284245b52294527ff846d1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 17:14:05.755157 13809 raft_consensus.cc:348] T b8265abf3f9a418abf113c3140f68710 P 5dabc71dec514792b9847ee6647a152f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dabc71dec514792b9847ee6647a152f" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 34671 } } peers { permanent_uuid: "51297d6562284245b52294527ff846d1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44687 } } peers { permanent_uuid: "5f57262c9aef494b9e98d7e2fec6b631" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38577 } }
I20260923 17:14:05.755268 13809 raft_consensus.cc:374] T b8265abf3f9a418abf113c3140f68710 P 5dabc71dec514792b9847ee6647a152f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:05.755306 13809 raft_consensus.cc:729] T b8265abf3f9a418abf113c3140f68710 P 5dabc71dec514792b9847ee6647a152f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5dabc71dec514792b9847ee6647a152f, State: Initialized, Role: FOLLOWER
I20260923 17:14:05.755422 13809 consensus_queue.cc:260] T b8265abf3f9a418abf113c3140f68710 P 5dabc71dec514792b9847ee6647a152f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dabc71dec514792b9847ee6647a152f" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 34671 } } peers { permanent_uuid: "51297d6562284245b52294527ff846d1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44687 } } peers { permanent_uuid: "5f57262c9aef494b9e98d7e2fec6b631" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38577 } }
I20260923 17:14:05.755692 13809 ts_tablet_manager.cc:1428] T b8265abf3f9a418abf113c3140f68710 P 5dabc71dec514792b9847ee6647a152f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260923 17:14:05.755950 13839 tablet_replica.cc:439] T b8265abf3f9a418abf113c3140f68710 P 5dabc71dec514792b9847ee6647a152f: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dabc71dec514792b9847ee6647a152f" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 34671 } } peers { permanent_uuid: "51297d6562284245b52294527ff846d1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44687 } } peers { permanent_uuid: "5f57262c9aef494b9e98d7e2fec6b631" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38577 } } }
I20260923 17:14:05.756098 13839 tablet_replica.cc:442] T b8265abf3f9a418abf113c3140f68710 P 5dabc71dec514792b9847ee6647a152f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 17:14:05.756832 13808 tablet_bootstrap.cc:492] T b8265abf3f9a418abf113c3140f68710 P 5f57262c9aef494b9e98d7e2fec6b631: No bootstrap required, opened a new log
I20260923 17:14:05.756925 13808 ts_tablet_manager.cc:1397] T b8265abf3f9a418abf113c3140f68710 P 5f57262c9aef494b9e98d7e2fec6b631: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260923 17:14:05.757352 13808 raft_consensus.cc:348] T b8265abf3f9a418abf113c3140f68710 P 5f57262c9aef494b9e98d7e2fec6b631 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dabc71dec514792b9847ee6647a152f" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 34671 } } peers { permanent_uuid: "51297d6562284245b52294527ff846d1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44687 } } peers { permanent_uuid: "5f57262c9aef494b9e98d7e2fec6b631" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38577 } }
I20260923 17:14:05.757440 13808 raft_consensus.cc:374] T b8265abf3f9a418abf113c3140f68710 P 5f57262c9aef494b9e98d7e2fec6b631 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:05.757462 13808 raft_consensus.cc:729] T b8265abf3f9a418abf113c3140f68710 P 5f57262c9aef494b9e98d7e2fec6b631 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f57262c9aef494b9e98d7e2fec6b631, State: Initialized, Role: FOLLOWER
I20260923 17:14:05.757596 13808 consensus_queue.cc:260] T b8265abf3f9a418abf113c3140f68710 P 5f57262c9aef494b9e98d7e2fec6b631 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dabc71dec514792b9847ee6647a152f" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 34671 } } peers { permanent_uuid: "51297d6562284245b52294527ff846d1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44687 } } peers { permanent_uuid: "5f57262c9aef494b9e98d7e2fec6b631" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38577 } }
I20260923 17:14:05.757865 13808 ts_tablet_manager.cc:1428] T b8265abf3f9a418abf113c3140f68710 P 5f57262c9aef494b9e98d7e2fec6b631: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260923 17:14:05.758770 13814 tablet_replica.cc:439] T b8265abf3f9a418abf113c3140f68710 P 5f57262c9aef494b9e98d7e2fec6b631: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dabc71dec514792b9847ee6647a152f" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 34671 } } peers { permanent_uuid: "51297d6562284245b52294527ff846d1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44687 } } peers { permanent_uuid: "5f57262c9aef494b9e98d7e2fec6b631" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38577 } } }
I20260923 17:14:05.758916 13814 tablet_replica.cc:442] T b8265abf3f9a418abf113c3140f68710 P 5f57262c9aef494b9e98d7e2fec6b631: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 17:14:05.861349 13814 raft_consensus.cc:482] T b8265abf3f9a418abf113c3140f68710 P 5f57262c9aef494b9e98d7e2fec6b631 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 17:14:05.861488 13814 raft_consensus.cc:504] T b8265abf3f9a418abf113c3140f68710 P 5f57262c9aef494b9e98d7e2fec6b631 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dabc71dec514792b9847ee6647a152f" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 34671 } } peers { permanent_uuid: "51297d6562284245b52294527ff846d1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44687 } } peers { permanent_uuid: "5f57262c9aef494b9e98d7e2fec6b631" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38577 } }
I20260923 17:14:05.862901 13814 leader_election.cc:288] T b8265abf3f9a418abf113c3140f68710 P 5f57262c9aef494b9e98d7e2fec6b631 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5dabc71dec514792b9847ee6647a152f (127.11.229.129:34671), 51297d6562284245b52294527ff846d1 (127.11.229.130:44687)
I20260923 17:14:05.866851 13803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:05.863240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:54137 (local address 127.11.229.129:34671)
0923 17:14:05.863372 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:05.863376 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:05.863393 (+ 17us) server_negotiation.cc:407] Connection header received
0923 17:14:05.863459 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:05.863463 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:05.863516 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:05.863607 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:14:05.864254 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.864759 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.865780 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.866292 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.866424 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:05.866479 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:05.866669 (+ 190us) server_negotiation.cc:299] Negotiation successful
0923 17:14:05.866734 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260923 17:14:05.866851 13678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:05.863106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:34671 (local address 127.11.229.131:54137)
0923 17:14:05.863247 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:05.863264 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:05.863366 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:05.863628 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:05.863631 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:05.863651 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:14:05.864120 (+ 469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:05.864127 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.864869 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.864875 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:05.865654 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:05.865662 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.866411 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.866414 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:05.866519 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:05.866547 (+ 28us) client_negotiation.cc:769] Sending connection context
0923 17:14:05.866646 (+ 99us) client_negotiation.cc:240] Negotiation successful
0923 17:14:05.866718 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260923 17:14:05.867403 13807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:05.863478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:50767 (local address 127.11.229.130:44687)
0923 17:14:05.863612 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:05.863617 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:05.863867 (+ 250us) server_negotiation.cc:407] Connection header received
0923 17:14:05.864045 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:05.864050 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:05.864102 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:05.864193 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:14:05.864471 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.865017 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.866155 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.866687 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.866816 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:05.866868 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:05.867209 (+ 341us) server_negotiation.cc:299] Negotiation successful
0923 17:14:05.867287 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260923 17:14:05.867409 13850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:05.863412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.130:44687 (local address 127.11.229.131:50767)
0923 17:14:05.863775 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:05.863786 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:05.863917 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:05.864206 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:05.864209 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:05.864225 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:14:05.864363 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:05.864368 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.865135 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.865142 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:05.866043 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:05.866055 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.866816 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.866820 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:05.867039 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:05.867071 (+ 32us) client_negotiation.cc:769] Sending connection context
0923 17:14:05.867182 (+ 111us) client_negotiation.cc:240] Negotiation successful
0923 17:14:05.867250 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"mutex_wait_us":1,"thread_start_us":137,"threads_started":1}
I20260923 17:14:05.867445 13459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8265abf3f9a418abf113c3140f68710" candidate_uuid: "5f57262c9aef494b9e98d7e2fec6b631" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dabc71dec514792b9847ee6647a152f" is_pre_election: true
I20260923 17:14:05.867601 13459 raft_consensus.cc:2454] T b8265abf3f9a418abf113c3140f68710 P 5dabc71dec514792b9847ee6647a152f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f57262c9aef494b9e98d7e2fec6b631 in term 0.
I20260923 17:14:05.867947 13597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8265abf3f9a418abf113c3140f68710" candidate_uuid: "5f57262c9aef494b9e98d7e2fec6b631" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51297d6562284245b52294527ff846d1" is_pre_election: true
I20260923 17:14:05.867969 13673 leader_election.cc:302] T b8265abf3f9a418abf113c3140f68710 P 5f57262c9aef494b9e98d7e2fec6b631 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dabc71dec514792b9847ee6647a152f, 5f57262c9aef494b9e98d7e2fec6b631; no voters:
I20260923 17:14:05.868091 13597 raft_consensus.cc:2454] T b8265abf3f9a418abf113c3140f68710 P 51297d6562284245b52294527ff846d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f57262c9aef494b9e98d7e2fec6b631 in term 0.
I20260923 17:14:05.868220 13814 raft_consensus.cc:2781] T b8265abf3f9a418abf113c3140f68710 P 5f57262c9aef494b9e98d7e2fec6b631 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 17:14:05.868294 13814 raft_consensus.cc:482] T b8265abf3f9a418abf113c3140f68710 P 5f57262c9aef494b9e98d7e2fec6b631 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 17:14:05.868360 13814 raft_consensus.cc:3037] T b8265abf3f9a418abf113c3140f68710 P 5f57262c9aef494b9e98d7e2fec6b631 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:05.869366 13814 raft_consensus.cc:504] T b8265abf3f9a418abf113c3140f68710 P 5f57262c9aef494b9e98d7e2fec6b631 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dabc71dec514792b9847ee6647a152f" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 34671 } } peers { permanent_uuid: "51297d6562284245b52294527ff846d1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44687 } } peers { permanent_uuid: "5f57262c9aef494b9e98d7e2fec6b631" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38577 } }
I20260923 17:14:05.869661 13814 leader_election.cc:288] T b8265abf3f9a418abf113c3140f68710 P 5f57262c9aef494b9e98d7e2fec6b631 [CANDIDATE]: Term 1 election: Requested vote from peers 5dabc71dec514792b9847ee6647a152f (127.11.229.129:34671), 51297d6562284245b52294527ff846d1 (127.11.229.130:44687)
I20260923 17:14:05.870002 13459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8265abf3f9a418abf113c3140f68710" candidate_uuid: "5f57262c9aef494b9e98d7e2fec6b631" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5dabc71dec514792b9847ee6647a152f"
I20260923 17:14:05.870085 13597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8265abf3f9a418abf113c3140f68710" candidate_uuid: "5f57262c9aef494b9e98d7e2fec6b631" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51297d6562284245b52294527ff846d1"
I20260923 17:14:05.870124 13459 raft_consensus.cc:3037] T b8265abf3f9a418abf113c3140f68710 P 5dabc71dec514792b9847ee6647a152f [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:05.870190 13597 raft_consensus.cc:3037] T b8265abf3f9a418abf113c3140f68710 P 51297d6562284245b52294527ff846d1 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:05.871255 13459 raft_consensus.cc:2454] T b8265abf3f9a418abf113c3140f68710 P 5dabc71dec514792b9847ee6647a152f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f57262c9aef494b9e98d7e2fec6b631 in term 1.
I20260923 17:14:05.871255 13597 raft_consensus.cc:2454] T b8265abf3f9a418abf113c3140f68710 P 51297d6562284245b52294527ff846d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f57262c9aef494b9e98d7e2fec6b631 in term 1.
I20260923 17:14:05.871552 13673 leader_election.cc:302] T b8265abf3f9a418abf113c3140f68710 P 5f57262c9aef494b9e98d7e2fec6b631 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5dabc71dec514792b9847ee6647a152f, 5f57262c9aef494b9e98d7e2fec6b631; no voters:
I20260923 17:14:05.871702 13814 raft_consensus.cc:2781] T b8265abf3f9a418abf113c3140f68710 P 5f57262c9aef494b9e98d7e2fec6b631 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:14:05.871958 13814 raft_consensus.cc:686] T b8265abf3f9a418abf113c3140f68710 P 5f57262c9aef494b9e98d7e2fec6b631 [term 1 LEADER]: Becoming Leader. State: Replica: 5f57262c9aef494b9e98d7e2fec6b631, State: Running, Role: LEADER
I20260923 17:14:05.872298 13814 consensus_queue.cc:237] T b8265abf3f9a418abf113c3140f68710 P 5f57262c9aef494b9e98d7e2fec6b631 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dabc71dec514792b9847ee6647a152f" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 34671 } } peers { permanent_uuid: "51297d6562284245b52294527ff846d1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44687 } } peers { permanent_uuid: "5f57262c9aef494b9e98d7e2fec6b631" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38577 } }
I20260923 17:14:05.873471 13851 tablet_replica.cc:439] T b8265abf3f9a418abf113c3140f68710 P 5f57262c9aef494b9e98d7e2fec6b631: TxnStatusTablet state changed. Reason: New leader 5f57262c9aef494b9e98d7e2fec6b631. Latest consensus state: current_term: 1 leader_uuid: "5f57262c9aef494b9e98d7e2fec6b631" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dabc71dec514792b9847ee6647a152f" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 34671 } } peers { permanent_uuid: "51297d6562284245b52294527ff846d1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44687 } } peers { permanent_uuid: "5f57262c9aef494b9e98d7e2fec6b631" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38577 } } }
I20260923 17:14:05.873572 13851 tablet_replica.cc:442] T b8265abf3f9a418abf113c3140f68710 P 5f57262c9aef494b9e98d7e2fec6b631: This TxnStatusTablet replica's current role is: LEADER
I20260923 17:14:05.873932 13853 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260923 17:14:05.874080 13853 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260923 17:14:05.874663 13301 catalog_manager.cc:5495] T b8265abf3f9a418abf113c3140f68710 P 5f57262c9aef494b9e98d7e2fec6b631 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f57262c9aef494b9e98d7e2fec6b631 (127.11.229.131). New cstate: current_term: 1 leader_uuid: "5f57262c9aef494b9e98d7e2fec6b631" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dabc71dec514792b9847ee6647a152f" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 34671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51297d6562284245b52294527ff846d1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44687 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f57262c9aef494b9e98d7e2fec6b631" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38577 } health_report { overall_health: HEALTHY } } }
I20260923 17:14:05.914757 13806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:05.910081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60910 (local address 127.11.229.131:38577)
0923 17:14:05.910216 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:05.910219 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:05.910281 (+ 62us) server_negotiation.cc:407] Connection header received
0923 17:14:05.910481 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:05.910483 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:05.910553 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:05.910649 (+ 96us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 17:14:05.911002 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.911629 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.912861 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.913100 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.913204 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:05.913577 (+ 373us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 17:14:05.914359 (+ 782us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 17:14:05.914475 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:05.914586 (+ 111us) server_negotiation.cc:299] Negotiation successful
0923 17:14:05.914639 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260923 17:14:05.914813 13846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:05.909911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.131:38577 (local address 127.0.0.1:60910)
0923 17:14:05.910198 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:05.910214 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:05.910340 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:05.910689 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:05.910693 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:05.910702 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0923 17:14:05.910870 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:05.910880 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.911732 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.911736 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:05.912727 (+ 991us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:05.912737 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.913225 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.913229 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:05.913332 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:05.913389 (+ 57us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0923 17:14:05.914468 (+ 1079us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0923 17:14:05.914484 (+ 16us) client_negotiation.cc:769] Sending connection context
0923 17:14:05.914577 (+ 93us) client_negotiation.cc:240] Negotiation successful
0923 17:14:05.914670 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186}
I20260923 17:14:05.917959 13459 raft_consensus.cc:1261] T b8265abf3f9a418abf113c3140f68710 P 5dabc71dec514792b9847ee6647a152f [term 1 FOLLOWER]: Refusing update from remote peer 5f57262c9aef494b9e98d7e2fec6b631: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:14:05.918176 13597 raft_consensus.cc:1261] T b8265abf3f9a418abf113c3140f68710 P 51297d6562284245b52294527ff846d1 [term 1 FOLLOWER]: Refusing update from remote peer 5f57262c9aef494b9e98d7e2fec6b631: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:14:05.918587 13814 consensus_queue.cc:1035] T b8265abf3f9a418abf113c3140f68710 P 5f57262c9aef494b9e98d7e2fec6b631 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5dabc71dec514792b9847ee6647a152f" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 34671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:14:05.918747 13851 consensus_queue.cc:1035] T b8265abf3f9a418abf113c3140f68710 P 5f57262c9aef494b9e98d7e2fec6b631 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51297d6562284245b52294527ff846d1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:14:05.920254 13839 tablet_replica.cc:439] T b8265abf3f9a418abf113c3140f68710 P 5dabc71dec514792b9847ee6647a152f: TxnStatusTablet state changed. Reason: New leader 5f57262c9aef494b9e98d7e2fec6b631. Latest consensus state: current_term: 1 leader_uuid: "5f57262c9aef494b9e98d7e2fec6b631" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dabc71dec514792b9847ee6647a152f" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 34671 } } peers { permanent_uuid: "51297d6562284245b52294527ff846d1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44687 } } peers { permanent_uuid: "5f57262c9aef494b9e98d7e2fec6b631" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38577 } } }
I20260923 17:14:05.920367 13839 tablet_replica.cc:442] T b8265abf3f9a418abf113c3140f68710 P 5dabc71dec514792b9847ee6647a152f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 17:14:05.921133 13828 tablet_replica.cc:439] T b8265abf3f9a418abf113c3140f68710 P 51297d6562284245b52294527ff846d1: TxnStatusTablet state changed. Reason: New leader 5f57262c9aef494b9e98d7e2fec6b631. Latest consensus state: current_term: 1 leader_uuid: "5f57262c9aef494b9e98d7e2fec6b631" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dabc71dec514792b9847ee6647a152f" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 34671 } } peers { permanent_uuid: "51297d6562284245b52294527ff846d1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44687 } } peers { permanent_uuid: "5f57262c9aef494b9e98d7e2fec6b631" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38577 } } }
I20260923 17:14:05.921226 13828 tablet_replica.cc:442] T b8265abf3f9a418abf113c3140f68710 P 51297d6562284245b52294527ff846d1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 17:14:05.923105 13851 tablet_replica.cc:439] T b8265abf3f9a418abf113c3140f68710 P 5f57262c9aef494b9e98d7e2fec6b631: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5f57262c9aef494b9e98d7e2fec6b631" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dabc71dec514792b9847ee6647a152f" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 34671 } } peers { permanent_uuid: "51297d6562284245b52294527ff846d1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44687 } } peers { permanent_uuid: "5f57262c9aef494b9e98d7e2fec6b631" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38577 } } }
I20260923 17:14:05.923214 13851 tablet_replica.cc:442] T b8265abf3f9a418abf113c3140f68710 P 5f57262c9aef494b9e98d7e2fec6b631: This TxnStatusTablet replica's current role is: LEADER
I20260923 17:14:05.923774 13814 tablet_replica.cc:439] T b8265abf3f9a418abf113c3140f68710 P 5f57262c9aef494b9e98d7e2fec6b631: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5f57262c9aef494b9e98d7e2fec6b631" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dabc71dec514792b9847ee6647a152f" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 34671 } } peers { permanent_uuid: "51297d6562284245b52294527ff846d1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44687 } } peers { permanent_uuid: "5f57262c9aef494b9e98d7e2fec6b631" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38577 } } }
I20260923 17:14:05.923870 13814 tablet_replica.cc:442] T b8265abf3f9a418abf113c3140f68710 P 5f57262c9aef494b9e98d7e2fec6b631: This TxnStatusTablet replica's current role is: LEADER
I20260923 17:14:05.924173 13839 tablet_replica.cc:439] T b8265abf3f9a418abf113c3140f68710 P 5dabc71dec514792b9847ee6647a152f: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5f57262c9aef494b9e98d7e2fec6b631" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dabc71dec514792b9847ee6647a152f" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 34671 } } peers { permanent_uuid: "51297d6562284245b52294527ff846d1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44687 } } peers { permanent_uuid: "5f57262c9aef494b9e98d7e2fec6b631" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38577 } } }
I20260923 17:14:05.924314 13839 tablet_replica.cc:442] T b8265abf3f9a418abf113c3140f68710 P 5dabc71dec514792b9847ee6647a152f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 17:14:05.928768 13828 tablet_replica.cc:439] T b8265abf3f9a418abf113c3140f68710 P 51297d6562284245b52294527ff846d1: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5f57262c9aef494b9e98d7e2fec6b631" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5dabc71dec514792b9847ee6647a152f" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 34671 } } peers { permanent_uuid: "51297d6562284245b52294527ff846d1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44687 } } peers { permanent_uuid: "5f57262c9aef494b9e98d7e2fec6b631" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38577 } } }
I20260923 17:14:05.928898 13828 tablet_replica.cc:442] T b8265abf3f9a418abf113c3140f68710 P 51297d6562284245b52294527ff846d1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 17:14:05.934101 13803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:05.929887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46448 (local address 127.11.229.129:34671)
0923 17:14:05.930030 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:05.930035 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:05.930051 (+ 16us) server_negotiation.cc:407] Connection header received
0923 17:14:05.930143 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:05.930146 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:05.930216 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:05.930373 (+ 157us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 17:14:05.930616 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.931249 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.932397 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.932743 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.932854 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:05.933157 (+ 303us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 17:14:05.933630 (+ 473us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 17:14:05.933735 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:05.933823 (+ 88us) server_negotiation.cc:299] Negotiation successful
0923 17:14:05.933879 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260923 17:14:05.945365 13806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:05.941980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:35131 (local address 127.11.229.131:38577)
0923 17:14:05.942209 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:05.942215 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:05.942264 (+ 49us) server_negotiation.cc:407] Connection header received
0923 17:14:05.942439 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:05.942442 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:05.942496 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:05.942572 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 17:14:05.942862 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.943381 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.944279 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.944505 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.944614 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:05.944891 (+ 277us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 17:14:05.944968 (+ 77us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 17:14:05.945043 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:05.945169 (+ 126us) server_negotiation.cc:299] Negotiation successful
0923 17:14:05.945217 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135}
I20260923 17:14:05.945796 13860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:05.941874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.131:38577 (local address 127.11.229.129:35131)
0923 17:14:05.942163 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:05.942184 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:05.942328 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:05.942620 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:05.942623 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:05.942631 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0923 17:14:05.942757 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:05.942762 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.943492 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.943497 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:05.944139 (+ 642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:05.944147 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.944617 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.944621 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:05.944717 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:05.944757 (+ 40us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0923 17:14:05.945058 (+ 301us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0923 17:14:05.945066 (+ 8us) client_negotiation.cc:769] Sending connection context
0923 17:14:05.945147 (+ 81us) client_negotiation.cc:240] Negotiation successful
0923 17:14:05.945228 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":115,"threads_started":1}
I20260923 17:14:05.952997 13739 raft_consensus.cc:1261] T 4bcaa423a01345c389be17fd5167b8e2 P 5f57262c9aef494b9e98d7e2fec6b631 [term 1 FOLLOWER]: Refusing update from remote peer 5dabc71dec514792b9847ee6647a152f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:14:05.953003 13597 raft_consensus.cc:1261] T 4bcaa423a01345c389be17fd5167b8e2 P 51297d6562284245b52294527ff846d1 [term 1 FOLLOWER]: Refusing update from remote peer 5dabc71dec514792b9847ee6647a152f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:14:05.953431 13839 consensus_queue.cc:1035] T 4bcaa423a01345c389be17fd5167b8e2 P 5dabc71dec514792b9847ee6647a152f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f57262c9aef494b9e98d7e2fec6b631" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38577 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:14:05.953596 13815 consensus_queue.cc:1035] T 4bcaa423a01345c389be17fd5167b8e2 P 5dabc71dec514792b9847ee6647a152f [LEADER]: Connected to new peer: Peer: permanent_uuid: "51297d6562284245b52294527ff846d1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:14:05.976903 13803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:05.972824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:49625 (local address 127.11.229.129:34671)
0923 17:14:05.972958 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:05.972963 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:05.972976 (+ 13us) server_negotiation.cc:407] Connection header received
0923 17:14:05.973020 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:05.973023 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:05.973073 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:05.973153 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 17:14:05.973441 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.974278 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.975722 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.976068 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.976169 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:05.976461 (+ 292us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 17:14:05.976543 (+ 82us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 17:14:05.976609 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:05.976728 (+ 119us) server_negotiation.cc:299] Negotiation successful
0923 17:14:05.976777 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260923 17:14:05.976948 13867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:05.972484 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:34671 (local address 127.11.229.131:49625)
0923 17:14:05.972810 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:05.972825 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:05.972923 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:05.973189 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:05.973193 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:05.973201 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0923 17:14:05.973307 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:05.973313 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.974416 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.974422 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:05.975591 (+ 1169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:05.975605 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:05.976188 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:05.976192 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:05.976278 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:05.976329 (+ 51us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0923 17:14:05.976633 (+ 304us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0923 17:14:05.976639 (+ 6us) client_negotiation.cc:769] Sending connection context
0923 17:14:05.976708 (+ 69us) client_negotiation.cc:240] Negotiation successful
0923 17:14:05.976785 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":110,"threads_started":1}
I20260923 17:14:06.012951 13302 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44778:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:14:06.013139 13302 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44778:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:14:06.015588 13302 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6112ca0421594b58a0155fb655bbbd75: Sending DeleteTablet for 3 replicas of tablet 4bcaa423a01345c389be17fd5167b8e2
I20260923 17:14:06.016496 13719 tablet_service.cc:1514] Processing DeleteTablet for tablet 4bcaa423a01345c389be17fd5167b8e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:14:06 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:60894
I20260923 17:14:06.016628 13439 tablet_service.cc:1514] Processing DeleteTablet for tablet 4bcaa423a01345c389be17fd5167b8e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:14:06 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:46436
I20260923 17:14:06.016681 13833 tablet_replica.cc:330] T 4bcaa423a01345c389be17fd5167b8e2 P 5f57262c9aef494b9e98d7e2fec6b631: stopping tablet replica
I20260923 17:14:06.016795 13833 raft_consensus.cc:2229] T 4bcaa423a01345c389be17fd5167b8e2 P 5f57262c9aef494b9e98d7e2fec6b631 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:14:06.016808 13831 tablet_replica.cc:330] T 4bcaa423a01345c389be17fd5167b8e2 P 5dabc71dec514792b9847ee6647a152f: stopping tablet replica
I20260923 17:14:06.016934 13833 raft_consensus.cc:2258] T 4bcaa423a01345c389be17fd5167b8e2 P 5f57262c9aef494b9e98d7e2fec6b631 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:14:06.016934 13831 raft_consensus.cc:2229] T 4bcaa423a01345c389be17fd5167b8e2 P 5dabc71dec514792b9847ee6647a152f [term 1 LEADER]: Raft consensus shutting down.
I20260923 17:14:06.017246 13831 raft_consensus.cc:2258] T 4bcaa423a01345c389be17fd5167b8e2 P 5dabc71dec514792b9847ee6647a152f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:14:06.018052 13831 ts_tablet_manager.cc:1905] T 4bcaa423a01345c389be17fd5167b8e2 P 5dabc71dec514792b9847ee6647a152f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:14:06.018116 13833 ts_tablet_manager.cc:1905] T 4bcaa423a01345c389be17fd5167b8e2 P 5f57262c9aef494b9e98d7e2fec6b631: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:14:06.018496 13579 tablet_service.cc:1514] Processing DeleteTablet for tablet 4bcaa423a01345c389be17fd5167b8e2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:14:06 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:60142
I20260923 17:14:06.018677 13832 tablet_replica.cc:330] T 4bcaa423a01345c389be17fd5167b8e2 P 51297d6562284245b52294527ff846d1: stopping tablet replica
I20260923 17:14:06.018790 13832 raft_consensus.cc:2229] T 4bcaa423a01345c389be17fd5167b8e2 P 51297d6562284245b52294527ff846d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:14:06.018898 13832 raft_consensus.cc:2258] T 4bcaa423a01345c389be17fd5167b8e2 P 51297d6562284245b52294527ff846d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:14:06.021209 13833 ts_tablet_manager.cc:1918] T 4bcaa423a01345c389be17fd5167b8e2 P 5f57262c9aef494b9e98d7e2fec6b631: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 17:14:06.021278 13833 log.cc:1196] T 4bcaa423a01345c389be17fd5167b8e2 P 5f57262c9aef494b9e98d7e2fec6b631: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-2/wal/wals/4bcaa423a01345c389be17fd5167b8e2
I20260923 17:14:06.021539 13833 ts_tablet_manager.cc:1939] T 4bcaa423a01345c389be17fd5167b8e2 P 5f57262c9aef494b9e98d7e2fec6b631: Deleting consensus metadata
I20260923 17:14:06.021637 13831 ts_tablet_manager.cc:1918] T 4bcaa423a01345c389be17fd5167b8e2 P 5dabc71dec514792b9847ee6647a152f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 17:14:06.021706 13831 log.cc:1196] T 4bcaa423a01345c389be17fd5167b8e2 P 5dabc71dec514792b9847ee6647a152f: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-0/wal/wals/4bcaa423a01345c389be17fd5167b8e2
I20260923 17:14:06.021953 13831 ts_tablet_manager.cc:1939] T 4bcaa423a01345c389be17fd5167b8e2 P 5dabc71dec514792b9847ee6647a152f: Deleting consensus metadata
I20260923 17:14:06.022361 13286 catalog_manager.cc:4841] TS 5f57262c9aef494b9e98d7e2fec6b631 (127.11.229.131:38577): tablet 4bcaa423a01345c389be17fd5167b8e2 (table test-table [id=b2cb1b1728da44dbad0015d5dbb7cbde]) successfully deleted
I20260923 17:14:06.023303 13289 catalog_manager.cc:4841] TS 5dabc71dec514792b9847ee6647a152f (127.11.229.129:34671): tablet 4bcaa423a01345c389be17fd5167b8e2 (table test-table [id=b2cb1b1728da44dbad0015d5dbb7cbde]) successfully deleted
I20260923 17:14:06.023826 13832 ts_tablet_manager.cc:1905] T 4bcaa423a01345c389be17fd5167b8e2 P 51297d6562284245b52294527ff846d1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:14:06.026650 13832 ts_tablet_manager.cc:1918] T 4bcaa423a01345c389be17fd5167b8e2 P 51297d6562284245b52294527ff846d1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 17:14:06.026727 13832 log.cc:1196] T 4bcaa423a01345c389be17fd5167b8e2 P 51297d6562284245b52294527ff846d1: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790183633736342-12182-0/minicluster-data/ts-1/wal/wals/4bcaa423a01345c389be17fd5167b8e2
I20260923 17:14:06.026985 13832 ts_tablet_manager.cc:1939] T 4bcaa423a01345c389be17fd5167b8e2 P 51297d6562284245b52294527ff846d1: Deleting consensus metadata
I20260923 17:14:06.027814 13289 catalog_manager.cc:4841] TS 51297d6562284245b52294527ff846d1 (127.11.229.130:44687): tablet 4bcaa423a01345c389be17fd5167b8e2 (table test-table [id=b2cb1b1728da44dbad0015d5dbb7cbde]) successfully deleted
Sep 23 17:14:06 dist-test-slave-1x1f krb5kdc[13257](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183645, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.229.129@KRBTEST.COM
I20260923 17:14:06.050278 13803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:06.027582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46450 (local address 127.11.229.129:34671)
0923 17:14:06.027694 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:06.027698 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:06.030555 (+ 2857us) server_negotiation.cc:407] Connection header received
0923 17:14:06.030688 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:06.030691 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:06.030744 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:06.030833 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:06.031667 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:06.032463 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:06.033962 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:06.034348 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:06.034424 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:06.045342 (+ 10918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:06.045358 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:06.045376 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:06.045412 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:06.047883 (+ 2471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:06.048460 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:06.048467 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:06.048469 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:06.048569 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:06.048885 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:06.048889 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:06.048900 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:06.049274 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:06.049474 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:06.049906 (+ 432us) server_negotiation.cc:299] Negotiation successful
0923 17:14:06.050048 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
W20260923 17:14:06.051263 13499 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46450
I20260923 17:14:06.062762 13351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:06.053412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44800 (local address 127.11.229.190:43857)
0923 17:14:06.053546 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:06.053551 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:06.053697 (+ 146us) server_negotiation.cc:407] Connection header received
0923 17:14:06.053827 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:06.053833 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:06.053892 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:06.053968 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:06.054735 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:06.055581 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:06.056881 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:06.057239 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:06.057311 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:06.059019 (+ 1708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:06.059023 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:06.059026 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:06.059054 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:06.060731 (+ 1677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:06.061313 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:06.061320 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:06.061321 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:06.061403 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:06.061700 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:06.061703 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:06.061705 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:06.061912 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:06.062013 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:06.062392 (+ 379us) server_negotiation.cc:299] Negotiation successful
0923 17:14:06.062545 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
W20260923 17:14:06.063201 13302 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44800
I20260923 17:14:06.064553 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 13374
I20260923 17:14:06.075416 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 13514
I20260923 17:14:06.083508 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 13654
I20260923 17:14:06.093350 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 13270
2026-09-23T17:14:06Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2798 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 17:14:06 dist-test-slave-1x1f krb5kdc[13876](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 17:14:06 dist-test-slave-1x1f krb5kdc[13876](info): set up 2 sockets
Sep 23 17:14:06 dist-test-slave-1x1f krb5kdc[13876](info): commencing operation
krb5kdc: starting...
W20260923 17:14:07.190697 12182 mini_kdc.cc:121] Time spent starting KDC: real 1.074s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Sep 23 17:14:07 dist-test-slave-1x1f krb5kdc[13876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183647, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T17:14:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:14:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.229.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
I20260923 17:14:07.318488 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:36183
--webserver_interface=127.11.229.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:45621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:36183
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:14:07.428839 13889 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:07.429159 13889 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:07.429251 13889 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:07.433343 13889 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:14:07.433422 13889 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260923 17:14:07.433454 13889 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:07.433514 13889 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:07.433553 13889 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:14:07.433591 13889 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:14:07.438879 13889 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:45621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:36183
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:36183
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.229.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13889
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:07.439944 13889 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:07.440963 13889 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:07.449695 13894 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:07.449703 13895 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:07.449712 13897 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:07.449762 13889 server_base.cc:1034] running on GCE node
I20260923 17:14:07.450570 13889 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:07.451719 13889 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:07.452913 13889 hybrid_clock.cc:648] HybridClock initialized: now 1790183647452890 us; error 36 us; skew 500 ppm
Sep 23 17:14:07 dist-test-slave-1x1f krb5kdc[13876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183647, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:07.455796 13889 init.cc:377] Logged in from keytab as kudu/127.11.229.190@KRBTEST.COM (short username kudu)
I20260923 17:14:07.457005 13889 webserver.cc:460] Webserver started at http://127.11.229.190:43225/ using document root <none> and password file <none>
I20260923 17:14:07.457558 13889 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:07.457645 13889 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:07.457865 13889 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:07.459950 13889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "4b796d25429e42c8a4f4e266c3a97faa"
format_stamp: "Formatted at 2026-09-23 17:14:07 on dist-test-slave-1x1f"
server_key: "e286d241c094b8f0f0779762627192ba"
server_key_iv: "9f98df4ef7cba0abacaaec31441b1003"
server_key_version: "encryptionkey@0"
I20260923 17:14:07.460507 13889 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "4b796d25429e42c8a4f4e266c3a97faa"
format_stamp: "Formatted at 2026-09-23 17:14:07 on dist-test-slave-1x1f"
server_key: "e286d241c094b8f0f0779762627192ba"
server_key_iv: "9f98df4ef7cba0abacaaec31441b1003"
server_key_version: "encryptionkey@0"
I20260923 17:14:07.464178 13889 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260923 17:14:07.466589 13904 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:07.467890 13889 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260923 17:14:07.468094 13889 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "4b796d25429e42c8a4f4e266c3a97faa"
format_stamp: "Formatted at 2026-09-23 17:14:07 on dist-test-slave-1x1f"
server_key: "e286d241c094b8f0f0779762627192ba"
server_key_iv: "9f98df4ef7cba0abacaaec31441b1003"
server_key_version: "encryptionkey@0"
I20260923 17:14:07.468216 13889 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:07.502856 13889 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:07.506906 13889 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:07.507160 13889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:07.515897 13889 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.190:36183
I20260923 17:14:07.515921 13966 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.190:36183 every 8 connection(s)
I20260923 17:14:07.516979 13889 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:14:07.519893 13967 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:07.524922 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 13889
I20260923 17:14:07.525040 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:14:07.525300 12182 external_mini_cluster.cc:1428] Setting key c8acf86beabe92dada5dbd48485bb890
I20260923 17:14:07.525410 13967 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b796d25429e42c8a4f4e266c3a97faa: Bootstrap starting.
I20260923 17:14:07.528441 13967 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4b796d25429e42c8a4f4e266c3a97faa: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:07.529412 13967 log.cc:824] T 00000000000000000000000000000000 P 4b796d25429e42c8a4f4e266c3a97faa: Log is configured to *not* fsync() on all Append() calls
I20260923 17:14:07.531838 13967 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b796d25429e42c8a4f4e266c3a97faa: No bootstrap required, opened a new log
Sep 23 17:14:07 dist-test-slave-1x1f krb5kdc[13876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183647, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:14:07.536912 13967 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4b796d25429e42c8a4f4e266c3a97faa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b796d25429e42c8a4f4e266c3a97faa" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 36183 } }
I20260923 17:14:07.537173 13967 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4b796d25429e42c8a4f4e266c3a97faa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:07.537231 13967 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4b796d25429e42c8a4f4e266c3a97faa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b796d25429e42c8a4f4e266c3a97faa, State: Initialized, Role: FOLLOWER
I20260923 17:14:07.537724 13967 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4b796d25429e42c8a4f4e266c3a97faa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b796d25429e42c8a4f4e266c3a97faa" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 36183 } }
I20260923 17:14:07.537904 13967 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4b796d25429e42c8a4f4e266c3a97faa [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:14:07.538007 13967 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4b796d25429e42c8a4f4e266c3a97faa [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:14:07.538111 13967 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4b796d25429e42c8a4f4e266c3a97faa [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:07.539144 13967 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4b796d25429e42c8a4f4e266c3a97faa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b796d25429e42c8a4f4e266c3a97faa" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 36183 } }
I20260923 17:14:07.539499 13967 leader_election.cc:302] T 00000000000000000000000000000000 P 4b796d25429e42c8a4f4e266c3a97faa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4b796d25429e42c8a4f4e266c3a97faa; no voters:
I20260923 17:14:07.539820 13967 leader_election.cc:288] T 00000000000000000000000000000000 P 4b796d25429e42c8a4f4e266c3a97faa [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 17:14:07.539920 13972 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4b796d25429e42c8a4f4e266c3a97faa [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:14:07.540143 13972 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4b796d25429e42c8a4f4e266c3a97faa [term 1 LEADER]: Becoming Leader. State: Replica: 4b796d25429e42c8a4f4e266c3a97faa, State: Running, Role: LEADER
I20260923 17:14:07.540447 13972 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4b796d25429e42c8a4f4e266c3a97faa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b796d25429e42c8a4f4e266c3a97faa" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 36183 } }
I20260923 17:14:07.541178 13967 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4b796d25429e42c8a4f4e266c3a97faa [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:14:07.541653 13973 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b796d25429e42c8a4f4e266c3a97faa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4b796d25429e42c8a4f4e266c3a97faa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b796d25429e42c8a4f4e266c3a97faa" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 36183 } } }
I20260923 17:14:07.541667 13974 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b796d25429e42c8a4f4e266c3a97faa [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4b796d25429e42c8a4f4e266c3a97faa. Latest consensus state: current_term: 1 leader_uuid: "4b796d25429e42c8a4f4e266c3a97faa" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b796d25429e42c8a4f4e266c3a97faa" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 36183 } } }
I20260923 17:14:07.541795 13973 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b796d25429e42c8a4f4e266c3a97faa [sys.catalog]: This master's current role is: LEADER
I20260923 17:14:07.541795 13974 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b796d25429e42c8a4f4e266c3a97faa [sys.catalog]: This master's current role is: LEADER
I20260923 17:14:07.543164 13970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:07.527059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47122 (local address 127.11.229.190:36183)
0923 17:14:07.527626 (+ 567us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:07.527650 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:07.527685 (+ 35us) server_negotiation.cc:407] Connection header received
0923 17:14:07.528722 (+ 1037us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:07.528744 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:07.529290 (+ 546us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:07.529743 (+ 453us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:07.530786 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:07.532272 (+ 1486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:07.533520 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:07.534299 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:07.534466 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:07.537168 (+ 2702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:07.537176 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:07.537196 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:07.537230 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:07.539323 (+ 2093us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:07.539756 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:07.539763 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:07.539768 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:07.539924 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:07.540243 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:07.540247 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:07.540248 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:07.540743 (+ 495us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:07.540945 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:07.541723 (+ 778us) server_negotiation.cc:299] Negotiation successful
0923 17:14:07.542075 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":193,"threads_started":1}
W20260923 17:14:07.546483 13987 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4b796d25429e42c8a4f4e266c3a97faa: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 17:14:07.546568 13987 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 17:14:07.546623 13977 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:14:07.547433 13977 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:14:07.553457 13977 catalog_manager.cc:1347] Generated new cluster ID: f49339e8bd8440069f82986a32aa74e3
I20260923 17:14:07.553562 13977 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:14:07.580005 13977 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:14:07.581000 13977 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:14:07.590462 13977 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4b796d25429e42c8a4f4e266c3a97faa: Generated new TSK 0
I20260923 17:14:07.591203 13977 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.229.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab.
Entry for principal kudu/127.11.229.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab.
I20260923 17:14:07.629765 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.129:0
--local_ip_for_outbound_sockets=127.11.229.129
--webserver_interface=127.11.229.129
--webserver_port=0
--tserver_master_addrs=127.11.229.190:36183
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab
--principal=kudu/127.11.229.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:45621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:14:07.749392 13993 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:07.749645 13993 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:07.749691 13993 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:07.753620 13993 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:07.753677 13993 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:07.753716 13993 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260923 17:14:07.753770 13993 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260923 17:14:07.753829 13993 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.129
I20260923 17:14:07.759056 13993 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:45621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab
--principal=kudu/127.11.229.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.229.129
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.229.190:36183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13993
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.129
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:07.760090 13993 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:07.761118 13993 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260923 17:14:07.771021 13993 server_base.cc:1034] running on GCE node
W20260923 17:14:07.770968 14001 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:07.770969 13999 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:07.770970 13998 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:07.771697 13993 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:07.772375 13993 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:07.773558 13993 hybrid_clock.cc:648] HybridClock initialized: now 1790183647773509 us; error 64 us; skew 500 ppm
Sep 23 17:14:07 dist-test-slave-1x1f krb5kdc[13876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183647, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:07.776512 13993 init.cc:377] Logged in from keytab as kudu/127.11.229.129@KRBTEST.COM (short username kudu)
I20260923 17:14:07.777391 13993 webserver.cc:460] Webserver started at http://127.11.229.129:35835/ using document root <none> and password file <none>
I20260923 17:14:07.777951 13993 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:07.778047 13993 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:07.778335 13993 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:07.780357 13993 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-0/data/instance:
uuid: "55f7637537d44ed5a7c2442532af0bcb"
format_stamp: "Formatted at 2026-09-23 17:14:07 on dist-test-slave-1x1f"
server_key: "eeb1121766a3960bdb7b95f753139c0d"
server_key_iv: "adbbbb1fb80a40d5e69bebc658c83457"
server_key_version: "encryptionkey@0"
I20260923 17:14:07.780916 13993 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance:
uuid: "55f7637537d44ed5a7c2442532af0bcb"
format_stamp: "Formatted at 2026-09-23 17:14:07 on dist-test-slave-1x1f"
server_key: "eeb1121766a3960bdb7b95f753139c0d"
server_key_iv: "adbbbb1fb80a40d5e69bebc658c83457"
server_key_version: "encryptionkey@0"
I20260923 17:14:07.784682 13993 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260923 17:14:07.787282 14008 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:07.788540 13993 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 17:14:07.788692 13993 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-0/wal
uuid: "55f7637537d44ed5a7c2442532af0bcb"
format_stamp: "Formatted at 2026-09-23 17:14:07 on dist-test-slave-1x1f"
server_key: "eeb1121766a3960bdb7b95f753139c0d"
server_key_iv: "adbbbb1fb80a40d5e69bebc658c83457"
server_key_version: "encryptionkey@0"
I20260923 17:14:07.788810 13993 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:07.811605 13993 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:07.814983 13993 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:07.815181 13993 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:07.816663 13993 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:14:07.816732 13993 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:07.816794 13993 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:14:07.816824 13993 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 23 17:14:07 dist-test-slave-1x1f krb5kdc[13876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183647, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.129@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:14:07.827870 13993 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.129:38477
I20260923 17:14:07.828184 14123 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.129:38477 every 8 connection(s)
I20260923 17:14:07.828941 13993 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
I20260923 17:14:07.830834 13970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:07.817631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:45025 (local address 127.11.229.190:36183)
0923 17:14:07.817754 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:07.817757 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:07.818854 (+ 1097us) server_negotiation.cc:407] Connection header received
0923 17:14:07.819939 (+ 1085us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:07.819943 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:07.820055 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:07.820107 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:07.821630 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:07.822559 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:07.823982 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:07.824266 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:07.824386 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:07.827053 (+ 2667us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:07.827057 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:07.827059 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:07.827083 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:07.828647 (+ 1564us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:07.829197 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:07.829200 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:07.829201 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:07.829275 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:07.829732 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:07.829737 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:07.829739 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:07.829953 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:07.830050 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:07.830615 (+ 565us) server_negotiation.cc:299] Negotiation successful
0923 17:14:07.830714 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260923 17:14:07.831610 14017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:07.818160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36183 (local address 127.11.229.129:45025)
0923 17:14:07.818697 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:07.818740 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:07.819648 (+ 908us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:07.820424 (+ 776us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:07.820431 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:07.820816 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:07.821413 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:07.821428 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:07.822690 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:07.822695 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:07.823865 (+ 1170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:07.823874 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:07.824440 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:07.824445 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:07.824613 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:07.825181 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:07.825196 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:07.826871 (+ 1675us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:07.828759 (+ 1888us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:07.828764 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:07.828778 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:07.829108 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:07.829406 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:07.829410 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:07.829413 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:07.829582 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:07.830068 (+ 486us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:07.830073 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:07.830391 (+ 318us) client_negotiation.cc:769] Sending connection context
0923 17:14:07.830567 (+ 176us) client_negotiation.cc:240] Negotiation successful
0923 17:14:07.830799 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":117,"threads_started":1}
I20260923 17:14:07.832856 14124 heartbeater.cc:347] Connected to a master server at 127.11.229.190:36183
I20260923 17:14:07.832988 14124 heartbeater.cc:464] Registering TS with master...
I20260923 17:14:07.833563 14124 heartbeater.cc:511] Master 127.11.229.190:36183 requested a full tablet report, sending...
I20260923 17:14:07.835055 13920 ts_manager.cc:194] Registered new tserver with Master: 55f7637537d44ed5a7c2442532af0bcb (127.11.229.129:38477)
I20260923 17:14:07.836211 13920 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.129@KRBTEST.COM'} at 127.11.229.129:45025
I20260923 17:14:07.837371 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 13993
I20260923 17:14:07.837491 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance
I20260923 17:14:07.837769 12182 external_mini_cluster.cc:1428] Setting key c49b383d4c89bc21f151bfdd7939b627
I20260923 17:14:07.844065 13970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:07.835220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:34457 (local address 127.11.229.190:36183)
0923 17:14:07.836421 (+ 1201us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:07.836425 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:07.836438 (+ 13us) server_negotiation.cc:407] Connection header received
0923 17:14:07.836471 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:07.836474 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:07.836510 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:07.836591 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:07.837031 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:07.837773 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:07.838888 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:07.839220 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:07.839347 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:07.840513 (+ 1166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:07.840517 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:07.840520 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:07.840544 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:07.842349 (+ 1805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:07.842859 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:07.842862 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:07.842863 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:07.842935 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:07.843279 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:07.843289 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:07.843291 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:07.843457 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:07.843539 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:07.843853 (+ 314us) server_negotiation.cc:299] Negotiation successful
0923 17:14:07.843947 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1133}
I20260923 17:14:07.844241 14130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:07.835090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36183 (local address 127.11.229.129:34457)
0923 17:14:07.835377 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:07.835392 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:07.835473 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:07.836631 (+ 1158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:07.836633 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:07.836814 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:07.836916 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:07.836921 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:07.837925 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:07.837928 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:07.838774 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:07.838783 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:07.839347 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:07.839351 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:07.839455 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:07.839982 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:07.839994 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:07.840374 (+ 380us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:07.842470 (+ 2096us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:07.842477 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:07.842482 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:07.842757 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:07.843036 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:07.843040 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:07.843044 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:07.843148 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:07.843560 (+ 412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:07.843564 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:07.843679 (+ 115us) client_negotiation.cc:769] Sending connection context
0923 17:14:07.843799 (+ 120us) client_negotiation.cc:240] Negotiation successful
0923 17:14:07.843963 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":108,"threads_started":1}
WARNING: no policy specified for kudu/127.11.229.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab.
Entry for principal kudu/127.11.229.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab.
I20260923 17:14:07.865844 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.130:0
--local_ip_for_outbound_sockets=127.11.229.130
--webserver_interface=127.11.229.130
--webserver_port=0
--tserver_master_addrs=127.11.229.190:36183
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab
--principal=kudu/127.11.229.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:45621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:14:07.976943 14133 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:07.977211 14133 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:07.977293 14133 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:07.981383 14133 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:07.981447 14133 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:07.981509 14133 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260923 17:14:07.981540 14133 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260923 17:14:07.981598 14133 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.130
I20260923 17:14:07.987030 14133 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:45621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab
--principal=kudu/127.11.229.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.229.130
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.229.190:36183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14133
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.130
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:07.988149 14133 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:07.989176 14133 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:07.998822 14139 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:07.998822 14138 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:07.998831 14141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:07.999291 14133 server_base.cc:1034] running on GCE node
I20260923 17:14:07.999706 14133 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:08.000309 14133 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:08.001478 14133 hybrid_clock.cc:648] HybridClock initialized: now 1790183648001440 us; error 52 us; skew 500 ppm
Sep 23 17:14:08 dist-test-slave-1x1f krb5kdc[13876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183648, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:08.004360 14133 init.cc:377] Logged in from keytab as kudu/127.11.229.130@KRBTEST.COM (short username kudu)
I20260923 17:14:08.005193 14133 webserver.cc:460] Webserver started at http://127.11.229.130:33629/ using document root <none> and password file <none>
I20260923 17:14:08.005722 14133 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:08.005803 14133 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:08.005971 14133 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:08.008551 14133 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-1/data/instance:
uuid: "1e259955db614825ac1dcd354f008989"
format_stamp: "Formatted at 2026-09-23 17:14:08 on dist-test-slave-1x1f"
server_key: "2ec08de970210ee1285176a6f07ab33a"
server_key_iv: "2b6a9c7d1406344d73a7c526beb3f41e"
server_key_version: "encryptionkey@0"
I20260923 17:14:08.009238 14133 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance:
uuid: "1e259955db614825ac1dcd354f008989"
format_stamp: "Formatted at 2026-09-23 17:14:08 on dist-test-slave-1x1f"
server_key: "2ec08de970210ee1285176a6f07ab33a"
server_key_iv: "2b6a9c7d1406344d73a7c526beb3f41e"
server_key_version: "encryptionkey@0"
I20260923 17:14:08.013365 14133 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260923 17:14:08.015856 14148 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:08.017237 14133 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260923 17:14:08.017377 14133 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-1/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-1/wal
uuid: "1e259955db614825ac1dcd354f008989"
format_stamp: "Formatted at 2026-09-23 17:14:08 on dist-test-slave-1x1f"
server_key: "2ec08de970210ee1285176a6f07ab33a"
server_key_iv: "2b6a9c7d1406344d73a7c526beb3f41e"
server_key_version: "encryptionkey@0"
I20260923 17:14:08.017488 14133 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:08.035852 14133 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:08.039222 14133 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:08.039422 14133 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:08.040807 14133 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:14:08.040879 14133 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:08.040952 14133 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:14:08.041011 14133 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 23 17:14:08 dist-test-slave-1x1f krb5kdc[13876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183648, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.130@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:14:08.051456 14133 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.130:39275
I20260923 17:14:08.051559 14263 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.130:39275 every 8 connection(s)
I20260923 17:14:08.052366 14133 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
I20260923 17:14:08.056489 13970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:08.041744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:49991 (local address 127.11.229.190:36183)
0923 17:14:08.041876 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:08.041883 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:08.043327 (+ 1444us) server_negotiation.cc:407] Connection header received
0923 17:14:08.044784 (+ 1457us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:08.044788 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:08.044843 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:08.044935 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:08.046694 (+ 1759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.047530 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.048806 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.049051 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.049164 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:08.052296 (+ 3132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:08.052300 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:08.052303 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:08.052340 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:08.054038 (+ 1698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:08.054657 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:08.054659 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:08.054661 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:08.054739 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:08.055338 (+ 599us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:08.055342 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:08.055343 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:08.055552 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:08.055644 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:08.056263 (+ 619us) server_negotiation.cc:299] Negotiation successful
0923 17:14:08.056364 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260923 17:14:08.057303 14157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:08.042668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36183 (local address 127.11.229.130:49991)
0923 17:14:08.043188 (+ 520us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:08.043227 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:08.044536 (+ 1309us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:08.045172 (+ 636us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:08.045184 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:08.045713 (+ 529us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:08.046516 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:08.046542 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.047666 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.047669 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:08.048686 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:08.048695 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.049203 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.049207 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:08.049374 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:08.050007 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:08.050030 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:08.051938 (+ 1908us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:08.054173 (+ 2235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:08.054178 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:08.054189 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:08.054540 (+ 351us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:08.054855 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:08.054857 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:08.054859 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:08.055074 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:08.055675 (+ 601us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:08.055679 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:08.055906 (+ 227us) client_negotiation.cc:769] Sending connection context
0923 17:14:08.056151 (+ 245us) client_negotiation.cc:240] Negotiation successful
0923 17:14:08.056404 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":122,"threads_started":1}
I20260923 17:14:08.058694 14264 heartbeater.cc:347] Connected to a master server at 127.11.229.190:36183
I20260923 17:14:08.058876 14264 heartbeater.cc:464] Registering TS with master...
I20260923 17:14:08.059399 14264 heartbeater.cc:511] Master 127.11.229.190:36183 requested a full tablet report, sending...
I20260923 17:14:08.060564 13921 ts_manager.cc:194] Registered new tserver with Master: 1e259955db614825ac1dcd354f008989 (127.11.229.130:39275)
I20260923 17:14:08.061409 13921 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.130@KRBTEST.COM'} at 127.11.229.130:49991
I20260923 17:14:08.062441 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 14133
I20260923 17:14:08.062541 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance
I20260923 17:14:08.062856 12182 external_mini_cluster.cc:1428] Setting key 04eaa7c35a0b24cb027b5c8cda509910
I20260923 17:14:08.068794 14270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:08.060803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36183 (local address 127.11.229.130:45537)
0923 17:14:08.061076 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:08.061091 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:08.061188 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:08.061405 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:08.061407 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:08.061615 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:08.061751 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:08.061757 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.062702 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.062706 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:08.063498 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:08.063507 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.063962 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.063966 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:08.064055 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:08.064522 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:08.064537 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:08.064998 (+ 461us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:08.067110 (+ 2112us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:08.067113 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:08.067114 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:08.067307 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:08.067638 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:08.067643 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:08.067645 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:08.067735 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:08.068277 (+ 542us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:08.068280 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:08.068429 (+ 149us) client_negotiation.cc:769] Sending connection context
0923 17:14:08.068539 (+ 110us) client_negotiation.cc:240] Negotiation successful
0923 17:14:08.068651 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":83,"threads_started":1}
I20260923 17:14:08.068929 13970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:08.060861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:45537 (local address 127.11.229.190:36183)
0923 17:14:08.060977 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:08.060983 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:08.061147 (+ 164us) server_negotiation.cc:407] Connection header received
0923 17:14:08.061266 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:08.061268 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:08.061302 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:08.061364 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:08.061842 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.062552 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.063631 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.063853 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.063959 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:08.065139 (+ 1180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:08.065142 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:08.065144 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:08.065163 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:08.066903 (+ 1740us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:08.067409 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:08.067415 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:08.067420 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:08.067510 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:08.067834 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:08.067840 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:08.067845 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:08.068153 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:08.068262 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:08.068640 (+ 378us) server_negotiation.cc:299] Negotiation successful
0923 17:14:08.068758 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
WARNING: no policy specified for kudu/127.11.229.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab.
Entry for principal kudu/127.11.229.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab.
I20260923 17:14:08.091310 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.131:0
--local_ip_for_outbound_sockets=127.11.229.131
--webserver_interface=127.11.229.131
--webserver_port=0
--tserver_master_addrs=127.11.229.190:36183
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab
--principal=kudu/127.11.229.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:45621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:14:08.202848 14273 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:08.203131 14273 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:08.203188 14273 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:08.207335 14273 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:08.207394 14273 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:08.207434 14273 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260923 17:14:08.207448 14273 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260923 17:14:08.207533 14273 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.131
I20260923 17:14:08.212874 14273 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:45621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab
--principal=kudu/127.11.229.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.229.131
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.229.190:36183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14273
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.131
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:08.213927 14273 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:08.215015 14273 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:08.225226 14278 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:08.225262 14279 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:08.225275 14273 server_base.cc:1034] running on GCE node
W20260923 17:14:08.225221 14281 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:08.225858 14273 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:08.226583 14273 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:08.227772 14273 hybrid_clock.cc:648] HybridClock initialized: now 1790183648227749 us; error 37 us; skew 500 ppm
Sep 23 17:14:08 dist-test-slave-1x1f krb5kdc[13876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183648, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:08.230558 14273 init.cc:377] Logged in from keytab as kudu/127.11.229.131@KRBTEST.COM (short username kudu)
I20260923 17:14:08.231439 14273 webserver.cc:460] Webserver started at http://127.11.229.131:38943/ using document root <none> and password file <none>
I20260923 17:14:08.231992 14273 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:08.232079 14273 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:08.232314 14273 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:08.234491 14273 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-2/data/instance:
uuid: "85fe4a5ab7914a8abeabe059271d6ad3"
format_stamp: "Formatted at 2026-09-23 17:14:08 on dist-test-slave-1x1f"
server_key: "5eb57ab7e372c1a148eaa5858a615a2f"
server_key_iv: "9b4b142c2afa08b0a5a55649f7682169"
server_key_version: "encryptionkey@0"
I20260923 17:14:08.235037 14273 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance:
uuid: "85fe4a5ab7914a8abeabe059271d6ad3"
format_stamp: "Formatted at 2026-09-23 17:14:08 on dist-test-slave-1x1f"
server_key: "5eb57ab7e372c1a148eaa5858a615a2f"
server_key_iv: "9b4b142c2afa08b0a5a55649f7682169"
server_key_version: "encryptionkey@0"
I20260923 17:14:08.238790 14273 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260923 17:14:08.241192 14288 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:08.242632 14273 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 17:14:08.242754 14273 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-2/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-2/wal
uuid: "85fe4a5ab7914a8abeabe059271d6ad3"
format_stamp: "Formatted at 2026-09-23 17:14:08 on dist-test-slave-1x1f"
server_key: "5eb57ab7e372c1a148eaa5858a615a2f"
server_key_iv: "9b4b142c2afa08b0a5a55649f7682169"
server_key_version: "encryptionkey@0"
I20260923 17:14:08.242859 14273 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:08.254077 14273 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:08.256886 14273 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:08.257081 14273 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:08.258653 14273 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:14:08.258723 14273 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:08.258790 14273 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:14:08.258837 14273 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 23 17:14:08 dist-test-slave-1x1f krb5kdc[13876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183648, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.131@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:14:08.269996 14273 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.131:39649
I20260923 17:14:08.270165 14403 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.131:39649 every 8 connection(s)
I20260923 17:14:08.270993 14273 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
I20260923 17:14:08.272773 13970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:08.259654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:56413 (local address 127.11.229.190:36183)
0923 17:14:08.259809 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:08.259815 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:08.260784 (+ 969us) server_negotiation.cc:407] Connection header received
0923 17:14:08.261935 (+ 1151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:08.261938 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:08.261996 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:08.262068 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:08.263371 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.264026 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.265185 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.265422 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.265569 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:08.268727 (+ 3158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:08.268731 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:08.268734 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:08.268771 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:08.270476 (+ 1705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:08.271090 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:08.271093 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:08.271095 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:08.271172 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:08.271630 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:08.271633 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:08.271635 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:08.271900 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:08.272011 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:08.272439 (+ 428us) server_negotiation.cc:299] Negotiation successful
0923 17:14:08.272551 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260923 17:14:08.273591 14297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:08.260129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36183 (local address 127.11.229.131:56413)
0923 17:14:08.260623 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:08.260665 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:08.261709 (+ 1044us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:08.262345 (+ 636us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:08.262353 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:08.262694 (+ 341us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:08.263229 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:08.263244 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.264148 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.264152 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:08.265055 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:08.265064 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.265631 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.265635 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:08.265866 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:08.266594 (+ 728us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:08.266627 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:08.268539 (+ 1912us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:08.270617 (+ 2078us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:08.270626 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:08.270644 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:08.270920 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:08.271272 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:08.271275 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:08.271277 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:08.271470 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:08.271993 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:08.271997 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:08.272225 (+ 228us) client_negotiation.cc:769] Sending connection context
0923 17:14:08.272386 (+ 161us) client_negotiation.cc:240] Negotiation successful
0923 17:14:08.272667 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":299,"thread_start_us":122,"threads_started":1}
I20260923 17:14:08.274930 14404 heartbeater.cc:347] Connected to a master server at 127.11.229.190:36183
I20260923 17:14:08.275094 14404 heartbeater.cc:464] Registering TS with master...
I20260923 17:14:08.275588 14404 heartbeater.cc:511] Master 127.11.229.190:36183 requested a full tablet report, sending...
I20260923 17:14:08.276618 13920 ts_manager.cc:194] Registered new tserver with Master: 85fe4a5ab7914a8abeabe059271d6ad3 (127.11.229.131:39649)
I20260923 17:14:08.277204 13920 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.131@KRBTEST.COM'} at 127.11.229.131:56413
I20260923 17:14:08.277817 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 14273
I20260923 17:14:08.277936 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance
I20260923 17:14:08.278293 12182 external_mini_cluster.cc:1428] Setting key 749f509dc958eb8b62c08fafa04b7005
I20260923 17:14:08.280321 12182 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 17:14:08.285642 14410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:08.277271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36183 (local address 127.11.229.131:38079)
0923 17:14:08.277563 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:08.277580 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:08.277685 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:08.278023 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:08.278026 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:08.278267 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:08.278401 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:08.278409 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.279434 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.279437 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:08.280277 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:08.280286 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.280832 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.280835 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:08.280912 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:08.281471 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:08.281487 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:08.281830 (+ 343us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:08.284120 (+ 2290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:08.284123 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:08.284125 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:08.284343 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:08.284650 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:08.284652 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:08.284654 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:08.284734 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:08.285211 (+ 477us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:08.285213 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:08.285290 (+ 77us) client_negotiation.cc:769] Sending connection context
0923 17:14:08.285373 (+ 83us) client_negotiation.cc:240] Negotiation successful
0923 17:14:08.285482 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":86,"threads_started":1}
I20260923 17:14:08.285777 13970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:08.277310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:38079 (local address 127.11.229.190:36183)
0923 17:14:08.277560 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:08.277564 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:08.277659 (+ 95us) server_negotiation.cc:407] Connection header received
0923 17:14:08.277782 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:08.277785 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:08.277831 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:08.277912 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:08.278517 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.279282 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.280406 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.280707 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.280820 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:08.282039 (+ 1219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:08.282046 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:08.282052 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:08.282085 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:08.283991 (+ 1906us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:08.284447 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:08.284453 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:08.284458 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:08.284551 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:08.284831 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:08.284838 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:08.284842 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:08.285102 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:08.285221 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:08.285465 (+ 244us) server_negotiation.cc:299] Negotiation successful
0923 17:14:08.285592 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172}
Sep 23 17:14:08 dist-test-slave-1x1f krb5kdc[13876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183648, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 23 17:14:08 dist-test-slave-1x1f krb5kdc[13876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183648, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:14:08.309356 13970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:08.300157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47124 (local address 127.11.229.190:36183)
0923 17:14:08.300321 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:08.300324 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:08.300338 (+ 14us) server_negotiation.cc:407] Connection header received
0923 17:14:08.300379 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:08.300382 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:08.300420 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:08.300495 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:08.301248 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.301792 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.302749 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.302970 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.303059 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:08.305765 (+ 2706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:08.305769 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:08.305771 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:08.305797 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:08.307418 (+ 1621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:08.307904 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:08.307909 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:08.307911 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:08.308000 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:08.308319 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:08.308324 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:08.308326 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:08.308523 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:08.308674 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:08.308939 (+ 265us) server_negotiation.cc:299] Negotiation successful
0923 17:14:08.309176 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260923 17:14:08.312662 13920 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47124:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 17:14:08.316016 13920 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 17:14:08.331544 14422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:08.325403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37226 (local address 127.11.229.131:39649)
0923 17:14:08.326310 (+ 907us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:08.326321 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:08.326347 (+ 26us) server_negotiation.cc:407] Connection header received
0923 17:14:08.326789 (+ 442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:08.326820 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:08.327047 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:08.327201 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:14:08.327781 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.328506 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.330084 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.330791 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.330942 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:08.331097 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:08.331282 (+ 185us) server_negotiation.cc:299] Negotiation successful
0923 17:14:08.331378 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":764,"thread_start_us":110,"threads_started":1}
I20260923 17:14:08.331537 14425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:08.325301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.131:39649 (local address 127.0.0.1:37226)
0923 17:14:08.326110 (+ 809us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:08.326165 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:08.326317 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:08.327337 (+ 1020us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:08.327340 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:08.327369 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:14:08.327623 (+ 254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:08.327630 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.328625 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.328632 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:08.329946 (+ 1314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:08.329956 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.330935 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.330939 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:08.331060 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:08.331098 (+ 38us) client_negotiation.cc:769] Sending connection context
0923 17:14:08.331247 (+ 149us) client_negotiation.cc:240] Negotiation successful
0923 17:14:08.331378 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":630,"mutex_wait_us":133,"spinlock_wait_cycles":3456,"thread_start_us":77,"threads_started":1}
I20260923 17:14:08.332019 14421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:08.325304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.130:39275 (local address 127.0.0.1:44252)
0923 17:14:08.326590 (+ 1286us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:08.326603 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:08.326750 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:08.327337 (+ 587us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:08.327340 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:08.327371 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:14:08.327625 (+ 254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:08.327630 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.328954 (+ 1324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.328958 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:08.330295 (+ 1337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:08.330304 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.331531 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.331535 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:08.331691 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:08.331726 (+ 35us) client_negotiation.cc:769] Sending connection context
0923 17:14:08.331801 (+ 75us) client_negotiation.cc:240] Negotiation successful
0923 17:14:08.331866 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1223,"mutex_wait_us":610,"spinlock_wait_cycles":10112,"thread_start_us":87,"threads_started":1}
I20260923 17:14:08.332091 14424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:08.325575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44252 (local address 127.11.229.130:39275)
0923 17:14:08.325980 (+ 405us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:08.325993 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:08.326677 (+ 684us) server_negotiation.cc:407] Connection header received
0923 17:14:08.326893 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:08.326898 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:08.327051 (+ 153us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:08.327200 (+ 149us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:14:08.327755 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.328838 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.330458 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.331231 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.331355 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:08.331464 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:08.331842 (+ 378us) server_negotiation.cc:299] Negotiation successful
0923 17:14:08.331957 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":306,"thread_start_us":102,"threads_started":1}
I20260923 17:14:08.332616 14423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:08.325548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:38477 (local address 127.0.0.1:44288)
0923 17:14:08.326499 (+ 951us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:08.326514 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:08.326623 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:08.327149 (+ 526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:08.327155 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:08.327177 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:14:08.327330 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:08.327337 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.328808 (+ 1471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.328811 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:08.330171 (+ 1360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:08.330186 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.331531 (+ 1345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.331535 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:08.332021 (+ 486us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:08.332054 (+ 33us) client_negotiation.cc:769] Sending connection context
0923 17:14:08.332389 (+ 335us) client_negotiation.cc:240] Negotiation successful
0923 17:14:08.332491 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":880,"mutex_wait_us":432,"thread_start_us":100,"threads_started":1}
I20260923 17:14:08.332633 14426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:08.326134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44288 (local address 127.11.229.129:38477)
0923 17:14:08.326521 (+ 387us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:08.326537 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:08.326610 (+ 73us) server_negotiation.cc:407] Connection header received
0923 17:14:08.326763 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:08.326771 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:08.326998 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:08.327163 (+ 165us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:14:08.327448 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.328675 (+ 1227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.330346 (+ 1671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.331173 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.331335 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:08.331472 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:08.332420 (+ 948us) server_negotiation.cc:299] Negotiation successful
0923 17:14:08.332516 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":297,"thread_start_us":102,"threads_started":1}
I20260923 17:14:08.335042 14338 tablet_service.cc:1467] Processing CreateTablet for tablet 7bb3c70e21654487a067cf544b10d57d (DEFAULT_TABLE table=test-table [id=984f6e2fcfec487686474c395a26a76f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:14:08.335244 14198 tablet_service.cc:1467] Processing CreateTablet for tablet 7bb3c70e21654487a067cf544b10d57d (DEFAULT_TABLE table=test-table [id=984f6e2fcfec487686474c395a26a76f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:14:08.335450 14058 tablet_service.cc:1467] Processing CreateTablet for tablet 7bb3c70e21654487a067cf544b10d57d (DEFAULT_TABLE table=test-table [id=984f6e2fcfec487686474c395a26a76f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:14:08.336249 14338 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7bb3c70e21654487a067cf544b10d57d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:08.336289 14058 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7bb3c70e21654487a067cf544b10d57d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:08.336269 14198 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7bb3c70e21654487a067cf544b10d57d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:08.344642 14427 tablet_bootstrap.cc:492] T 7bb3c70e21654487a067cf544b10d57d P 1e259955db614825ac1dcd354f008989: Bootstrap starting.
I20260923 17:14:08.346143 14429 tablet_bootstrap.cc:492] T 7bb3c70e21654487a067cf544b10d57d P 85fe4a5ab7914a8abeabe059271d6ad3: Bootstrap starting.
I20260923 17:14:08.346652 14427 tablet_bootstrap.cc:654] T 7bb3c70e21654487a067cf544b10d57d P 1e259955db614825ac1dcd354f008989: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:08.347522 14427 log.cc:824] T 7bb3c70e21654487a067cf544b10d57d P 1e259955db614825ac1dcd354f008989: Log is configured to *not* fsync() on all Append() calls
I20260923 17:14:08.348188 14429 tablet_bootstrap.cc:654] T 7bb3c70e21654487a067cf544b10d57d P 85fe4a5ab7914a8abeabe059271d6ad3: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:08.348852 14429 log.cc:824] T 7bb3c70e21654487a067cf544b10d57d P 85fe4a5ab7914a8abeabe059271d6ad3: Log is configured to *not* fsync() on all Append() calls
I20260923 17:14:08.349555 14428 tablet_bootstrap.cc:492] T 7bb3c70e21654487a067cf544b10d57d P 55f7637537d44ed5a7c2442532af0bcb: Bootstrap starting.
I20260923 17:14:08.349632 14427 tablet_bootstrap.cc:492] T 7bb3c70e21654487a067cf544b10d57d P 1e259955db614825ac1dcd354f008989: No bootstrap required, opened a new log
I20260923 17:14:08.350102 14427 ts_tablet_manager.cc:1397] T 7bb3c70e21654487a067cf544b10d57d P 1e259955db614825ac1dcd354f008989: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260923 17:14:08.351354 14428 tablet_bootstrap.cc:654] T 7bb3c70e21654487a067cf544b10d57d P 55f7637537d44ed5a7c2442532af0bcb: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:08.352349 14428 log.cc:824] T 7bb3c70e21654487a067cf544b10d57d P 55f7637537d44ed5a7c2442532af0bcb: Log is configured to *not* fsync() on all Append() calls
I20260923 17:14:08.353294 14427 raft_consensus.cc:348] T 7bb3c70e21654487a067cf544b10d57d P 1e259955db614825ac1dcd354f008989 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } }
I20260923 17:14:08.353574 14427 raft_consensus.cc:374] T 7bb3c70e21654487a067cf544b10d57d P 1e259955db614825ac1dcd354f008989 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:08.353631 14427 raft_consensus.cc:729] T 7bb3c70e21654487a067cf544b10d57d P 1e259955db614825ac1dcd354f008989 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e259955db614825ac1dcd354f008989, State: Initialized, Role: FOLLOWER
I20260923 17:14:08.354096 14429 tablet_bootstrap.cc:492] T 7bb3c70e21654487a067cf544b10d57d P 85fe4a5ab7914a8abeabe059271d6ad3: No bootstrap required, opened a new log
I20260923 17:14:08.354130 14427 consensus_queue.cc:260] T 7bb3c70e21654487a067cf544b10d57d P 1e259955db614825ac1dcd354f008989 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } }
I20260923 17:14:08.354322 14428 tablet_bootstrap.cc:492] T 7bb3c70e21654487a067cf544b10d57d P 55f7637537d44ed5a7c2442532af0bcb: No bootstrap required, opened a new log
I20260923 17:14:08.354512 14429 ts_tablet_manager.cc:1397] T 7bb3c70e21654487a067cf544b10d57d P 85fe4a5ab7914a8abeabe059271d6ad3: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.005s
I20260923 17:14:08.354528 14428 ts_tablet_manager.cc:1397] T 7bb3c70e21654487a067cf544b10d57d P 55f7637537d44ed5a7c2442532af0bcb: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260923 17:14:08.355178 14427 ts_tablet_manager.cc:1428] T 7bb3c70e21654487a067cf544b10d57d P 1e259955db614825ac1dcd354f008989: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260923 17:14:08.355568 14264 heartbeater.cc:503] Master 127.11.229.190:36183 was elected leader, sending a full tablet report...
I20260923 17:14:08.358301 14428 raft_consensus.cc:348] T 7bb3c70e21654487a067cf544b10d57d P 55f7637537d44ed5a7c2442532af0bcb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } }
I20260923 17:14:08.358301 14429 raft_consensus.cc:348] T 7bb3c70e21654487a067cf544b10d57d P 85fe4a5ab7914a8abeabe059271d6ad3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } }
I20260923 17:14:08.358544 14428 raft_consensus.cc:374] T 7bb3c70e21654487a067cf544b10d57d P 55f7637537d44ed5a7c2442532af0bcb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:08.358584 14429 raft_consensus.cc:374] T 7bb3c70e21654487a067cf544b10d57d P 85fe4a5ab7914a8abeabe059271d6ad3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:08.358592 14428 raft_consensus.cc:729] T 7bb3c70e21654487a067cf544b10d57d P 55f7637537d44ed5a7c2442532af0bcb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55f7637537d44ed5a7c2442532af0bcb, State: Initialized, Role: FOLLOWER
I20260923 17:14:08.358647 14429 raft_consensus.cc:729] T 7bb3c70e21654487a067cf544b10d57d P 85fe4a5ab7914a8abeabe059271d6ad3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fe4a5ab7914a8abeabe059271d6ad3, State: Initialized, Role: FOLLOWER
I20260923 17:14:08.359066 14428 consensus_queue.cc:260] T 7bb3c70e21654487a067cf544b10d57d P 55f7637537d44ed5a7c2442532af0bcb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } }
I20260923 17:14:08.359084 14429 consensus_queue.cc:260] T 7bb3c70e21654487a067cf544b10d57d P 85fe4a5ab7914a8abeabe059271d6ad3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } }
I20260923 17:14:08.359680 14124 heartbeater.cc:503] Master 127.11.229.190:36183 was elected leader, sending a full tablet report...
I20260923 17:14:08.360049 14428 ts_tablet_manager.cc:1428] T 7bb3c70e21654487a067cf544b10d57d P 55f7637537d44ed5a7c2442532af0bcb: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260923 17:14:08.360114 14429 ts_tablet_manager.cc:1428] T 7bb3c70e21654487a067cf544b10d57d P 85fe4a5ab7914a8abeabe059271d6ad3: Time spent starting tablet: real 0.006s user 0.003s sys 0.002s
I20260923 17:14:08.360435 14404 heartbeater.cc:503] Master 127.11.229.190:36183 was elected leader, sending a full tablet report...
I20260923 17:14:08.385488 14435 raft_consensus.cc:482] T 7bb3c70e21654487a067cf544b10d57d P 85fe4a5ab7914a8abeabe059271d6ad3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 17:14:08.385756 14435 raft_consensus.cc:504] T 7bb3c70e21654487a067cf544b10d57d P 85fe4a5ab7914a8abeabe059271d6ad3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } }
I20260923 17:14:08.387099 14435 leader_election.cc:288] T 7bb3c70e21654487a067cf544b10d57d P 85fe4a5ab7914a8abeabe059271d6ad3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e259955db614825ac1dcd354f008989 (127.11.229.130:39275), 55f7637537d44ed5a7c2442532af0bcb (127.11.229.129:38477)
I20260923 17:14:08.391882 14297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:08.387475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:38477 (local address 127.11.229.131:33751)
0923 17:14:08.387717 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:08.387733 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:08.387866 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:08.388332 (+ 466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:08.388339 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:08.388357 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:14:08.388466 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:08.388471 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.389514 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.389518 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:08.390473 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:08.390483 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.391351 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.391354 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:08.391493 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:08.391520 (+ 27us) client_negotiation.cc:769] Sending connection context
0923 17:14:08.391623 (+ 103us) client_negotiation.cc:240] Negotiation successful
0923 17:14:08.391698 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150}
I20260923 17:14:08.392006 14426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:08.387617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:33751 (local address 127.11.229.129:38477)
0923 17:14:08.387756 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:08.387782 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:08.387801 (+ 19us) server_negotiation.cc:407] Connection header received
0923 17:14:08.388017 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:08.388025 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:08.388138 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:08.388229 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:14:08.388631 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.389400 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.390606 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.391222 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.391352 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:08.391429 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:08.391681 (+ 252us) server_negotiation.cc:299] Negotiation successful
0923 17:14:08.391802 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260923 17:14:08.392688 14424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:08.387630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:33857 (local address 127.11.229.130:39275)
0923 17:14:08.387791 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:08.387796 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:08.388084 (+ 288us) server_negotiation.cc:407] Connection header received
0923 17:14:08.388423 (+ 339us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:08.388427 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:08.388488 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:08.388587 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:14:08.388885 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.389563 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.391464 (+ 1901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.392102 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.392211 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:08.392261 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:08.392503 (+ 242us) server_negotiation.cc:299] Negotiation successful
0923 17:14:08.392577 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260923 17:14:08.392728 14064 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bb3c70e21654487a067cf544b10d57d" candidate_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55f7637537d44ed5a7c2442532af0bcb" is_pre_election: true
I20260923 17:14:08.393040 14436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:08.387475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.130:39275 (local address 127.11.229.131:33857)
0923 17:14:08.387980 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:08.387994 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:08.388159 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:08.388600 (+ 441us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:08.388603 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:08.388620 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:14:08.388758 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:08.388763 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.389699 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.389702 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:08.391336 (+ 1634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:08.391346 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.392227 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.392231 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:08.392339 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:08.392355 (+ 16us) client_negotiation.cc:769] Sending connection context
0923 17:14:08.392832 (+ 477us) client_negotiation.cc:240] Negotiation successful
0923 17:14:08.392910 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":418,"mutex_wait_us":45,"thread_start_us":166,"threads_started":1}
I20260923 17:14:08.393081 14064 raft_consensus.cc:2454] T 7bb3c70e21654487a067cf544b10d57d P 55f7637537d44ed5a7c2442532af0bcb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fe4a5ab7914a8abeabe059271d6ad3 in term 0.
I20260923 17:14:08.393635 14292 leader_election.cc:302] T 7bb3c70e21654487a067cf544b10d57d P 85fe4a5ab7914a8abeabe059271d6ad3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55f7637537d44ed5a7c2442532af0bcb, 85fe4a5ab7914a8abeabe059271d6ad3; no voters:
I20260923 17:14:08.393682 14218 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bb3c70e21654487a067cf544b10d57d" candidate_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e259955db614825ac1dcd354f008989" is_pre_election: true
I20260923 17:14:08.393962 14435 raft_consensus.cc:2781] T 7bb3c70e21654487a067cf544b10d57d P 85fe4a5ab7914a8abeabe059271d6ad3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 17:14:08.393985 14218 raft_consensus.cc:2454] T 7bb3c70e21654487a067cf544b10d57d P 1e259955db614825ac1dcd354f008989 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fe4a5ab7914a8abeabe059271d6ad3 in term 0.
I20260923 17:14:08.394089 14435 raft_consensus.cc:482] T 7bb3c70e21654487a067cf544b10d57d P 85fe4a5ab7914a8abeabe059271d6ad3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 17:14:08.394147 14435 raft_consensus.cc:3037] T 7bb3c70e21654487a067cf544b10d57d P 85fe4a5ab7914a8abeabe059271d6ad3 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:08.395354 14435 raft_consensus.cc:504] T 7bb3c70e21654487a067cf544b10d57d P 85fe4a5ab7914a8abeabe059271d6ad3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } }
I20260923 17:14:08.395743 14435 leader_election.cc:288] T 7bb3c70e21654487a067cf544b10d57d P 85fe4a5ab7914a8abeabe059271d6ad3 [CANDIDATE]: Term 1 election: Requested vote from peers 1e259955db614825ac1dcd354f008989 (127.11.229.130:39275), 55f7637537d44ed5a7c2442532af0bcb (127.11.229.129:38477)
I20260923 17:14:08.396095 14218 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bb3c70e21654487a067cf544b10d57d" candidate_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e259955db614825ac1dcd354f008989"
I20260923 17:14:08.396153 14064 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7bb3c70e21654487a067cf544b10d57d" candidate_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55f7637537d44ed5a7c2442532af0bcb"
I20260923 17:14:08.396231 14218 raft_consensus.cc:3037] T 7bb3c70e21654487a067cf544b10d57d P 1e259955db614825ac1dcd354f008989 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:08.396306 14064 raft_consensus.cc:3037] T 7bb3c70e21654487a067cf544b10d57d P 55f7637537d44ed5a7c2442532af0bcb [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:08.397310 14218 raft_consensus.cc:2454] T 7bb3c70e21654487a067cf544b10d57d P 1e259955db614825ac1dcd354f008989 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fe4a5ab7914a8abeabe059271d6ad3 in term 1.
I20260923 17:14:08.397495 14064 raft_consensus.cc:2454] T 7bb3c70e21654487a067cf544b10d57d P 55f7637537d44ed5a7c2442532af0bcb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fe4a5ab7914a8abeabe059271d6ad3 in term 1.
I20260923 17:14:08.397682 14290 leader_election.cc:302] T 7bb3c70e21654487a067cf544b10d57d P 85fe4a5ab7914a8abeabe059271d6ad3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e259955db614825ac1dcd354f008989, 85fe4a5ab7914a8abeabe059271d6ad3; no voters:
I20260923 17:14:08.397928 14435 raft_consensus.cc:2781] T 7bb3c70e21654487a067cf544b10d57d P 85fe4a5ab7914a8abeabe059271d6ad3 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:14:08.398192 14435 raft_consensus.cc:686] T 7bb3c70e21654487a067cf544b10d57d P 85fe4a5ab7914a8abeabe059271d6ad3 [term 1 LEADER]: Becoming Leader. State: Replica: 85fe4a5ab7914a8abeabe059271d6ad3, State: Running, Role: LEADER
I20260923 17:14:08.398612 14435 consensus_queue.cc:237] T 7bb3c70e21654487a067cf544b10d57d P 85fe4a5ab7914a8abeabe059271d6ad3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } }
I20260923 17:14:08.402071 13920 catalog_manager.cc:5495] T 7bb3c70e21654487a067cf544b10d57d P 85fe4a5ab7914a8abeabe059271d6ad3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85fe4a5ab7914a8abeabe059271d6ad3 (127.11.229.131). New cstate: current_term: 1 leader_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } health_report { overall_health: UNKNOWN } } }
Sep 23 17:14:08 dist-test-slave-1x1f krb5kdc[13876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183647, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:14:08.432996 14444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:08.424083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36183 (local address 127.0.0.1:47128)
0923 17:14:08.424404 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:08.424421 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:08.424530 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:08.424812 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:08.424814 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:08.425207 (+ 393us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:08.425305 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:08.425311 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.426139 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.426142 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:08.426763 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:08.426771 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.427251 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.427255 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:08.427328 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:08.427953 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:08.427965 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:08.429437 (+ 1472us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:08.431317 (+ 1880us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:08.431325 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:08.431330 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:08.431570 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:08.431850 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:08.431853 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:08.431854 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:08.431931 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:08.432494 (+ 563us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:08.432501 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:08.432612 (+ 111us) client_negotiation.cc:769] Sending connection context
0923 17:14:08.432719 (+ 107us) client_negotiation.cc:240] Negotiation successful
0923 17:14:08.432846 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":144,"threads_started":1}
I20260923 17:14:08.433032 13970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:08.424142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47128 (local address 127.11.229.190:36183)
0923 17:14:08.424290 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:08.424294 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:08.424506 (+ 212us) server_negotiation.cc:407] Connection header received
0923 17:14:08.424642 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:08.424645 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:08.424688 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:08.424775 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:08.425430 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.426018 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.426870 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.427127 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.427215 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:08.429581 (+ 2366us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:08.429585 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:08.429587 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:08.429608 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:08.431198 (+ 1590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:08.431677 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:08.431680 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:08.431681 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:08.431759 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:08.432110 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:08.432114 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:08.432115 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:08.432328 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:08.432478 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:08.432807 (+ 329us) server_negotiation.cc:299] Negotiation successful
0923 17:14:08.432922 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260923 17:14:08.437320 13920 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:47128:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260923 17:14:08.438017 13920 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 17:14:08.444725 14058 tablet_service.cc:1467] Processing CreateTablet for tablet cb546c4be538424cb3fb150f202d8d86 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=59ec8c28904f49489cb6d9040f831ba2]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260923 17:14:08.444728 14338 tablet_service.cc:1467] Processing CreateTablet for tablet cb546c4be538424cb3fb150f202d8d86 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=59ec8c28904f49489cb6d9040f831ba2]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260923 17:14:08.445711 14058 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb546c4be538424cb3fb150f202d8d86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:08.445711 14338 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb546c4be538424cb3fb150f202d8d86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:08.444873 14198 tablet_service.cc:1467] Processing CreateTablet for tablet cb546c4be538424cb3fb150f202d8d86 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=59ec8c28904f49489cb6d9040f831ba2]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260923 17:14:08.446089 14198 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb546c4be538424cb3fb150f202d8d86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:08.448906 14427 tablet_bootstrap.cc:492] T cb546c4be538424cb3fb150f202d8d86 P 1e259955db614825ac1dcd354f008989: Bootstrap starting.
I20260923 17:14:08.448975 14428 tablet_bootstrap.cc:492] T cb546c4be538424cb3fb150f202d8d86 P 55f7637537d44ed5a7c2442532af0bcb: Bootstrap starting.
I20260923 17:14:08.448966 14429 tablet_bootstrap.cc:492] T cb546c4be538424cb3fb150f202d8d86 P 85fe4a5ab7914a8abeabe059271d6ad3: Bootstrap starting.
I20260923 17:14:08.449774 14427 tablet_bootstrap.cc:654] T cb546c4be538424cb3fb150f202d8d86 P 1e259955db614825ac1dcd354f008989: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:08.450016 14429 tablet_bootstrap.cc:654] T cb546c4be538424cb3fb150f202d8d86 P 85fe4a5ab7914a8abeabe059271d6ad3: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:08.450027 14428 tablet_bootstrap.cc:654] T cb546c4be538424cb3fb150f202d8d86 P 55f7637537d44ed5a7c2442532af0bcb: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:08.451439 14428 tablet_bootstrap.cc:492] T cb546c4be538424cb3fb150f202d8d86 P 55f7637537d44ed5a7c2442532af0bcb: No bootstrap required, opened a new log
I20260923 17:14:08.451534 14428 ts_tablet_manager.cc:1397] T cb546c4be538424cb3fb150f202d8d86 P 55f7637537d44ed5a7c2442532af0bcb: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260923 17:14:08.451599 14427 tablet_bootstrap.cc:492] T cb546c4be538424cb3fb150f202d8d86 P 1e259955db614825ac1dcd354f008989: No bootstrap required, opened a new log
I20260923 17:14:08.451689 14427 ts_tablet_manager.cc:1397] T cb546c4be538424cb3fb150f202d8d86 P 1e259955db614825ac1dcd354f008989: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260923 17:14:08.452035 14428 raft_consensus.cc:348] T cb546c4be538424cb3fb150f202d8d86 P 55f7637537d44ed5a7c2442532af0bcb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } }
I20260923 17:14:08.452086 14427 raft_consensus.cc:348] T cb546c4be538424cb3fb150f202d8d86 P 1e259955db614825ac1dcd354f008989 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } }
I20260923 17:14:08.452164 14428 raft_consensus.cc:374] T cb546c4be538424cb3fb150f202d8d86 P 55f7637537d44ed5a7c2442532af0bcb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:08.452195 14427 raft_consensus.cc:374] T cb546c4be538424cb3fb150f202d8d86 P 1e259955db614825ac1dcd354f008989 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:08.452199 14428 raft_consensus.cc:729] T cb546c4be538424cb3fb150f202d8d86 P 55f7637537d44ed5a7c2442532af0bcb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55f7637537d44ed5a7c2442532af0bcb, State: Initialized, Role: FOLLOWER
I20260923 17:14:08.452240 14427 raft_consensus.cc:729] T cb546c4be538424cb3fb150f202d8d86 P 1e259955db614825ac1dcd354f008989 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e259955db614825ac1dcd354f008989, State: Initialized, Role: FOLLOWER
I20260923 17:14:08.452337 14428 consensus_queue.cc:260] T cb546c4be538424cb3fb150f202d8d86 P 55f7637537d44ed5a7c2442532af0bcb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } }
I20260923 17:14:08.452361 14427 consensus_queue.cc:260] T cb546c4be538424cb3fb150f202d8d86 P 1e259955db614825ac1dcd354f008989 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } }
I20260923 17:14:08.452601 14427 ts_tablet_manager.cc:1428] T cb546c4be538424cb3fb150f202d8d86 P 1e259955db614825ac1dcd354f008989: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260923 17:14:08.452629 14428 ts_tablet_manager.cc:1428] T cb546c4be538424cb3fb150f202d8d86 P 55f7637537d44ed5a7c2442532af0bcb: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260923 17:14:08.452698 14433 tablet_replica.cc:439] T cb546c4be538424cb3fb150f202d8d86 P 1e259955db614825ac1dcd354f008989: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } } }
I20260923 17:14:08.452864 14433 tablet_replica.cc:442] T cb546c4be538424cb3fb150f202d8d86 P 1e259955db614825ac1dcd354f008989: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 17:14:08.452807 14434 tablet_replica.cc:439] T cb546c4be538424cb3fb150f202d8d86 P 55f7637537d44ed5a7c2442532af0bcb: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } } }
I20260923 17:14:08.452924 14434 tablet_replica.cc:442] T cb546c4be538424cb3fb150f202d8d86 P 55f7637537d44ed5a7c2442532af0bcb: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 17:14:08.454052 14429 tablet_bootstrap.cc:492] T cb546c4be538424cb3fb150f202d8d86 P 85fe4a5ab7914a8abeabe059271d6ad3: No bootstrap required, opened a new log
I20260923 17:14:08.454175 14429 ts_tablet_manager.cc:1397] T cb546c4be538424cb3fb150f202d8d86 P 85fe4a5ab7914a8abeabe059271d6ad3: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20260923 17:14:08.454696 14429 raft_consensus.cc:348] T cb546c4be538424cb3fb150f202d8d86 P 85fe4a5ab7914a8abeabe059271d6ad3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } }
I20260923 17:14:08.454843 14429 raft_consensus.cc:374] T cb546c4be538424cb3fb150f202d8d86 P 85fe4a5ab7914a8abeabe059271d6ad3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:08.454888 14429 raft_consensus.cc:729] T cb546c4be538424cb3fb150f202d8d86 P 85fe4a5ab7914a8abeabe059271d6ad3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fe4a5ab7914a8abeabe059271d6ad3, State: Initialized, Role: FOLLOWER
I20260923 17:14:08.455035 14429 consensus_queue.cc:260] T cb546c4be538424cb3fb150f202d8d86 P 85fe4a5ab7914a8abeabe059271d6ad3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } }
I20260923 17:14:08.455354 14429 ts_tablet_manager.cc:1428] T cb546c4be538424cb3fb150f202d8d86 P 85fe4a5ab7914a8abeabe059271d6ad3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260923 17:14:08.455303 14435 tablet_replica.cc:439] T cb546c4be538424cb3fb150f202d8d86 P 85fe4a5ab7914a8abeabe059271d6ad3: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } } }
I20260923 17:14:08.455430 14435 tablet_replica.cc:442] T cb546c4be538424cb3fb150f202d8d86 P 85fe4a5ab7914a8abeabe059271d6ad3: This TxnStatusTablet replica's current role is: FOLLOWER
W20260923 17:14:08.522017 14405 tablet.cc:2369] T 7bb3c70e21654487a067cf544b10d57d P 85fe4a5ab7914a8abeabe059271d6ad3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 17:14:08.554046 14265 tablet.cc:2369] T 7bb3c70e21654487a067cf544b10d57d P 1e259955db614825ac1dcd354f008989: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 17:14:08.580339 14125 tablet.cc:2369] T 7bb3c70e21654487a067cf544b10d57d P 55f7637537d44ed5a7c2442532af0bcb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 17:14:08.636700 14434 raft_consensus.cc:482] T cb546c4be538424cb3fb150f202d8d86 P 55f7637537d44ed5a7c2442532af0bcb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 17:14:08.636850 14434 raft_consensus.cc:504] T cb546c4be538424cb3fb150f202d8d86 P 55f7637537d44ed5a7c2442532af0bcb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } }
I20260923 17:14:08.637969 14434 leader_election.cc:288] T cb546c4be538424cb3fb150f202d8d86 P 55f7637537d44ed5a7c2442532af0bcb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e259955db614825ac1dcd354f008989 (127.11.229.130:39275), 85fe4a5ab7914a8abeabe059271d6ad3 (127.11.229.131:39649)
I20260923 17:14:08.643091 14448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:08.638351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.131:39649 (local address 127.11.229.129:54651)
0923 17:14:08.638787 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:08.638800 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:08.638933 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:08.639236 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:08.639239 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:08.639255 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:14:08.639425 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:08.639431 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.640419 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.640423 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:08.641672 (+ 1249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:08.641681 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.642565 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.642569 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:08.642681 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:08.642709 (+ 28us) client_negotiation.cc:769] Sending connection context
0923 17:14:08.642796 (+ 87us) client_negotiation.cc:240] Negotiation successful
0923 17:14:08.642889 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":372,"mutex_wait_us":1,"spinlock_wait_cycles":7296,"thread_start_us":163,"threads_started":1}
I20260923 17:14:08.643221 14422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:08.638513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:54651 (local address 127.11.229.131:39649)
0923 17:14:08.638652 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:08.638656 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:08.638891 (+ 235us) server_negotiation.cc:407] Connection header received
0923 17:14:08.639062 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:08.639065 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:08.639122 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:08.639189 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:14:08.639536 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.640304 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.641841 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.642436 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.642531 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:08.642572 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:08.642892 (+ 320us) server_negotiation.cc:299] Negotiation successful
0923 17:14:08.642982 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260923 17:14:08.643432 14424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:08.638518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:39281 (local address 127.11.229.130:39275)
0923 17:14:08.638650 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:08.638656 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:08.638931 (+ 275us) server_negotiation.cc:407] Connection header received
0923 17:14:08.639090 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:08.639093 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:08.639134 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:08.639224 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:14:08.640112 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.640745 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.642123 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.642790 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.642897 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:08.642938 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:08.643205 (+ 267us) server_negotiation.cc:299] Negotiation successful
0923 17:14:08.643297 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260923 17:14:08.643447 14449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:08.638351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.130:39275 (local address 127.11.229.129:39281)
0923 17:14:08.638795 (+ 444us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:08.638807 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:08.638951 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:08.639252 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:08.639255 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:08.639272 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:14:08.639974 (+ 702us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:08.639984 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.640933 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.640936 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:08.641945 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:08.641958 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.642919 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.642923 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:08.643035 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:08.643062 (+ 27us) client_negotiation.cc:769] Sending connection context
0923 17:14:08.643185 (+ 123us) client_negotiation.cc:240] Negotiation successful
0923 17:14:08.643271 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":388,"mutex_wait_us":74,"thread_start_us":101,"threads_started":1}
I20260923 17:14:08.644025 14218 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb546c4be538424cb3fb150f202d8d86" candidate_uuid: "55f7637537d44ed5a7c2442532af0bcb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e259955db614825ac1dcd354f008989" is_pre_election: true
I20260923 17:14:08.644073 14358 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb546c4be538424cb3fb150f202d8d86" candidate_uuid: "55f7637537d44ed5a7c2442532af0bcb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" is_pre_election: true
I20260923 17:14:08.644210 14218 raft_consensus.cc:2454] T cb546c4be538424cb3fb150f202d8d86 P 1e259955db614825ac1dcd354f008989 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55f7637537d44ed5a7c2442532af0bcb in term 0.
I20260923 17:14:08.644301 14358 raft_consensus.cc:2454] T cb546c4be538424cb3fb150f202d8d86 P 85fe4a5ab7914a8abeabe059271d6ad3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 55f7637537d44ed5a7c2442532af0bcb in term 0.
I20260923 17:14:08.644645 14010 leader_election.cc:302] T cb546c4be538424cb3fb150f202d8d86 P 55f7637537d44ed5a7c2442532af0bcb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e259955db614825ac1dcd354f008989, 55f7637537d44ed5a7c2442532af0bcb; no voters:
I20260923 17:14:08.644960 14434 raft_consensus.cc:2781] T cb546c4be538424cb3fb150f202d8d86 P 55f7637537d44ed5a7c2442532af0bcb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 17:14:08.645087 14434 raft_consensus.cc:482] T cb546c4be538424cb3fb150f202d8d86 P 55f7637537d44ed5a7c2442532af0bcb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 17:14:08.645166 14434 raft_consensus.cc:3037] T cb546c4be538424cb3fb150f202d8d86 P 55f7637537d44ed5a7c2442532af0bcb [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:08.646270 14434 raft_consensus.cc:504] T cb546c4be538424cb3fb150f202d8d86 P 55f7637537d44ed5a7c2442532af0bcb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } }
I20260923 17:14:08.646664 14434 leader_election.cc:288] T cb546c4be538424cb3fb150f202d8d86 P 55f7637537d44ed5a7c2442532af0bcb [CANDIDATE]: Term 1 election: Requested vote from peers 1e259955db614825ac1dcd354f008989 (127.11.229.130:39275), 85fe4a5ab7914a8abeabe059271d6ad3 (127.11.229.131:39649)
I20260923 17:14:08.647096 14358 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb546c4be538424cb3fb150f202d8d86" candidate_uuid: "55f7637537d44ed5a7c2442532af0bcb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fe4a5ab7914a8abeabe059271d6ad3"
I20260923 17:14:08.647230 14358 raft_consensus.cc:3037] T cb546c4be538424cb3fb150f202d8d86 P 85fe4a5ab7914a8abeabe059271d6ad3 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:08.647254 14218 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb546c4be538424cb3fb150f202d8d86" candidate_uuid: "55f7637537d44ed5a7c2442532af0bcb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e259955db614825ac1dcd354f008989"
I20260923 17:14:08.647382 14218 raft_consensus.cc:3037] T cb546c4be538424cb3fb150f202d8d86 P 1e259955db614825ac1dcd354f008989 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:08.648216 14358 raft_consensus.cc:2454] T cb546c4be538424cb3fb150f202d8d86 P 85fe4a5ab7914a8abeabe059271d6ad3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55f7637537d44ed5a7c2442532af0bcb in term 1.
I20260923 17:14:08.648319 14218 raft_consensus.cc:2454] T cb546c4be538424cb3fb150f202d8d86 P 1e259955db614825ac1dcd354f008989 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 55f7637537d44ed5a7c2442532af0bcb in term 1.
I20260923 17:14:08.648561 14009 leader_election.cc:302] T cb546c4be538424cb3fb150f202d8d86 P 55f7637537d44ed5a7c2442532af0bcb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55f7637537d44ed5a7c2442532af0bcb, 85fe4a5ab7914a8abeabe059271d6ad3; no voters:
I20260923 17:14:08.648734 14434 raft_consensus.cc:2781] T cb546c4be538424cb3fb150f202d8d86 P 55f7637537d44ed5a7c2442532af0bcb [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:14:08.649021 14434 raft_consensus.cc:686] T cb546c4be538424cb3fb150f202d8d86 P 55f7637537d44ed5a7c2442532af0bcb [term 1 LEADER]: Becoming Leader. State: Replica: 55f7637537d44ed5a7c2442532af0bcb, State: Running, Role: LEADER
I20260923 17:14:08.649369 14434 consensus_queue.cc:237] T cb546c4be538424cb3fb150f202d8d86 P 55f7637537d44ed5a7c2442532af0bcb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } }
I20260923 17:14:08.651698 14450 tablet_replica.cc:439] T cb546c4be538424cb3fb150f202d8d86 P 55f7637537d44ed5a7c2442532af0bcb: TxnStatusTablet state changed. Reason: New leader 55f7637537d44ed5a7c2442532af0bcb. Latest consensus state: current_term: 1 leader_uuid: "55f7637537d44ed5a7c2442532af0bcb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } } }
I20260923 17:14:08.651836 14450 tablet_replica.cc:442] T cb546c4be538424cb3fb150f202d8d86 P 55f7637537d44ed5a7c2442532af0bcb: This TxnStatusTablet replica's current role is: LEADER
I20260923 17:14:08.652127 14452 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260923 17:14:08.652338 14452 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260923 17:14:08.652706 13920 catalog_manager.cc:5495] T cb546c4be538424cb3fb150f202d8d86 P 55f7637537d44ed5a7c2442532af0bcb reported cstate change: term changed from 0 to 1, leader changed from <none> to 55f7637537d44ed5a7c2442532af0bcb (127.11.229.129). New cstate: current_term: 1 leader_uuid: "55f7637537d44ed5a7c2442532af0bcb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } health_report { overall_health: UNKNOWN } } }
I20260923 17:14:08.698814 14426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:08.694499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44296 (local address 127.11.229.129:38477)
0923 17:14:08.694647 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:08.694651 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:08.694669 (+ 18us) server_negotiation.cc:407] Connection header received
0923 17:14:08.694827 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:08.694830 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:08.694897 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:08.695007 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 17:14:08.695263 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.696061 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.696908 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.697259 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.697372 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:08.697745 (+ 373us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 17:14:08.698345 (+ 600us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 17:14:08.698460 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:08.698600 (+ 140us) server_negotiation.cc:299] Negotiation successful
0923 17:14:08.698664 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260923 17:14:08.698830 14444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:08.694342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:38477 (local address 127.0.0.1:44296)
0923 17:14:08.694550 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:08.694569 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:08.694672 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:08.695054 (+ 382us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:08.695057 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:08.695064 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0923 17:14:08.695158 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:08.695163 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.696194 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.696196 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:08.696796 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:08.696803 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.697392 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.697395 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:08.697474 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:08.697583 (+ 109us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0923 17:14:08.698462 (+ 879us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0923 17:14:08.698495 (+ 33us) client_negotiation.cc:769] Sending connection context
0923 17:14:08.698559 (+ 64us) client_negotiation.cc:240] Negotiation successful
0923 17:14:08.698686 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260923 17:14:08.704046 14218 raft_consensus.cc:1261] T cb546c4be538424cb3fb150f202d8d86 P 1e259955db614825ac1dcd354f008989 [term 1 FOLLOWER]: Refusing update from remote peer 55f7637537d44ed5a7c2442532af0bcb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:14:08.704046 14358 raft_consensus.cc:1261] T cb546c4be538424cb3fb150f202d8d86 P 85fe4a5ab7914a8abeabe059271d6ad3 [term 1 FOLLOWER]: Refusing update from remote peer 55f7637537d44ed5a7c2442532af0bcb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:14:08.704788 14434 consensus_queue.cc:1035] T cb546c4be538424cb3fb150f202d8d86 P 55f7637537d44ed5a7c2442532af0bcb [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:14:08.705024 14450 consensus_queue.cc:1035] T cb546c4be538424cb3fb150f202d8d86 P 55f7637537d44ed5a7c2442532af0bcb [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:14:08.708866 14435 tablet_replica.cc:439] T cb546c4be538424cb3fb150f202d8d86 P 85fe4a5ab7914a8abeabe059271d6ad3: TxnStatusTablet state changed. Reason: New leader 55f7637537d44ed5a7c2442532af0bcb. Latest consensus state: current_term: 1 leader_uuid: "55f7637537d44ed5a7c2442532af0bcb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } } }
I20260923 17:14:08.709005 14435 tablet_replica.cc:442] T cb546c4be538424cb3fb150f202d8d86 P 85fe4a5ab7914a8abeabe059271d6ad3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 17:14:08.709803 14433 tablet_replica.cc:439] T cb546c4be538424cb3fb150f202d8d86 P 1e259955db614825ac1dcd354f008989: TxnStatusTablet state changed. Reason: New leader 55f7637537d44ed5a7c2442532af0bcb. Latest consensus state: current_term: 1 leader_uuid: "55f7637537d44ed5a7c2442532af0bcb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } } }
I20260923 17:14:08.709932 14433 tablet_replica.cc:442] T cb546c4be538424cb3fb150f202d8d86 P 1e259955db614825ac1dcd354f008989: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 17:14:08.714048 14450 tablet_replica.cc:439] T cb546c4be538424cb3fb150f202d8d86 P 55f7637537d44ed5a7c2442532af0bcb: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "55f7637537d44ed5a7c2442532af0bcb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } } }
I20260923 17:14:08.714175 14450 tablet_replica.cc:442] T cb546c4be538424cb3fb150f202d8d86 P 55f7637537d44ed5a7c2442532af0bcb: This TxnStatusTablet replica's current role is: LEADER
I20260923 17:14:08.714342 14433 tablet_replica.cc:439] T cb546c4be538424cb3fb150f202d8d86 P 1e259955db614825ac1dcd354f008989: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "55f7637537d44ed5a7c2442532af0bcb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } } }
I20260923 17:14:08.714452 14433 tablet_replica.cc:442] T cb546c4be538424cb3fb150f202d8d86 P 1e259955db614825ac1dcd354f008989: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 17:14:08.714857 14450 tablet_replica.cc:439] T cb546c4be538424cb3fb150f202d8d86 P 55f7637537d44ed5a7c2442532af0bcb: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "55f7637537d44ed5a7c2442532af0bcb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } } }
I20260923 17:14:08.714956 14450 tablet_replica.cc:442] T cb546c4be538424cb3fb150f202d8d86 P 55f7637537d44ed5a7c2442532af0bcb: This TxnStatusTablet replica's current role is: LEADER
I20260923 17:14:08.716245 14457 mvcc.cc:205] Tried to move back new op lower bound from 7332592225084579840 to 7332592224870547456. Current Snapshot: MvccSnapshot[applied={T|T < 7332592225084579840}]
I20260923 17:14:08.716428 14435 tablet_replica.cc:439] T cb546c4be538424cb3fb150f202d8d86 P 85fe4a5ab7914a8abeabe059271d6ad3: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "55f7637537d44ed5a7c2442532af0bcb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } } }
I20260923 17:14:08.716527 14435 tablet_replica.cc:442] T cb546c4be538424cb3fb150f202d8d86 P 85fe4a5ab7914a8abeabe059271d6ad3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 17:14:08.717527 14456 mvcc.cc:205] Tried to move back new op lower bound from 7332592225084579840 to 7332592224870547456. Current Snapshot: MvccSnapshot[applied={T|T < 7332592225084579840}]
I20260923 17:14:08.724820 14422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:08.720787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37230 (local address 127.11.229.131:39649)
0923 17:14:08.720916 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:08.720920 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:08.720935 (+ 15us) server_negotiation.cc:407] Connection header received
0923 17:14:08.721081 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:08.721084 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:08.721145 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:08.721281 (+ 136us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 17:14:08.721571 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.722159 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.723385 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.723613 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.723702 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:08.723986 (+ 284us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 17:14:08.724404 (+ 418us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 17:14:08.724501 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:08.724599 (+ 98us) server_negotiation.cc:299] Negotiation successful
0923 17:14:08.724645 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260923 17:14:08.736378 14410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:08.732602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:38477 (local address 127.11.229.131:51109)
0923 17:14:08.732791 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:08.732809 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:08.732897 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:08.733133 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:08.733135 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:08.733147 (+ 12us) client_negotiation.cc:189] Negotiated authn=TOKEN
0923 17:14:08.733310 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:08.733316 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.734356 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.734361 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:08.735033 (+ 672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:08.735042 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.735617 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.735620 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:08.735691 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:08.735736 (+ 45us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0923 17:14:08.736105 (+ 369us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0923 17:14:08.736112 (+ 7us) client_negotiation.cc:769] Sending connection context
0923 17:14:08.736192 (+ 80us) client_negotiation.cc:240] Negotiation successful
0923 17:14:08.736262 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":73}
I20260923 17:14:08.736413 14426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:08.732741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:51109 (local address 127.11.229.129:38477)
0923 17:14:08.732892 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:08.732897 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:08.732914 (+ 17us) server_negotiation.cc:407] Connection header received
0923 17:14:08.732965 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:08.732969 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:08.733019 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:08.733102 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 17:14:08.733397 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.734200 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.735155 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.735499 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.735601 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:08.735889 (+ 288us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 17:14:08.735976 (+ 87us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 17:14:08.736048 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:08.736221 (+ 173us) server_negotiation.cc:299] Negotiation successful
0923 17:14:08.736276 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260923 17:14:08.744776 14218 raft_consensus.cc:1261] T 7bb3c70e21654487a067cf544b10d57d P 1e259955db614825ac1dcd354f008989 [term 1 FOLLOWER]: Refusing update from remote peer 85fe4a5ab7914a8abeabe059271d6ad3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:14:08.744982 14064 raft_consensus.cc:1261] T 7bb3c70e21654487a067cf544b10d57d P 55f7637537d44ed5a7c2442532af0bcb [term 1 FOLLOWER]: Refusing update from remote peer 85fe4a5ab7914a8abeabe059271d6ad3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:14:08.745249 14437 consensus_queue.cc:1035] T 7bb3c70e21654487a067cf544b10d57d P 85fe4a5ab7914a8abeabe059271d6ad3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:14:08.745453 14435 consensus_queue.cc:1035] T 7bb3c70e21654487a067cf544b10d57d P 85fe4a5ab7914a8abeabe059271d6ad3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:14:08.750752 14455 mvcc.cc:205] Tried to move back new op lower bound from 7332592225254088704 to 7332592223843852288. Current Snapshot: MvccSnapshot[applied={T|T < 7332592225254088704}]
I20260923 17:14:08.769582 14422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:08.765204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:54511 (local address 127.11.229.131:39649)
0923 17:14:08.765319 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:08.765324 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:08.765560 (+ 236us) server_negotiation.cc:407] Connection header received
0923 17:14:08.765653 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:08.765657 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:08.765710 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:08.765793 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 17:14:08.766092 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.766894 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.768308 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.768622 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.768710 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:08.769077 (+ 367us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 17:14:08.769166 (+ 89us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 17:14:08.769215 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:08.769364 (+ 149us) server_negotiation.cc:299] Negotiation successful
0923 17:14:08.769422 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260923 17:14:08.769603 14472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:08.765133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.131:39649 (local address 127.11.229.129:54511)
0923 17:14:08.765465 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:08.765480 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:08.765573 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:08.765823 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:08.765826 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:08.765834 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0923 17:14:08.765961 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:08.765982 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.767069 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.767073 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:08.768150 (+ 1077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:08.768163 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:08.768760 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:08.768764 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:08.768857 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:08.768917 (+ 60us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0923 17:14:08.769277 (+ 360us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0923 17:14:08.769283 (+ 6us) client_negotiation.cc:769] Sending connection context
0923 17:14:08.769344 (+ 61us) client_negotiation.cc:240] Negotiation successful
0923 17:14:08.769431 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":128,"threads_started":1}
I20260923 17:14:08.793733 13921 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47124:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:14:08.793933 13921 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47124:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:14:08.796357 13921 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4b796d25429e42c8a4f4e266c3a97faa: Sending DeleteTablet for 3 replicas of tablet 7bb3c70e21654487a067cf544b10d57d
I20260923 17:14:08.797120 14338 tablet_service.cc:1514] Processing DeleteTablet for tablet 7bb3c70e21654487a067cf544b10d57d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:14:08 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:37226
I20260923 17:14:08.797650 14475 tablet_replica.cc:330] T 7bb3c70e21654487a067cf544b10d57d P 85fe4a5ab7914a8abeabe059271d6ad3: stopping tablet replica
I20260923 17:14:08.797969 14198 tablet_service.cc:1514] Processing DeleteTablet for tablet 7bb3c70e21654487a067cf544b10d57d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:14:08 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:44252
I20260923 17:14:08.798175 14475 raft_consensus.cc:2229] T 7bb3c70e21654487a067cf544b10d57d P 85fe4a5ab7914a8abeabe059271d6ad3 [term 1 LEADER]: Raft consensus shutting down.
I20260923 17:14:08.798662 14475 raft_consensus.cc:2258] T 7bb3c70e21654487a067cf544b10d57d P 85fe4a5ab7914a8abeabe059271d6ad3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:14:08.799232 14058 tablet_service.cc:1514] Processing DeleteTablet for tablet 7bb3c70e21654487a067cf544b10d57d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:14:08 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:44288
I20260923 17:14:08.799255 13921 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47124:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 17:14:08.799677 13921 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 17:14:08.799736 14476 tablet_replica.cc:330] T 7bb3c70e21654487a067cf544b10d57d P 1e259955db614825ac1dcd354f008989: stopping tablet replica
I20260923 17:14:08.800056 14476 raft_consensus.cc:2229] T 7bb3c70e21654487a067cf544b10d57d P 1e259955db614825ac1dcd354f008989 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:14:08.800252 14476 raft_consensus.cc:2258] T 7bb3c70e21654487a067cf544b10d57d P 1e259955db614825ac1dcd354f008989 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:14:08.800432 14475 ts_tablet_manager.cc:1905] T 7bb3c70e21654487a067cf544b10d57d P 85fe4a5ab7914a8abeabe059271d6ad3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:14:08.801765 14476 ts_tablet_manager.cc:1905] T 7bb3c70e21654487a067cf544b10d57d P 1e259955db614825ac1dcd354f008989: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:14:08.803663 14475 ts_tablet_manager.cc:1918] T 7bb3c70e21654487a067cf544b10d57d P 85fe4a5ab7914a8abeabe059271d6ad3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 17:14:08.803769 14475 log.cc:1196] T 7bb3c70e21654487a067cf544b10d57d P 85fe4a5ab7914a8abeabe059271d6ad3: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-2/wal/wals/7bb3c70e21654487a067cf544b10d57d
I20260923 17:14:08.804091 14475 ts_tablet_manager.cc:1939] T 7bb3c70e21654487a067cf544b10d57d P 85fe4a5ab7914a8abeabe059271d6ad3: Deleting consensus metadata
I20260923 17:14:08.805001 14476 ts_tablet_manager.cc:1918] T 7bb3c70e21654487a067cf544b10d57d P 1e259955db614825ac1dcd354f008989: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 17:14:08.805171 14476 log.cc:1196] T 7bb3c70e21654487a067cf544b10d57d P 1e259955db614825ac1dcd354f008989: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-1/wal/wals/7bb3c70e21654487a067cf544b10d57d
I20260923 17:14:08.805653 14198 tablet_service.cc:1467] Processing CreateTablet for tablet 2371852025b84996a680277668ce9f0e (DEFAULT_TABLE table=test-table [id=d075a7eba2214482a36edee57ea9769a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:14:08.805919 14198 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2371852025b84996a680277668ce9f0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:08.806993 13905 catalog_manager.cc:4841] TS 85fe4a5ab7914a8abeabe059271d6ad3 (127.11.229.131:39649): tablet 7bb3c70e21654487a067cf544b10d57d (table test-table [id=984f6e2fcfec487686474c395a26a76f]) successfully deleted
I20260923 17:14:08.807382 14477 tablet_replica.cc:330] T 7bb3c70e21654487a067cf544b10d57d P 55f7637537d44ed5a7c2442532af0bcb: stopping tablet replica
I20260923 17:14:08.807695 14477 raft_consensus.cc:2229] T 7bb3c70e21654487a067cf544b10d57d P 55f7637537d44ed5a7c2442532af0bcb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:14:08.807864 14477 raft_consensus.cc:2258] T 7bb3c70e21654487a067cf544b10d57d P 55f7637537d44ed5a7c2442532af0bcb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:14:08.808102 14427 tablet_bootstrap.cc:492] T 2371852025b84996a680277668ce9f0e P 1e259955db614825ac1dcd354f008989: Bootstrap starting.
I20260923 17:14:08.808306 14058 tablet_service.cc:1467] Processing CreateTablet for tablet 2371852025b84996a680277668ce9f0e (DEFAULT_TABLE table=test-table [id=d075a7eba2214482a36edee57ea9769a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:14:08.808559 14058 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2371852025b84996a680277668ce9f0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:08.809044 14427 tablet_bootstrap.cc:654] T 2371852025b84996a680277668ce9f0e P 1e259955db614825ac1dcd354f008989: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:08.809168 14477 ts_tablet_manager.cc:1905] T 7bb3c70e21654487a067cf544b10d57d P 55f7637537d44ed5a7c2442532af0bcb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:14:08.811044 14338 tablet_service.cc:1467] Processing CreateTablet for tablet 2371852025b84996a680277668ce9f0e (DEFAULT_TABLE table=test-table [id=d075a7eba2214482a36edee57ea9769a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:14:08.811269 14338 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2371852025b84996a680277668ce9f0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:08.811865 14477 ts_tablet_manager.cc:1918] T 7bb3c70e21654487a067cf544b10d57d P 55f7637537d44ed5a7c2442532af0bcb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 17:14:08.811942 14477 log.cc:1196] T 7bb3c70e21654487a067cf544b10d57d P 55f7637537d44ed5a7c2442532af0bcb: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-0/wal/wals/7bb3c70e21654487a067cf544b10d57d
I20260923 17:14:08.812248 14477 ts_tablet_manager.cc:1939] T 7bb3c70e21654487a067cf544b10d57d P 55f7637537d44ed5a7c2442532af0bcb: Deleting consensus metadata
I20260923 17:14:08.813586 14429 tablet_bootstrap.cc:492] T 2371852025b84996a680277668ce9f0e P 85fe4a5ab7914a8abeabe059271d6ad3: Bootstrap starting.
I20260923 17:14:08.813879 14428 tablet_bootstrap.cc:492] T 2371852025b84996a680277668ce9f0e P 55f7637537d44ed5a7c2442532af0bcb: Bootstrap starting.
I20260923 17:14:08.814570 14429 tablet_bootstrap.cc:654] T 2371852025b84996a680277668ce9f0e P 85fe4a5ab7914a8abeabe059271d6ad3: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:08.814819 14428 tablet_bootstrap.cc:654] T 2371852025b84996a680277668ce9f0e P 55f7637537d44ed5a7c2442532af0bcb: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:08.815958 14429 tablet_bootstrap.cc:492] T 2371852025b84996a680277668ce9f0e P 85fe4a5ab7914a8abeabe059271d6ad3: No bootstrap required, opened a new log
I20260923 17:14:08.815929 13908 catalog_manager.cc:4841] TS 55f7637537d44ed5a7c2442532af0bcb (127.11.229.129:38477): tablet 7bb3c70e21654487a067cf544b10d57d (table test-table [id=984f6e2fcfec487686474c395a26a76f]) successfully deleted
I20260923 17:14:08.816043 14429 ts_tablet_manager.cc:1397] T 2371852025b84996a680277668ce9f0e P 85fe4a5ab7914a8abeabe059271d6ad3: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260923 17:14:08.816471 14429 raft_consensus.cc:348] T 2371852025b84996a680277668ce9f0e P 85fe4a5ab7914a8abeabe059271d6ad3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } }
I20260923 17:14:08.816586 14429 raft_consensus.cc:374] T 2371852025b84996a680277668ce9f0e P 85fe4a5ab7914a8abeabe059271d6ad3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:08.816617 14429 raft_consensus.cc:729] T 2371852025b84996a680277668ce9f0e P 85fe4a5ab7914a8abeabe059271d6ad3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fe4a5ab7914a8abeabe059271d6ad3, State: Initialized, Role: FOLLOWER
I20260923 17:14:08.816740 14429 consensus_queue.cc:260] T 2371852025b84996a680277668ce9f0e P 85fe4a5ab7914a8abeabe059271d6ad3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } }
I20260923 17:14:08.816993 14429 ts_tablet_manager.cc:1428] T 2371852025b84996a680277668ce9f0e P 85fe4a5ab7914a8abeabe059271d6ad3: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260923 17:14:08.817525 14427 tablet_bootstrap.cc:492] T 2371852025b84996a680277668ce9f0e P 1e259955db614825ac1dcd354f008989: No bootstrap required, opened a new log
I20260923 17:14:08.817612 14427 ts_tablet_manager.cc:1397] T 2371852025b84996a680277668ce9f0e P 1e259955db614825ac1dcd354f008989: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20260923 17:14:08.818071 14476 ts_tablet_manager.cc:1939] T 7bb3c70e21654487a067cf544b10d57d P 1e259955db614825ac1dcd354f008989: Deleting consensus metadata
I20260923 17:14:08.818027 14427 raft_consensus.cc:348] T 2371852025b84996a680277668ce9f0e P 1e259955db614825ac1dcd354f008989 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } }
I20260923 17:14:08.818219 14427 raft_consensus.cc:374] T 2371852025b84996a680277668ce9f0e P 1e259955db614825ac1dcd354f008989 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:08.818286 14427 raft_consensus.cc:729] T 2371852025b84996a680277668ce9f0e P 1e259955db614825ac1dcd354f008989 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e259955db614825ac1dcd354f008989, State: Initialized, Role: FOLLOWER
I20260923 17:14:08.818409 14427 consensus_queue.cc:260] T 2371852025b84996a680277668ce9f0e P 1e259955db614825ac1dcd354f008989 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } }
I20260923 17:14:08.818655 14427 ts_tablet_manager.cc:1428] T 2371852025b84996a680277668ce9f0e P 1e259955db614825ac1dcd354f008989: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260923 17:14:08.819640 13906 catalog_manager.cc:4841] TS 1e259955db614825ac1dcd354f008989 (127.11.229.130:39275): tablet 7bb3c70e21654487a067cf544b10d57d (table test-table [id=984f6e2fcfec487686474c395a26a76f]) successfully deleted
I20260923 17:14:08.820385 14428 tablet_bootstrap.cc:492] T 2371852025b84996a680277668ce9f0e P 55f7637537d44ed5a7c2442532af0bcb: No bootstrap required, opened a new log
I20260923 17:14:08.820473 14428 ts_tablet_manager.cc:1397] T 2371852025b84996a680277668ce9f0e P 55f7637537d44ed5a7c2442532af0bcb: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20260923 17:14:08.820883 14428 raft_consensus.cc:348] T 2371852025b84996a680277668ce9f0e P 55f7637537d44ed5a7c2442532af0bcb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } }
I20260923 17:14:08.821013 14428 raft_consensus.cc:374] T 2371852025b84996a680277668ce9f0e P 55f7637537d44ed5a7c2442532af0bcb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:08.821053 14428 raft_consensus.cc:729] T 2371852025b84996a680277668ce9f0e P 55f7637537d44ed5a7c2442532af0bcb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55f7637537d44ed5a7c2442532af0bcb, State: Initialized, Role: FOLLOWER
I20260923 17:14:08.821168 14428 consensus_queue.cc:260] T 2371852025b84996a680277668ce9f0e P 55f7637537d44ed5a7c2442532af0bcb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } }
I20260923 17:14:08.821416 14428 ts_tablet_manager.cc:1428] T 2371852025b84996a680277668ce9f0e P 55f7637537d44ed5a7c2442532af0bcb: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260923 17:14:08.891711 14437 raft_consensus.cc:482] T 2371852025b84996a680277668ce9f0e P 85fe4a5ab7914a8abeabe059271d6ad3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 17:14:08.891886 14437 raft_consensus.cc:504] T 2371852025b84996a680277668ce9f0e P 85fe4a5ab7914a8abeabe059271d6ad3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } }
I20260923 17:14:08.892453 14437 leader_election.cc:288] T 2371852025b84996a680277668ce9f0e P 85fe4a5ab7914a8abeabe059271d6ad3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 55f7637537d44ed5a7c2442532af0bcb (127.11.229.129:38477), 1e259955db614825ac1dcd354f008989 (127.11.229.130:39275)
I20260923 17:14:08.892948 14064 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2371852025b84996a680277668ce9f0e" candidate_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55f7637537d44ed5a7c2442532af0bcb" is_pre_election: true
I20260923 17:14:08.892953 14218 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2371852025b84996a680277668ce9f0e" candidate_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e259955db614825ac1dcd354f008989" is_pre_election: true
I20260923 17:14:08.893103 14064 raft_consensus.cc:2454] T 2371852025b84996a680277668ce9f0e P 55f7637537d44ed5a7c2442532af0bcb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fe4a5ab7914a8abeabe059271d6ad3 in term 0.
I20260923 17:14:08.893124 14218 raft_consensus.cc:2454] T 2371852025b84996a680277668ce9f0e P 1e259955db614825ac1dcd354f008989 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85fe4a5ab7914a8abeabe059271d6ad3 in term 0.
I20260923 17:14:08.893391 14290 leader_election.cc:302] T 2371852025b84996a680277668ce9f0e P 85fe4a5ab7914a8abeabe059271d6ad3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e259955db614825ac1dcd354f008989, 85fe4a5ab7914a8abeabe059271d6ad3; no voters:
I20260923 17:14:08.893574 14437 raft_consensus.cc:2781] T 2371852025b84996a680277668ce9f0e P 85fe4a5ab7914a8abeabe059271d6ad3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 17:14:08.893658 14437 raft_consensus.cc:482] T 2371852025b84996a680277668ce9f0e P 85fe4a5ab7914a8abeabe059271d6ad3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 17:14:08.893714 14437 raft_consensus.cc:3037] T 2371852025b84996a680277668ce9f0e P 85fe4a5ab7914a8abeabe059271d6ad3 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:08.894742 14437 raft_consensus.cc:504] T 2371852025b84996a680277668ce9f0e P 85fe4a5ab7914a8abeabe059271d6ad3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } }
I20260923 17:14:08.895107 14437 leader_election.cc:288] T 2371852025b84996a680277668ce9f0e P 85fe4a5ab7914a8abeabe059271d6ad3 [CANDIDATE]: Term 1 election: Requested vote from peers 55f7637537d44ed5a7c2442532af0bcb (127.11.229.129:38477), 1e259955db614825ac1dcd354f008989 (127.11.229.130:39275)
I20260923 17:14:08.895376 14064 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2371852025b84996a680277668ce9f0e" candidate_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55f7637537d44ed5a7c2442532af0bcb"
I20260923 17:14:08.895499 14064 raft_consensus.cc:3037] T 2371852025b84996a680277668ce9f0e P 55f7637537d44ed5a7c2442532af0bcb [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:08.895447 14218 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2371852025b84996a680277668ce9f0e" candidate_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e259955db614825ac1dcd354f008989"
I20260923 17:14:08.895581 14218 raft_consensus.cc:3037] T 2371852025b84996a680277668ce9f0e P 1e259955db614825ac1dcd354f008989 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:08.896399 14218 raft_consensus.cc:2454] T 2371852025b84996a680277668ce9f0e P 1e259955db614825ac1dcd354f008989 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fe4a5ab7914a8abeabe059271d6ad3 in term 1.
I20260923 17:14:08.896637 14064 raft_consensus.cc:2454] T 2371852025b84996a680277668ce9f0e P 55f7637537d44ed5a7c2442532af0bcb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85fe4a5ab7914a8abeabe059271d6ad3 in term 1.
I20260923 17:14:08.896673 14290 leader_election.cc:302] T 2371852025b84996a680277668ce9f0e P 85fe4a5ab7914a8abeabe059271d6ad3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e259955db614825ac1dcd354f008989, 85fe4a5ab7914a8abeabe059271d6ad3; no voters:
I20260923 17:14:08.896842 14437 raft_consensus.cc:2781] T 2371852025b84996a680277668ce9f0e P 85fe4a5ab7914a8abeabe059271d6ad3 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:14:08.896932 14437 raft_consensus.cc:686] T 2371852025b84996a680277668ce9f0e P 85fe4a5ab7914a8abeabe059271d6ad3 [term 1 LEADER]: Becoming Leader. State: Replica: 85fe4a5ab7914a8abeabe059271d6ad3, State: Running, Role: LEADER
I20260923 17:14:08.897140 14437 consensus_queue.cc:237] T 2371852025b84996a680277668ce9f0e P 85fe4a5ab7914a8abeabe059271d6ad3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } }
I20260923 17:14:08.899147 13921 catalog_manager.cc:5495] T 2371852025b84996a680277668ce9f0e P 85fe4a5ab7914a8abeabe059271d6ad3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85fe4a5ab7914a8abeabe059271d6ad3 (127.11.229.131). New cstate: current_term: 1 leader_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } health_report { overall_health: HEALTHY } } }
I20260923 17:14:08.933207 14218 raft_consensus.cc:1261] T 2371852025b84996a680277668ce9f0e P 1e259955db614825ac1dcd354f008989 [term 1 FOLLOWER]: Refusing update from remote peer 85fe4a5ab7914a8abeabe059271d6ad3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:14:08.933250 14064 raft_consensus.cc:1261] T 2371852025b84996a680277668ce9f0e P 55f7637537d44ed5a7c2442532af0bcb [term 1 FOLLOWER]: Refusing update from remote peer 85fe4a5ab7914a8abeabe059271d6ad3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:14:08.933622 14470 consensus_queue.cc:1035] T 2371852025b84996a680277668ce9f0e P 85fe4a5ab7914a8abeabe059271d6ad3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:14:08.934190 14437 consensus_queue.cc:1035] T 2371852025b84996a680277668ce9f0e P 85fe4a5ab7914a8abeabe059271d6ad3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260923 17:14:08.949282 14457 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260923 17:14:10.504251 13920 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47124:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:14:10.504403 13920 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47124:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:14:10.506794 13920 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4b796d25429e42c8a4f4e266c3a97faa: Sending DeleteTablet for 3 replicas of tablet 2371852025b84996a680277668ce9f0e
I20260923 17:14:10.507442 14058 tablet_service.cc:1514] Processing DeleteTablet for tablet 2371852025b84996a680277668ce9f0e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:14:10 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:44288
I20260923 17:14:10.507462 14338 tablet_service.cc:1514] Processing DeleteTablet for tablet 2371852025b84996a680277668ce9f0e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:14:10 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:37226
I20260923 17:14:10.507465 14198 tablet_service.cc:1514] Processing DeleteTablet for tablet 2371852025b84996a680277668ce9f0e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:14:10 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:44252
I20260923 17:14:10.507809 14507 tablet_replica.cc:330] T 2371852025b84996a680277668ce9f0e P 55f7637537d44ed5a7c2442532af0bcb: stopping tablet replica
I20260923 17:14:10.507889 14508 tablet_replica.cc:330] T 2371852025b84996a680277668ce9f0e P 1e259955db614825ac1dcd354f008989: stopping tablet replica
I20260923 17:14:10.508021 14508 raft_consensus.cc:2229] T 2371852025b84996a680277668ce9f0e P 1e259955db614825ac1dcd354f008989 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:14:10.508092 14507 raft_consensus.cc:2229] T 2371852025b84996a680277668ce9f0e P 55f7637537d44ed5a7c2442532af0bcb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:14:10.508141 14508 raft_consensus.cc:2258] T 2371852025b84996a680277668ce9f0e P 1e259955db614825ac1dcd354f008989 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:14:10.508333 14507 raft_consensus.cc:2258] T 2371852025b84996a680277668ce9f0e P 55f7637537d44ed5a7c2442532af0bcb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:14:10.508371 14506 tablet_replica.cc:330] T 2371852025b84996a680277668ce9f0e P 85fe4a5ab7914a8abeabe059271d6ad3: stopping tablet replica
I20260923 17:14:10.508517 14506 raft_consensus.cc:2229] T 2371852025b84996a680277668ce9f0e P 85fe4a5ab7914a8abeabe059271d6ad3 [term 1 LEADER]: Raft consensus shutting down.
I20260923 17:14:10.508787 14506 raft_consensus.cc:2258] T 2371852025b84996a680277668ce9f0e P 85fe4a5ab7914a8abeabe059271d6ad3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:14:10.509197 14508 ts_tablet_manager.cc:1905] T 2371852025b84996a680277668ce9f0e P 1e259955db614825ac1dcd354f008989: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:14:10.509222 14507 ts_tablet_manager.cc:1905] T 2371852025b84996a680277668ce9f0e P 55f7637537d44ed5a7c2442532af0bcb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:14:10.511466 14506 ts_tablet_manager.cc:1905] T 2371852025b84996a680277668ce9f0e P 85fe4a5ab7914a8abeabe059271d6ad3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:14:10.512174 14507 ts_tablet_manager.cc:1918] T 2371852025b84996a680277668ce9f0e P 55f7637537d44ed5a7c2442532af0bcb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260923 17:14:10.512277 14507 log.cc:1196] T 2371852025b84996a680277668ce9f0e P 55f7637537d44ed5a7c2442532af0bcb: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-0/wal/wals/2371852025b84996a680277668ce9f0e
I20260923 17:14:10.512264 14508 ts_tablet_manager.cc:1918] T 2371852025b84996a680277668ce9f0e P 1e259955db614825ac1dcd354f008989: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260923 17:14:10.512331 14508 log.cc:1196] T 2371852025b84996a680277668ce9f0e P 1e259955db614825ac1dcd354f008989: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-1/wal/wals/2371852025b84996a680277668ce9f0e
I20260923 17:14:10.512563 14507 ts_tablet_manager.cc:1939] T 2371852025b84996a680277668ce9f0e P 55f7637537d44ed5a7c2442532af0bcb: Deleting consensus metadata
I20260923 17:14:10.512648 14508 ts_tablet_manager.cc:1939] T 2371852025b84996a680277668ce9f0e P 1e259955db614825ac1dcd354f008989: Deleting consensus metadata
I20260923 17:14:10.513517 13908 catalog_manager.cc:4841] TS 55f7637537d44ed5a7c2442532af0bcb (127.11.229.129:38477): tablet 2371852025b84996a680277668ce9f0e (table test-table [id=d075a7eba2214482a36edee57ea9769a]) successfully deleted
I20260923 17:14:10.513736 13906 catalog_manager.cc:4841] TS 1e259955db614825ac1dcd354f008989 (127.11.229.130:39275): tablet 2371852025b84996a680277668ce9f0e (table test-table [id=d075a7eba2214482a36edee57ea9769a]) successfully deleted
I20260923 17:14:10.514514 14506 ts_tablet_manager.cc:1918] T 2371852025b84996a680277668ce9f0e P 85fe4a5ab7914a8abeabe059271d6ad3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260923 17:14:10.514622 14506 log.cc:1196] T 2371852025b84996a680277668ce9f0e P 85fe4a5ab7914a8abeabe059271d6ad3: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-2/wal/wals/2371852025b84996a680277668ce9f0e
I20260923 17:14:10.514863 14506 ts_tablet_manager.cc:1939] T 2371852025b84996a680277668ce9f0e P 85fe4a5ab7914a8abeabe059271d6ad3: Deleting consensus metadata
I20260923 17:14:10.515811 13905 catalog_manager.cc:4841] TS 85fe4a5ab7914a8abeabe059271d6ad3 (127.11.229.131:39649): tablet 2371852025b84996a680277668ce9f0e (table test-table [id=d075a7eba2214482a36edee57ea9769a]) successfully deleted
Sep 23 17:14:10 dist-test-slave-1x1f krb5kdc[13876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183650, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 23 17:14:10 dist-test-slave-1x1f krb5kdc[13876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183650, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:14:10.544340 14516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:10.529470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47140 (local address 127.11.229.190:36183)
0923 17:14:10.529756 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:10.529764 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:10.529867 (+ 103us) server_negotiation.cc:407] Connection header received
0923 17:14:10.530036 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:10.530043 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:10.530150 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:10.530294 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:10.530984 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:10.531534 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:10.532393 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:10.532625 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:10.532765 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:10.540379 (+ 7614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:10.540383 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:10.540385 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:10.540421 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:10.542451 (+ 2030us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:10.542950 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:10.542953 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:10.542955 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:10.543058 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:10.543382 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:10.543385 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:10.543386 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:10.543626 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:10.543740 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:10.543949 (+ 209us) server_negotiation.cc:299] Negotiation successful
0923 17:14:10.544135 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":211,"thread_start_us":82,"threads_started":1}
I20260923 17:14:10.547199 13920 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47140:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 17:14:10.547644 13920 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 17:14:10.552446 14198 tablet_service.cc:1467] Processing CreateTablet for tablet b1641961350547788d720cb7d7bebe97 (DEFAULT_TABLE table=test-table [id=51e08c0255ab40278fd9c9b8b7dc9157]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:14:10.552585 14338 tablet_service.cc:1467] Processing CreateTablet for tablet b1641961350547788d720cb7d7bebe97 (DEFAULT_TABLE table=test-table [id=51e08c0255ab40278fd9c9b8b7dc9157]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:14:10.552778 14198 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1641961350547788d720cb7d7bebe97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:10.552868 14338 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1641961350547788d720cb7d7bebe97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:10.554905 14517 tablet_bootstrap.cc:492] T b1641961350547788d720cb7d7bebe97 P 85fe4a5ab7914a8abeabe059271d6ad3: Bootstrap starting.
I20260923 17:14:10.555152 14058 tablet_service.cc:1467] Processing CreateTablet for tablet b1641961350547788d720cb7d7bebe97 (DEFAULT_TABLE table=test-table [id=51e08c0255ab40278fd9c9b8b7dc9157]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:14:10.555461 14058 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1641961350547788d720cb7d7bebe97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:10.555802 14517 tablet_bootstrap.cc:654] T b1641961350547788d720cb7d7bebe97 P 85fe4a5ab7914a8abeabe059271d6ad3: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:10.556867 14517 tablet_bootstrap.cc:492] T b1641961350547788d720cb7d7bebe97 P 85fe4a5ab7914a8abeabe059271d6ad3: No bootstrap required, opened a new log
I20260923 17:14:10.556974 14517 ts_tablet_manager.cc:1397] T b1641961350547788d720cb7d7bebe97 P 85fe4a5ab7914a8abeabe059271d6ad3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260923 17:14:10.557359 14517 raft_consensus.cc:348] T b1641961350547788d720cb7d7bebe97 P 85fe4a5ab7914a8abeabe059271d6ad3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } }
I20260923 17:14:10.557479 14517 raft_consensus.cc:374] T b1641961350547788d720cb7d7bebe97 P 85fe4a5ab7914a8abeabe059271d6ad3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:10.557525 14517 raft_consensus.cc:729] T b1641961350547788d720cb7d7bebe97 P 85fe4a5ab7914a8abeabe059271d6ad3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fe4a5ab7914a8abeabe059271d6ad3, State: Initialized, Role: FOLLOWER
I20260923 17:14:10.557739 14520 tablet_bootstrap.cc:492] T b1641961350547788d720cb7d7bebe97 P 55f7637537d44ed5a7c2442532af0bcb: Bootstrap starting.
I20260923 17:14:10.557765 14517 consensus_queue.cc:260] T b1641961350547788d720cb7d7bebe97 P 85fe4a5ab7914a8abeabe059271d6ad3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } }
I20260923 17:14:10.558215 14518 tablet_bootstrap.cc:492] T b1641961350547788d720cb7d7bebe97 P 1e259955db614825ac1dcd354f008989: Bootstrap starting.
I20260923 17:14:10.558665 14520 tablet_bootstrap.cc:654] T b1641961350547788d720cb7d7bebe97 P 55f7637537d44ed5a7c2442532af0bcb: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:10.558884 14517 ts_tablet_manager.cc:1428] T b1641961350547788d720cb7d7bebe97 P 85fe4a5ab7914a8abeabe059271d6ad3: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260923 17:14:10.559727 14518 tablet_bootstrap.cc:654] T b1641961350547788d720cb7d7bebe97 P 1e259955db614825ac1dcd354f008989: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:10.559836 14520 tablet_bootstrap.cc:492] T b1641961350547788d720cb7d7bebe97 P 55f7637537d44ed5a7c2442532af0bcb: No bootstrap required, opened a new log
I20260923 17:14:10.559962 14520 ts_tablet_manager.cc:1397] T b1641961350547788d720cb7d7bebe97 P 55f7637537d44ed5a7c2442532af0bcb: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260923 17:14:10.560451 14520 raft_consensus.cc:348] T b1641961350547788d720cb7d7bebe97 P 55f7637537d44ed5a7c2442532af0bcb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } }
I20260923 17:14:10.560585 14520 raft_consensus.cc:374] T b1641961350547788d720cb7d7bebe97 P 55f7637537d44ed5a7c2442532af0bcb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:10.560643 14520 raft_consensus.cc:729] T b1641961350547788d720cb7d7bebe97 P 55f7637537d44ed5a7c2442532af0bcb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55f7637537d44ed5a7c2442532af0bcb, State: Initialized, Role: FOLLOWER
I20260923 17:14:10.560777 14520 consensus_queue.cc:260] T b1641961350547788d720cb7d7bebe97 P 55f7637537d44ed5a7c2442532af0bcb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } }
I20260923 17:14:10.561071 14520 ts_tablet_manager.cc:1428] T b1641961350547788d720cb7d7bebe97 P 55f7637537d44ed5a7c2442532af0bcb: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260923 17:14:10.561875 14518 tablet_bootstrap.cc:492] T b1641961350547788d720cb7d7bebe97 P 1e259955db614825ac1dcd354f008989: No bootstrap required, opened a new log
I20260923 17:14:10.561973 14518 ts_tablet_manager.cc:1397] T b1641961350547788d720cb7d7bebe97 P 1e259955db614825ac1dcd354f008989: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260923 17:14:10.562438 14518 raft_consensus.cc:348] T b1641961350547788d720cb7d7bebe97 P 1e259955db614825ac1dcd354f008989 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } }
I20260923 17:14:10.562546 14518 raft_consensus.cc:374] T b1641961350547788d720cb7d7bebe97 P 1e259955db614825ac1dcd354f008989 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:10.562590 14518 raft_consensus.cc:729] T b1641961350547788d720cb7d7bebe97 P 1e259955db614825ac1dcd354f008989 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e259955db614825ac1dcd354f008989, State: Initialized, Role: FOLLOWER
I20260923 17:14:10.562713 14518 consensus_queue.cc:260] T b1641961350547788d720cb7d7bebe97 P 1e259955db614825ac1dcd354f008989 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } }
I20260923 17:14:10.563390 14518 ts_tablet_manager.cc:1428] T b1641961350547788d720cb7d7bebe97 P 1e259955db614825ac1dcd354f008989: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260923 17:14:10.798632 14523 raft_consensus.cc:482] T b1641961350547788d720cb7d7bebe97 P 1e259955db614825ac1dcd354f008989 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 17:14:10.798826 14523 raft_consensus.cc:504] T b1641961350547788d720cb7d7bebe97 P 1e259955db614825ac1dcd354f008989 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } }
I20260923 17:14:10.799949 14523 leader_election.cc:288] T b1641961350547788d720cb7d7bebe97 P 1e259955db614825ac1dcd354f008989 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 55f7637537d44ed5a7c2442532af0bcb (127.11.229.129:38477), 85fe4a5ab7914a8abeabe059271d6ad3 (127.11.229.131:39649)
I20260923 17:14:10.804234 14526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:10.800350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:38537 (local address 127.11.229.129:38477)
0923 17:14:10.800669 (+ 319us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:10.800679 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:10.800760 (+ 81us) server_negotiation.cc:407] Connection header received
0923 17:14:10.800927 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:10.800930 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:10.800981 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:10.801075 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:14:10.801381 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:10.801911 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:10.803136 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:10.803570 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:10.803724 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:10.803780 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:10.804013 (+ 233us) server_negotiation.cc:299] Negotiation successful
0923 17:14:10.804090 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":229,"thread_start_us":115,"threads_started":1}
I20260923 17:14:10.804234 14527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:10.800360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:49069 (local address 127.11.229.131:39649)
0923 17:14:10.800688 (+ 328us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:10.800698 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:10.800832 (+ 134us) server_negotiation.cc:407] Connection header received
0923 17:14:10.800988 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:10.800991 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:10.801041 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:10.801133 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:14:10.801398 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:10.801910 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:10.803133 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:10.803572 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:10.803713 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:10.803771 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:10.803999 (+ 228us) server_negotiation.cc:299] Negotiation successful
0923 17:14:10.804082 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":223,"thread_start_us":112,"threads_started":1}
I20260923 17:14:10.804265 14524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:10.800238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.131:39649 (local address 127.11.229.130:49069)
0923 17:14:10.800746 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:10.800758 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:10.800883 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:10.801143 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:10.801146 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:10.801162 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:14:10.801294 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:10.801298 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:10.802034 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:10.802038 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:10.803012 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:10.803020 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:10.803714 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:10.803717 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:10.803863 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:10.803889 (+ 26us) client_negotiation.cc:769] Sending connection context
0923 17:14:10.803989 (+ 100us) client_negotiation.cc:240] Negotiation successful
0923 17:14:10.804091 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":436,"mutex_wait_us":138,"thread_start_us":117,"threads_started":1}
I20260923 17:14:10.804281 14525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:10.800238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:38477 (local address 127.11.229.130:38537)
0923 17:14:10.800658 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:10.800674 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:10.800805 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:10.801087 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:10.801089 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:10.801105 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:14:10.801266 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:10.801272 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:10.802028 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:10.802033 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:10.803006 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:10.803015 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:10.803721 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:10.803725 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:10.803889 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:10.803907 (+ 18us) client_negotiation.cc:769] Sending connection context
0923 17:14:10.803995 (+ 88us) client_negotiation.cc:240] Negotiation successful
0923 17:14:10.804083 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":343,"mutex_wait_us":79,"thread_start_us":116,"threads_started":1}
I20260923 17:14:10.804728 14358 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1641961350547788d720cb7d7bebe97" candidate_uuid: "1e259955db614825ac1dcd354f008989" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" is_pre_election: true
I20260923 17:14:10.804891 14358 raft_consensus.cc:2454] T b1641961350547788d720cb7d7bebe97 P 85fe4a5ab7914a8abeabe059271d6ad3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e259955db614825ac1dcd354f008989 in term 0.
I20260923 17:14:10.805291 14064 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1641961350547788d720cb7d7bebe97" candidate_uuid: "1e259955db614825ac1dcd354f008989" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55f7637537d44ed5a7c2442532af0bcb" is_pre_election: true
I20260923 17:14:10.805436 14064 raft_consensus.cc:2454] T b1641961350547788d720cb7d7bebe97 P 55f7637537d44ed5a7c2442532af0bcb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e259955db614825ac1dcd354f008989 in term 0.
I20260923 17:14:10.805388 14149 leader_election.cc:302] T b1641961350547788d720cb7d7bebe97 P 1e259955db614825ac1dcd354f008989 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e259955db614825ac1dcd354f008989, 85fe4a5ab7914a8abeabe059271d6ad3; no voters:
I20260923 17:14:10.805678 14523 raft_consensus.cc:2781] T b1641961350547788d720cb7d7bebe97 P 1e259955db614825ac1dcd354f008989 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 17:14:10.805756 14523 raft_consensus.cc:482] T b1641961350547788d720cb7d7bebe97 P 1e259955db614825ac1dcd354f008989 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 17:14:10.805787 14523 raft_consensus.cc:3037] T b1641961350547788d720cb7d7bebe97 P 1e259955db614825ac1dcd354f008989 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:10.806893 14523 raft_consensus.cc:504] T b1641961350547788d720cb7d7bebe97 P 1e259955db614825ac1dcd354f008989 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } }
I20260923 17:14:10.807457 14523 leader_election.cc:288] T b1641961350547788d720cb7d7bebe97 P 1e259955db614825ac1dcd354f008989 [CANDIDATE]: Term 1 election: Requested vote from peers 55f7637537d44ed5a7c2442532af0bcb (127.11.229.129:38477), 85fe4a5ab7914a8abeabe059271d6ad3 (127.11.229.131:39649)
I20260923 17:14:10.807827 14064 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1641961350547788d720cb7d7bebe97" candidate_uuid: "1e259955db614825ac1dcd354f008989" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55f7637537d44ed5a7c2442532af0bcb"
I20260923 17:14:10.807997 14064 raft_consensus.cc:3037] T b1641961350547788d720cb7d7bebe97 P 55f7637537d44ed5a7c2442532af0bcb [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:10.807957 14358 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1641961350547788d720cb7d7bebe97" candidate_uuid: "1e259955db614825ac1dcd354f008989" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fe4a5ab7914a8abeabe059271d6ad3"
I20260923 17:14:10.808085 14358 raft_consensus.cc:3037] T b1641961350547788d720cb7d7bebe97 P 85fe4a5ab7914a8abeabe059271d6ad3 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:10.809198 14064 raft_consensus.cc:2454] T b1641961350547788d720cb7d7bebe97 P 55f7637537d44ed5a7c2442532af0bcb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e259955db614825ac1dcd354f008989 in term 1.
I20260923 17:14:10.809198 14358 raft_consensus.cc:2454] T b1641961350547788d720cb7d7bebe97 P 85fe4a5ab7914a8abeabe059271d6ad3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e259955db614825ac1dcd354f008989 in term 1.
I20260923 17:14:10.809648 14152 leader_election.cc:302] T b1641961350547788d720cb7d7bebe97 P 1e259955db614825ac1dcd354f008989 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e259955db614825ac1dcd354f008989, 55f7637537d44ed5a7c2442532af0bcb; no voters:
I20260923 17:14:10.809885 14523 raft_consensus.cc:2781] T b1641961350547788d720cb7d7bebe97 P 1e259955db614825ac1dcd354f008989 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:14:10.810143 14523 raft_consensus.cc:686] T b1641961350547788d720cb7d7bebe97 P 1e259955db614825ac1dcd354f008989 [term 1 LEADER]: Becoming Leader. State: Replica: 1e259955db614825ac1dcd354f008989, State: Running, Role: LEADER
I20260923 17:14:10.810432 14523 consensus_queue.cc:237] T b1641961350547788d720cb7d7bebe97 P 1e259955db614825ac1dcd354f008989 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } }
I20260923 17:14:10.813380 13920 catalog_manager.cc:5495] T b1641961350547788d720cb7d7bebe97 P 1e259955db614825ac1dcd354f008989 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e259955db614825ac1dcd354f008989 (127.11.229.130). New cstate: current_term: 1 leader_uuid: "1e259955db614825ac1dcd354f008989" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } health_report { overall_health: UNKNOWN } } }
I20260923 17:14:10.857985 14531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:10.854016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44256 (local address 127.11.229.130:39275)
0923 17:14:10.854373 (+ 357us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:10.854381 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:10.854396 (+ 15us) server_negotiation.cc:407] Connection header received
0923 17:14:10.854485 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:10.854495 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:10.854549 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:10.854676 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 17:14:10.854955 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:10.855556 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:10.856441 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:10.856680 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:10.856801 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:10.857095 (+ 294us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 17:14:10.857559 (+ 464us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 17:14:10.857690 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:10.857752 (+ 62us) server_negotiation.cc:299] Negotiation successful
0923 17:14:10.857808 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":277,"thread_start_us":91,"threads_started":1}
I20260923 17:14:10.868175 14526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:10.864813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:41789 (local address 127.11.229.129:38477)
0923 17:14:10.864953 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:10.864960 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:10.865084 (+ 124us) server_negotiation.cc:407] Connection header received
0923 17:14:10.865285 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:10.865288 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:10.865341 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:10.865423 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 17:14:10.865685 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:10.866186 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:10.867103 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:10.867329 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:10.867439 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:10.867734 (+ 295us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 17:14:10.867805 (+ 71us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 17:14:10.867880 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:10.867981 (+ 101us) server_negotiation.cc:299] Negotiation successful
0923 17:14:10.868034 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260923 17:14:10.868198 14534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:10.864663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:38477 (local address 127.11.229.130:41789)
0923 17:14:10.865000 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:10.865013 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:10.865134 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:10.865433 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:10.865436 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:10.865443 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0923 17:14:10.865563 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:10.865568 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:10.866346 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:10.866351 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:10.866980 (+ 629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:10.866988 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:10.867452 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:10.867455 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:10.867551 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:10.867592 (+ 41us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0923 17:14:10.867896 (+ 304us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0923 17:14:10.867904 (+ 8us) client_negotiation.cc:769] Sending connection context
0923 17:14:10.867963 (+ 59us) client_negotiation.cc:240] Negotiation successful
0923 17:14:10.868040 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":99,"threads_started":1}
I20260923 17:14:10.874354 14064 raft_consensus.cc:1261] T b1641961350547788d720cb7d7bebe97 P 55f7637537d44ed5a7c2442532af0bcb [term 1 FOLLOWER]: Refusing update from remote peer 1e259955db614825ac1dcd354f008989: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:14:10.874394 14358 raft_consensus.cc:1261] T b1641961350547788d720cb7d7bebe97 P 85fe4a5ab7914a8abeabe059271d6ad3 [term 1 FOLLOWER]: Refusing update from remote peer 1e259955db614825ac1dcd354f008989: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:14:10.874882 14523 consensus_queue.cc:1035] T b1641961350547788d720cb7d7bebe97 P 1e259955db614825ac1dcd354f008989 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:14:10.875085 14528 consensus_queue.cc:1035] T b1641961350547788d720cb7d7bebe97 P 1e259955db614825ac1dcd354f008989 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:14:10.892383 14531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:10.888767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:36453 (local address 127.11.229.130:39275)
0923 17:14:10.888881 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:10.888887 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:10.889073 (+ 186us) server_negotiation.cc:407] Connection header received
0923 17:14:10.889197 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:10.889199 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:10.889238 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:10.889296 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 17:14:10.889473 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:10.889961 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:10.890989 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:10.891321 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:10.891427 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:10.891817 (+ 390us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 17:14:10.891911 (+ 94us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 17:14:10.892023 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:10.892217 (+ 194us) server_negotiation.cc:299] Negotiation successful
0923 17:14:10.892268 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260923 17:14:10.892386 14539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:10.888704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.130:39275 (local address 127.11.229.129:36453)
0923 17:14:10.888974 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:10.888988 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:10.889098 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:10.889302 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:10.889303 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:10.889309 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0923 17:14:10.889393 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:10.889397 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:10.890096 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:10.890098 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:10.890875 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:10.890885 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:10.891426 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:10.891429 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:10.891664 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:10.891702 (+ 38us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0923 17:14:10.892067 (+ 365us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0923 17:14:10.892074 (+ 7us) client_negotiation.cc:769] Sending connection context
0923 17:14:10.892144 (+ 70us) client_negotiation.cc:240] Negotiation successful
0923 17:14:10.892231 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":98,"threads_started":1}
I20260923 17:14:10.914433 13920 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47140:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:14:10.914624 13920 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47140:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:14:10.916908 13920 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4b796d25429e42c8a4f4e266c3a97faa: Sending DeleteTablet for 3 replicas of tablet b1641961350547788d720cb7d7bebe97
I20260923 17:14:10.917518 14058 tablet_service.cc:1514] Processing DeleteTablet for tablet b1641961350547788d720cb7d7bebe97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:14:10 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:44288
I20260923 17:14:10.917555 14198 tablet_service.cc:1514] Processing DeleteTablet for tablet b1641961350547788d720cb7d7bebe97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:14:10 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:44252
I20260923 17:14:10.917711 14507 tablet_replica.cc:330] T b1641961350547788d720cb7d7bebe97 P 55f7637537d44ed5a7c2442532af0bcb: stopping tablet replica
I20260923 17:14:10.917729 14508 tablet_replica.cc:330] T b1641961350547788d720cb7d7bebe97 P 1e259955db614825ac1dcd354f008989: stopping tablet replica
I20260923 17:14:10.917735 14338 tablet_service.cc:1514] Processing DeleteTablet for tablet b1641961350547788d720cb7d7bebe97 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:14:10 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:37226
I20260923 17:14:10.917836 14507 raft_consensus.cc:2229] T b1641961350547788d720cb7d7bebe97 P 55f7637537d44ed5a7c2442532af0bcb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:14:10.917841 14508 raft_consensus.cc:2229] T b1641961350547788d720cb7d7bebe97 P 1e259955db614825ac1dcd354f008989 [term 1 LEADER]: Raft consensus shutting down.
I20260923 17:14:10.917910 14506 tablet_replica.cc:330] T b1641961350547788d720cb7d7bebe97 P 85fe4a5ab7914a8abeabe059271d6ad3: stopping tablet replica
I20260923 17:14:10.917959 14507 raft_consensus.cc:2258] T b1641961350547788d720cb7d7bebe97 P 55f7637537d44ed5a7c2442532af0bcb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:14:10.918008 14506 raft_consensus.cc:2229] T b1641961350547788d720cb7d7bebe97 P 85fe4a5ab7914a8abeabe059271d6ad3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:14:10.918113 14506 raft_consensus.cc:2258] T b1641961350547788d720cb7d7bebe97 P 85fe4a5ab7914a8abeabe059271d6ad3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:14:10.918159 14508 raft_consensus.cc:2258] T b1641961350547788d720cb7d7bebe97 P 1e259955db614825ac1dcd354f008989 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:14:10.918974 14508 ts_tablet_manager.cc:1905] T b1641961350547788d720cb7d7bebe97 P 1e259955db614825ac1dcd354f008989: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:14:10.918985 14506 ts_tablet_manager.cc:1905] T b1641961350547788d720cb7d7bebe97 P 85fe4a5ab7914a8abeabe059271d6ad3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:14:10.919477 13920 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47140:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 17:14:10.919888 13920 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 17:14:10.921644 14508 ts_tablet_manager.cc:1918] T b1641961350547788d720cb7d7bebe97 P 1e259955db614825ac1dcd354f008989: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 17:14:10.921711 14508 log.cc:1196] T b1641961350547788d720cb7d7bebe97 P 1e259955db614825ac1dcd354f008989: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-1/wal/wals/b1641961350547788d720cb7d7bebe97
I20260923 17:14:10.921715 14506 ts_tablet_manager.cc:1918] T b1641961350547788d720cb7d7bebe97 P 85fe4a5ab7914a8abeabe059271d6ad3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 17:14:10.921782 14506 log.cc:1196] T b1641961350547788d720cb7d7bebe97 P 85fe4a5ab7914a8abeabe059271d6ad3: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-2/wal/wals/b1641961350547788d720cb7d7bebe97
I20260923 17:14:10.921983 14508 ts_tablet_manager.cc:1939] T b1641961350547788d720cb7d7bebe97 P 1e259955db614825ac1dcd354f008989: Deleting consensus metadata
I20260923 17:14:10.922043 14506 ts_tablet_manager.cc:1939] T b1641961350547788d720cb7d7bebe97 P 85fe4a5ab7914a8abeabe059271d6ad3: Deleting consensus metadata
I20260923 17:14:10.922896 13905 catalog_manager.cc:4841] TS 85fe4a5ab7914a8abeabe059271d6ad3 (127.11.229.131:39649): tablet b1641961350547788d720cb7d7bebe97 (table test-table [id=51e08c0255ab40278fd9c9b8b7dc9157]) successfully deleted
I20260923 17:14:10.923749 13906 catalog_manager.cc:4841] TS 1e259955db614825ac1dcd354f008989 (127.11.229.130:39275): tablet b1641961350547788d720cb7d7bebe97 (table test-table [id=51e08c0255ab40278fd9c9b8b7dc9157]) successfully deleted
I20260923 17:14:10.924813 14058 tablet_service.cc:1467] Processing CreateTablet for tablet 2c2ba2753ec9485eb1a8642a8f83d257 (DEFAULT_TABLE table=test-table [id=74b954df1c224eaea0a3fffa4ed2fd38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:14:10.925091 14058 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c2ba2753ec9485eb1a8642a8f83d257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:10.925094 14338 tablet_service.cc:1467] Processing CreateTablet for tablet 2c2ba2753ec9485eb1a8642a8f83d257 (DEFAULT_TABLE table=test-table [id=74b954df1c224eaea0a3fffa4ed2fd38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:14:10.925175 14198 tablet_service.cc:1467] Processing CreateTablet for tablet 2c2ba2753ec9485eb1a8642a8f83d257 (DEFAULT_TABLE table=test-table [id=74b954df1c224eaea0a3fffa4ed2fd38]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:14:10.925331 14338 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c2ba2753ec9485eb1a8642a8f83d257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:10.925374 14198 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c2ba2753ec9485eb1a8642a8f83d257. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:10.927572 14517 tablet_bootstrap.cc:492] T 2c2ba2753ec9485eb1a8642a8f83d257 P 85fe4a5ab7914a8abeabe059271d6ad3: Bootstrap starting.
I20260923 17:14:10.927583 14520 tablet_bootstrap.cc:492] T 2c2ba2753ec9485eb1a8642a8f83d257 P 55f7637537d44ed5a7c2442532af0bcb: Bootstrap starting.
I20260923 17:14:10.928385 14517 tablet_bootstrap.cc:654] T 2c2ba2753ec9485eb1a8642a8f83d257 P 85fe4a5ab7914a8abeabe059271d6ad3: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:10.928385 14520 tablet_bootstrap.cc:654] T 2c2ba2753ec9485eb1a8642a8f83d257 P 55f7637537d44ed5a7c2442532af0bcb: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:10.928926 14518 tablet_bootstrap.cc:492] T 2c2ba2753ec9485eb1a8642a8f83d257 P 1e259955db614825ac1dcd354f008989: Bootstrap starting.
I20260923 17:14:10.929872 14518 tablet_bootstrap.cc:654] T 2c2ba2753ec9485eb1a8642a8f83d257 P 1e259955db614825ac1dcd354f008989: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:10.929915 14520 tablet_bootstrap.cc:492] T 2c2ba2753ec9485eb1a8642a8f83d257 P 55f7637537d44ed5a7c2442532af0bcb: No bootstrap required, opened a new log
I20260923 17:14:10.929991 14520 ts_tablet_manager.cc:1397] T 2c2ba2753ec9485eb1a8642a8f83d257 P 55f7637537d44ed5a7c2442532af0bcb: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260923 17:14:10.930439 14507 ts_tablet_manager.cc:1905] T b1641961350547788d720cb7d7bebe97 P 55f7637537d44ed5a7c2442532af0bcb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:14:10.930451 14520 raft_consensus.cc:348] T 2c2ba2753ec9485eb1a8642a8f83d257 P 55f7637537d44ed5a7c2442532af0bcb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } }
I20260923 17:14:10.930614 14520 raft_consensus.cc:374] T 2c2ba2753ec9485eb1a8642a8f83d257 P 55f7637537d44ed5a7c2442532af0bcb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:10.930652 14520 raft_consensus.cc:729] T 2c2ba2753ec9485eb1a8642a8f83d257 P 55f7637537d44ed5a7c2442532af0bcb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55f7637537d44ed5a7c2442532af0bcb, State: Initialized, Role: FOLLOWER
I20260923 17:14:10.930778 14520 consensus_queue.cc:260] T 2c2ba2753ec9485eb1a8642a8f83d257 P 55f7637537d44ed5a7c2442532af0bcb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } }
I20260923 17:14:10.931074 14520 ts_tablet_manager.cc:1428] T 2c2ba2753ec9485eb1a8642a8f83d257 P 55f7637537d44ed5a7c2442532af0bcb: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260923 17:14:10.931252 14518 tablet_bootstrap.cc:492] T 2c2ba2753ec9485eb1a8642a8f83d257 P 1e259955db614825ac1dcd354f008989: No bootstrap required, opened a new log
I20260923 17:14:10.931324 14518 ts_tablet_manager.cc:1397] T 2c2ba2753ec9485eb1a8642a8f83d257 P 1e259955db614825ac1dcd354f008989: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260923 17:14:10.931723 14518 raft_consensus.cc:348] T 2c2ba2753ec9485eb1a8642a8f83d257 P 1e259955db614825ac1dcd354f008989 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } }
I20260923 17:14:10.931828 14518 raft_consensus.cc:374] T 2c2ba2753ec9485eb1a8642a8f83d257 P 1e259955db614825ac1dcd354f008989 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:10.931864 14518 raft_consensus.cc:729] T 2c2ba2753ec9485eb1a8642a8f83d257 P 1e259955db614825ac1dcd354f008989 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e259955db614825ac1dcd354f008989, State: Initialized, Role: FOLLOWER
I20260923 17:14:10.931975 14518 consensus_queue.cc:260] T 2c2ba2753ec9485eb1a8642a8f83d257 P 1e259955db614825ac1dcd354f008989 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } }
I20260923 17:14:10.932305 14518 ts_tablet_manager.cc:1428] T 2c2ba2753ec9485eb1a8642a8f83d257 P 1e259955db614825ac1dcd354f008989: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260923 17:14:10.933409 14517 tablet_bootstrap.cc:492] T 2c2ba2753ec9485eb1a8642a8f83d257 P 85fe4a5ab7914a8abeabe059271d6ad3: No bootstrap required, opened a new log
I20260923 17:14:10.933506 14517 ts_tablet_manager.cc:1397] T 2c2ba2753ec9485eb1a8642a8f83d257 P 85fe4a5ab7914a8abeabe059271d6ad3: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260923 17:14:10.933913 14517 raft_consensus.cc:348] T 2c2ba2753ec9485eb1a8642a8f83d257 P 85fe4a5ab7914a8abeabe059271d6ad3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } }
I20260923 17:14:10.934026 14517 raft_consensus.cc:374] T 2c2ba2753ec9485eb1a8642a8f83d257 P 85fe4a5ab7914a8abeabe059271d6ad3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:10.934056 14517 raft_consensus.cc:729] T 2c2ba2753ec9485eb1a8642a8f83d257 P 85fe4a5ab7914a8abeabe059271d6ad3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85fe4a5ab7914a8abeabe059271d6ad3, State: Initialized, Role: FOLLOWER
I20260923 17:14:10.934168 14517 consensus_queue.cc:260] T 2c2ba2753ec9485eb1a8642a8f83d257 P 85fe4a5ab7914a8abeabe059271d6ad3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } }
I20260923 17:14:10.934465 14517 ts_tablet_manager.cc:1428] T 2c2ba2753ec9485eb1a8642a8f83d257 P 85fe4a5ab7914a8abeabe059271d6ad3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260923 17:14:10.934695 14507 ts_tablet_manager.cc:1918] T b1641961350547788d720cb7d7bebe97 P 55f7637537d44ed5a7c2442532af0bcb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 17:14:10.934777 14507 log.cc:1196] T b1641961350547788d720cb7d7bebe97 P 55f7637537d44ed5a7c2442532af0bcb: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-0/wal/wals/b1641961350547788d720cb7d7bebe97
I20260923 17:14:10.935045 14507 ts_tablet_manager.cc:1939] T b1641961350547788d720cb7d7bebe97 P 55f7637537d44ed5a7c2442532af0bcb: Deleting consensus metadata
I20260923 17:14:10.935779 13908 catalog_manager.cc:4841] TS 55f7637537d44ed5a7c2442532af0bcb (127.11.229.129:38477): tablet b1641961350547788d720cb7d7bebe97 (table test-table [id=51e08c0255ab40278fd9c9b8b7dc9157]) successfully deleted
I20260923 17:14:11.034405 14528 raft_consensus.cc:482] T 2c2ba2753ec9485eb1a8642a8f83d257 P 1e259955db614825ac1dcd354f008989 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 17:14:11.034570 14528 raft_consensus.cc:504] T 2c2ba2753ec9485eb1a8642a8f83d257 P 1e259955db614825ac1dcd354f008989 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } }
I20260923 17:14:11.035087 14528 leader_election.cc:288] T 2c2ba2753ec9485eb1a8642a8f83d257 P 1e259955db614825ac1dcd354f008989 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 55f7637537d44ed5a7c2442532af0bcb (127.11.229.129:38477), 85fe4a5ab7914a8abeabe059271d6ad3 (127.11.229.131:39649)
I20260923 17:14:11.035508 14064 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c2ba2753ec9485eb1a8642a8f83d257" candidate_uuid: "1e259955db614825ac1dcd354f008989" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55f7637537d44ed5a7c2442532af0bcb" is_pre_election: true
I20260923 17:14:11.035548 14357 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c2ba2753ec9485eb1a8642a8f83d257" candidate_uuid: "1e259955db614825ac1dcd354f008989" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" is_pre_election: true
I20260923 17:14:11.035671 14064 raft_consensus.cc:2454] T 2c2ba2753ec9485eb1a8642a8f83d257 P 55f7637537d44ed5a7c2442532af0bcb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e259955db614825ac1dcd354f008989 in term 0.
I20260923 17:14:11.035701 14357 raft_consensus.cc:2454] T 2c2ba2753ec9485eb1a8642a8f83d257 P 85fe4a5ab7914a8abeabe059271d6ad3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e259955db614825ac1dcd354f008989 in term 0.
I20260923 17:14:11.036024 14149 leader_election.cc:302] T 2c2ba2753ec9485eb1a8642a8f83d257 P 1e259955db614825ac1dcd354f008989 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e259955db614825ac1dcd354f008989, 85fe4a5ab7914a8abeabe059271d6ad3; no voters:
I20260923 17:14:11.036284 14528 raft_consensus.cc:2781] T 2c2ba2753ec9485eb1a8642a8f83d257 P 1e259955db614825ac1dcd354f008989 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 17:14:11.036355 14528 raft_consensus.cc:482] T 2c2ba2753ec9485eb1a8642a8f83d257 P 1e259955db614825ac1dcd354f008989 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 17:14:11.036394 14528 raft_consensus.cc:3037] T 2c2ba2753ec9485eb1a8642a8f83d257 P 1e259955db614825ac1dcd354f008989 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:11.037732 14528 raft_consensus.cc:504] T 2c2ba2753ec9485eb1a8642a8f83d257 P 1e259955db614825ac1dcd354f008989 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } }
I20260923 17:14:11.038110 14528 leader_election.cc:288] T 2c2ba2753ec9485eb1a8642a8f83d257 P 1e259955db614825ac1dcd354f008989 [CANDIDATE]: Term 1 election: Requested vote from peers 55f7637537d44ed5a7c2442532af0bcb (127.11.229.129:38477), 85fe4a5ab7914a8abeabe059271d6ad3 (127.11.229.131:39649)
I20260923 17:14:11.038508 14357 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c2ba2753ec9485eb1a8642a8f83d257" candidate_uuid: "1e259955db614825ac1dcd354f008989" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "85fe4a5ab7914a8abeabe059271d6ad3"
I20260923 17:14:11.038647 14357 raft_consensus.cc:3037] T 2c2ba2753ec9485eb1a8642a8f83d257 P 85fe4a5ab7914a8abeabe059271d6ad3 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:11.039861 14357 raft_consensus.cc:2454] T 2c2ba2753ec9485eb1a8642a8f83d257 P 85fe4a5ab7914a8abeabe059271d6ad3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e259955db614825ac1dcd354f008989 in term 1.
I20260923 17:14:11.040127 14064 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c2ba2753ec9485eb1a8642a8f83d257" candidate_uuid: "1e259955db614825ac1dcd354f008989" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55f7637537d44ed5a7c2442532af0bcb"
I20260923 17:14:11.040171 14149 leader_election.cc:302] T 2c2ba2753ec9485eb1a8642a8f83d257 P 1e259955db614825ac1dcd354f008989 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e259955db614825ac1dcd354f008989, 85fe4a5ab7914a8abeabe059271d6ad3; no voters:
I20260923 17:14:11.040275 14064 raft_consensus.cc:3037] T 2c2ba2753ec9485eb1a8642a8f83d257 P 55f7637537d44ed5a7c2442532af0bcb [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:11.040364 14528 raft_consensus.cc:2781] T 2c2ba2753ec9485eb1a8642a8f83d257 P 1e259955db614825ac1dcd354f008989 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:14:11.040447 14528 raft_consensus.cc:686] T 2c2ba2753ec9485eb1a8642a8f83d257 P 1e259955db614825ac1dcd354f008989 [term 1 LEADER]: Becoming Leader. State: Replica: 1e259955db614825ac1dcd354f008989, State: Running, Role: LEADER
I20260923 17:14:11.040591 14528 consensus_queue.cc:237] T 2c2ba2753ec9485eb1a8642a8f83d257 P 1e259955db614825ac1dcd354f008989 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } } peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } }
I20260923 17:14:11.041533 14064 raft_consensus.cc:2454] T 2c2ba2753ec9485eb1a8642a8f83d257 P 55f7637537d44ed5a7c2442532af0bcb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e259955db614825ac1dcd354f008989 in term 1.
I20260923 17:14:11.042641 13920 catalog_manager.cc:5495] T 2c2ba2753ec9485eb1a8642a8f83d257 P 1e259955db614825ac1dcd354f008989 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e259955db614825ac1dcd354f008989 (127.11.229.130). New cstate: current_term: 1 leader_uuid: "1e259955db614825ac1dcd354f008989" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e259955db614825ac1dcd354f008989" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 39275 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 } health_report { overall_health: UNKNOWN } } }
I20260923 17:14:11.074571 14358 raft_consensus.cc:1261] T 2c2ba2753ec9485eb1a8642a8f83d257 P 85fe4a5ab7914a8abeabe059271d6ad3 [term 1 FOLLOWER]: Refusing update from remote peer 1e259955db614825ac1dcd354f008989: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:14:11.074707 14064 raft_consensus.cc:1261] T 2c2ba2753ec9485eb1a8642a8f83d257 P 55f7637537d44ed5a7c2442532af0bcb [term 1 FOLLOWER]: Refusing update from remote peer 1e259955db614825ac1dcd354f008989: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:14:11.075129 14523 consensus_queue.cc:1035] T 2c2ba2753ec9485eb1a8642a8f83d257 P 1e259955db614825ac1dcd354f008989 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55f7637537d44ed5a7c2442532af0bcb" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:14:11.075295 14528 consensus_queue.cc:1035] T 2c2ba2753ec9485eb1a8642a8f83d257 P 1e259955db614825ac1dcd354f008989 [LEADER]: Connected to new peer: Peer: permanent_uuid: "85fe4a5ab7914a8abeabe059271d6ad3" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39649 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260923 17:14:11.088515 14489 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260923 17:14:12.642935 13919 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47140:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:14:12.643162 13919 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47140:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:14:12.645967 13919 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4b796d25429e42c8a4f4e266c3a97faa: Sending DeleteTablet for 3 replicas of tablet 2c2ba2753ec9485eb1a8642a8f83d257
I20260923 17:14:12.646777 14058 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c2ba2753ec9485eb1a8642a8f83d257 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:14:12 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:44288
I20260923 17:14:12.646878 14198 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c2ba2753ec9485eb1a8642a8f83d257 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:14:12 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:44252
I20260923 17:14:12.646895 14338 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c2ba2753ec9485eb1a8642a8f83d257 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:14:12 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:37226
I20260923 17:14:12.647214 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 13993
I20260923 17:14:12.648366 14569 tablet_replica.cc:330] T 2c2ba2753ec9485eb1a8642a8f83d257 P 1e259955db614825ac1dcd354f008989: stopping tablet replica
I20260923 17:14:12.648550 14569 raft_consensus.cc:2229] T 2c2ba2753ec9485eb1a8642a8f83d257 P 1e259955db614825ac1dcd354f008989 [term 1 LEADER]: Raft consensus shutting down.
I20260923 17:14:12.648777 14569 raft_consensus.cc:2258] T 2c2ba2753ec9485eb1a8642a8f83d257 P 1e259955db614825ac1dcd354f008989 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:14:12.649487 14569 ts_tablet_manager.cc:1905] T 2c2ba2753ec9485eb1a8642a8f83d257 P 1e259955db614825ac1dcd354f008989: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:14:12.651849 14569 ts_tablet_manager.cc:1918] T 2c2ba2753ec9485eb1a8642a8f83d257 P 1e259955db614825ac1dcd354f008989: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260923 17:14:12.651921 14569 log.cc:1196] T 2c2ba2753ec9485eb1a8642a8f83d257 P 1e259955db614825ac1dcd354f008989: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-1/wal/wals/2c2ba2753ec9485eb1a8642a8f83d257
I20260923 17:14:12.652216 14569 ts_tablet_manager.cc:1939] T 2c2ba2753ec9485eb1a8642a8f83d257 P 1e259955db614825ac1dcd354f008989: Deleting consensus metadata
I20260923 17:14:12.652498 14570 tablet_replica.cc:330] T 2c2ba2753ec9485eb1a8642a8f83d257 P 85fe4a5ab7914a8abeabe059271d6ad3: stopping tablet replica
I20260923 17:14:12.652765 14570 raft_consensus.cc:2229] T 2c2ba2753ec9485eb1a8642a8f83d257 P 85fe4a5ab7914a8abeabe059271d6ad3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:14:12.652907 14570 raft_consensus.cc:2258] T 2c2ba2753ec9485eb1a8642a8f83d257 P 85fe4a5ab7914a8abeabe059271d6ad3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:14:12.653331 13906 catalog_manager.cc:4841] TS 1e259955db614825ac1dcd354f008989 (127.11.229.130:39275): tablet 2c2ba2753ec9485eb1a8642a8f83d257 (table test-table [id=74b954df1c224eaea0a3fffa4ed2fd38]) successfully deleted
I20260923 17:14:12.653677 14570 ts_tablet_manager.cc:1905] T 2c2ba2753ec9485eb1a8642a8f83d257 P 85fe4a5ab7914a8abeabe059271d6ad3: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 17:14:12.655625 13908 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.229.129:38477 (error 108)
I20260923 17:14:12.655886 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 14133
I20260923 17:14:12.657228 14570 ts_tablet_manager.cc:1918] T 2c2ba2753ec9485eb1a8642a8f83d257 P 85fe4a5ab7914a8abeabe059271d6ad3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260923 17:14:12.657286 14570 log.cc:1196] T 2c2ba2753ec9485eb1a8642a8f83d257 P 85fe4a5ab7914a8abeabe059271d6ad3: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790183633736342-12182-0/minicluster-data/ts-2/wal/wals/2c2ba2753ec9485eb1a8642a8f83d257
I20260923 17:14:12.657495 14570 ts_tablet_manager.cc:1939] T 2c2ba2753ec9485eb1a8642a8f83d257 P 85fe4a5ab7914a8abeabe059271d6ad3: Deleting consensus metadata
I20260923 17:14:12.658684 14572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:12.657713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:38477 (local address 127.0.0.1:55738)
0923 17:14:12.658265 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:12.658566 (+ 301us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.129:38477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":100,"threads_started":1}
W20260923 17:14:12.658849 13908 catalog_manager.cc:4584] TS 55f7637537d44ed5a7c2442532af0bcb (127.11.229.129:38477): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2c2ba2753ec9485eb1a8642a8f83d257: Network error: Client connection negotiation failed: client connection to 127.11.229.129:38477: connect: Connection refused (error 111)
I20260923 17:14:12.658954 13905 catalog_manager.cc:4841] TS 85fe4a5ab7914a8abeabe059271d6ad3 (127.11.229.131:39649): tablet 2c2ba2753ec9485eb1a8642a8f83d257 (table test-table [id=74b954df1c224eaea0a3fffa4ed2fd38]) successfully deleted
I20260923 17:14:12.663775 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 14273
I20260923 17:14:12.670624 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 13889
2026-09-23T17:14:12Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6576 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 17:14:12 dist-test-slave-1x1f krb5kdc[14575](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 17:14:12 dist-test-slave-1x1f krb5kdc[14575](info): set up 2 sockets
Sep 23 17:14:12 dist-test-slave-1x1f krb5kdc[14575](info): commencing operation
krb5kdc: starting...
W20260923 17:14:13.762758 12182 mini_kdc.cc:121] Time spent starting KDC: real 1.069s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Sep 23 17:14:13 dist-test-slave-1x1f krb5kdc[14575](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183653, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T17:14:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:14:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.229.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
I20260923 17:14:13.895382 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:39405
--webserver_interface=127.11.229.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:33529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:39405
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:14:14.012960 14588 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:14.013249 14588 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:14.013291 14588 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:14.017484 14588 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:14:14.017563 14588 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:14.017583 14588 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:14.017601 14588 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:14:14.017616 14588 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:14:14.023283 14588 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:33529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:39405
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:39405
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.229.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14588
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:14.024502 14588 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:14.025558 14588 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:14.035661 14594 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:14.035652 14588 server_base.cc:1034] running on GCE node
W20260923 17:14:14.035643 14596 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:14.035859 14593 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:14.036692 14588 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:14.037822 14588 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:14.039038 14588 hybrid_clock.cc:648] HybridClock initialized: now 1790183654038998 us; error 56 us; skew 500 ppm
Sep 23 17:14:14 dist-test-slave-1x1f krb5kdc[14575](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183654, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:14.042639 14588 init.cc:377] Logged in from keytab as kudu/127.11.229.190@KRBTEST.COM (short username kudu)
I20260923 17:14:14.043723 14588 webserver.cc:460] Webserver started at http://127.11.229.190:45073/ using document root <none> and password file <none>
I20260923 17:14:14.044370 14588 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:14.044476 14588 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:14.044732 14588 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:14.047147 14588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "9862acf28a6840be96ea6d031b2b9d22"
format_stamp: "Formatted at 2026-09-23 17:14:14 on dist-test-slave-1x1f"
server_key: "2e5387520cb6c5eab38527d513fd6f1f"
server_key_iv: "d73d2faef7d509d617057292349e0cbe"
server_key_version: "encryptionkey@0"
I20260923 17:14:14.047748 14588 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "9862acf28a6840be96ea6d031b2b9d22"
format_stamp: "Formatted at 2026-09-23 17:14:14 on dist-test-slave-1x1f"
server_key: "2e5387520cb6c5eab38527d513fd6f1f"
server_key_iv: "d73d2faef7d509d617057292349e0cbe"
server_key_version: "encryptionkey@0"
I20260923 17:14:14.051931 14588 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260923 17:14:14.054679 14603 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:14.056406 14588 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 17:14:14.056595 14588 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "9862acf28a6840be96ea6d031b2b9d22"
format_stamp: "Formatted at 2026-09-23 17:14:14 on dist-test-slave-1x1f"
server_key: "2e5387520cb6c5eab38527d513fd6f1f"
server_key_iv: "d73d2faef7d509d617057292349e0cbe"
server_key_version: "encryptionkey@0"
I20260923 17:14:14.056746 14588 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:14.082147 14588 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:14.085695 14588 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:14.085928 14588 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:14.093227 14588 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.190:39405
I20260923 17:14:14.093250 14655 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.190:39405 every 8 connection(s)
I20260923 17:14:14.094214 14588 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:14:14.097110 14656 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:14.102618 14656 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9862acf28a6840be96ea6d031b2b9d22: Bootstrap starting.
I20260923 17:14:14.102813 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 14588
I20260923 17:14:14.102936 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:14:14.103241 12182 external_mini_cluster.cc:1428] Setting key 0479ad78269cefc099af0dff39d74535
I20260923 17:14:14.105399 14656 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9862acf28a6840be96ea6d031b2b9d22: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:14.106312 14656 log.cc:824] T 00000000000000000000000000000000 P 9862acf28a6840be96ea6d031b2b9d22: Log is configured to *not* fsync() on all Append() calls
I20260923 17:14:14.108615 14656 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9862acf28a6840be96ea6d031b2b9d22: No bootstrap required, opened a new log
I20260923 17:14:14.112679 14656 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9862acf28a6840be96ea6d031b2b9d22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9862acf28a6840be96ea6d031b2b9d22" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 39405 } }
I20260923 17:14:14.112931 14656 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9862acf28a6840be96ea6d031b2b9d22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
Sep 23 17:14:14 dist-test-slave-1x1f krb5kdc[14575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183653, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:14:14.113018 14656 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9862acf28a6840be96ea6d031b2b9d22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9862acf28a6840be96ea6d031b2b9d22, State: Initialized, Role: FOLLOWER
I20260923 17:14:14.113473 14656 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9862acf28a6840be96ea6d031b2b9d22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9862acf28a6840be96ea6d031b2b9d22" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 39405 } }
I20260923 17:14:14.113624 14656 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9862acf28a6840be96ea6d031b2b9d22 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:14:14.113695 14656 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9862acf28a6840be96ea6d031b2b9d22 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:14:14.113801 14656 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9862acf28a6840be96ea6d031b2b9d22 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:14.114802 14656 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9862acf28a6840be96ea6d031b2b9d22 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9862acf28a6840be96ea6d031b2b9d22" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 39405 } }
I20260923 17:14:14.115216 14656 leader_election.cc:302] T 00000000000000000000000000000000 P 9862acf28a6840be96ea6d031b2b9d22 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9862acf28a6840be96ea6d031b2b9d22; no voters:
I20260923 17:14:14.115576 14656 leader_election.cc:288] T 00000000000000000000000000000000 P 9862acf28a6840be96ea6d031b2b9d22 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 17:14:14.115676 14661 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9862acf28a6840be96ea6d031b2b9d22 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:14:14.115902 14661 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9862acf28a6840be96ea6d031b2b9d22 [term 1 LEADER]: Becoming Leader. State: Replica: 9862acf28a6840be96ea6d031b2b9d22, State: Running, Role: LEADER
I20260923 17:14:14.116295 14661 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9862acf28a6840be96ea6d031b2b9d22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9862acf28a6840be96ea6d031b2b9d22" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 39405 } }
I20260923 17:14:14.117036 14656 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9862acf28a6840be96ea6d031b2b9d22 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:14:14.118032 14663 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9862acf28a6840be96ea6d031b2b9d22 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9862acf28a6840be96ea6d031b2b9d22. Latest consensus state: current_term: 1 leader_uuid: "9862acf28a6840be96ea6d031b2b9d22" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9862acf28a6840be96ea6d031b2b9d22" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 39405 } } }
I20260923 17:14:14.118150 14663 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9862acf28a6840be96ea6d031b2b9d22 [sys.catalog]: This master's current role is: LEADER
I20260923 17:14:14.119675 14662 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9862acf28a6840be96ea6d031b2b9d22 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9862acf28a6840be96ea6d031b2b9d22" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9862acf28a6840be96ea6d031b2b9d22" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 39405 } } }
I20260923 17:14:14.119765 14662 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9862acf28a6840be96ea6d031b2b9d22 [sys.catalog]: This master's current role is: LEADER
I20260923 17:14:14.119814 14659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:14.104715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59260 (local address 127.11.229.190:39405)
0923 17:14:14.105143 (+ 428us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:14.105163 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:14.105206 (+ 43us) server_negotiation.cc:407] Connection header received
0923 17:14:14.106076 (+ 870us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:14.106101 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:14.106562 (+ 461us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:14.106907 (+ 345us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:14.107746 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:14.109246 (+ 1500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:14.110168 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:14.110911 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:14.111080 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:14.113706 (+ 2626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:14.113714 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:14.113732 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:14.113769 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:14.116151 (+ 2382us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:14.116650 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:14.116657 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:14.116663 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:14.116803 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:14.117146 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:14.117151 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:14.117152 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:14.117649 (+ 497us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:14.117847 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:14.118548 (+ 701us) server_negotiation.cc:299] Negotiation successful
0923 17:14:14.118844 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":279,"thread_start_us":120,"threads_started":1}
W20260923 17:14:14.122396 14676 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9862acf28a6840be96ea6d031b2b9d22: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 17:14:14.122481 14676 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 17:14:14.122545 14670 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:14:14.123209 14670 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:14:14.129298 14670 catalog_manager.cc:1347] Generated new cluster ID: 6fb620bf682d4444b40b406f7e17c936
I20260923 17:14:14.129376 14670 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:14:14.150274 14670 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:14:14.151280 14670 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:14:14.161284 14670 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9862acf28a6840be96ea6d031b2b9d22: Generated new TSK 0
I20260923 17:14:14.162410 14670 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.229.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab.
Entry for principal kudu/127.11.229.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab.
I20260923 17:14:14.195948 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.129:0
--local_ip_for_outbound_sockets=127.11.229.129
--webserver_interface=127.11.229.129
--webserver_port=0
--tserver_master_addrs=127.11.229.190:39405
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab
--principal=kudu/127.11.229.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:33529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:14:14.349491 14682 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:14.349807 14682 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:14.349851 14682 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:14.353876 14682 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:14.353946 14682 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:14.354012 14682 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.129
I20260923 17:14:14.359311 14682 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:33529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab
--principal=kudu/127.11.229.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.229.129
--webserver_port=0
--tserver_master_addrs=127.11.229.190:39405
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14682
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.129
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:14.360419 14682 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:14.361572 14682 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:14.371865 14690 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:14.372033 14682 server_base.cc:1034] running on GCE node
W20260923 17:14:14.371888 14687 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:14.371865 14688 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:14.372701 14682 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:14.373462 14682 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:14.374635 14682 hybrid_clock.cc:648] HybridClock initialized: now 1790183654374620 us; error 29 us; skew 500 ppm
Sep 23 17:14:14 dist-test-slave-1x1f krb5kdc[14575](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183654, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:14.377573 14682 init.cc:377] Logged in from keytab as kudu/127.11.229.129@KRBTEST.COM (short username kudu)
I20260923 17:14:14.378584 14682 webserver.cc:460] Webserver started at http://127.11.229.129:43205/ using document root <none> and password file <none>
I20260923 17:14:14.379215 14682 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:14.379315 14682 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:14.379570 14682 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:14.381773 14682 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-0/data/instance:
uuid: "0945e9e1a7bf44d99a8dbca059921a70"
format_stamp: "Formatted at 2026-09-23 17:14:14 on dist-test-slave-1x1f"
server_key: "1df28da66aa716759a71ae07e7f1db0a"
server_key_iv: "5bc2652b5503a000ade824f83a774412"
server_key_version: "encryptionkey@0"
I20260923 17:14:14.382458 14682 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance:
uuid: "0945e9e1a7bf44d99a8dbca059921a70"
format_stamp: "Formatted at 2026-09-23 17:14:14 on dist-test-slave-1x1f"
server_key: "1df28da66aa716759a71ae07e7f1db0a"
server_key_iv: "5bc2652b5503a000ade824f83a774412"
server_key_version: "encryptionkey@0"
I20260923 17:14:14.386538 14682 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260923 17:14:14.389359 14697 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:14.390738 14682 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 17:14:14.390877 14682 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-0/wal
uuid: "0945e9e1a7bf44d99a8dbca059921a70"
format_stamp: "Formatted at 2026-09-23 17:14:14 on dist-test-slave-1x1f"
server_key: "1df28da66aa716759a71ae07e7f1db0a"
server_key_iv: "5bc2652b5503a000ade824f83a774412"
server_key_version: "encryptionkey@0"
I20260923 17:14:14.390991 14682 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:14.407356 14682 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:14.410830 14682 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:14.411054 14682 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:14.411672 14682 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:14:14.412508 14682 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:14:14.412577 14682 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:14.412648 14682 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:14:14.412698 14682 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:14.422156 14682 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.129:39033
I20260923 17:14:14.422283 14810 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.129:39033 every 8 connection(s)
I20260923 17:14:14.423105 14682 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
I20260923 17:14:14.425550 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 14682
I20260923 17:14:14.425696 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance
I20260923 17:14:14.425977 12182 external_mini_cluster.cc:1428] Setting key 37d8a78c408d3c5fb05b842dcddbf120
Sep 23 17:14:14 dist-test-slave-1x1f krb5kdc[14575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183654, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.129@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.229.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.130@KRBTEST.COM" created.
I20260923 17:14:14.439585 14659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:14.425374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:54903 (local address 127.11.229.190:39405)
0923 17:14:14.425556 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:14.425561 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:14.426504 (+ 943us) server_negotiation.cc:407] Connection header received
0923 17:14:14.427809 (+ 1305us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:14.427815 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:14.427877 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:14.427966 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:14.429343 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:14.429875 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:14.431761 (+ 1886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:14.432002 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:14.432085 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:14.435309 (+ 3224us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:14.435312 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:14.435314 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:14.435340 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:14.437178 (+ 1838us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:14.437745 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:14.437748 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:14.437750 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:14.437847 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:14.438268 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:14.438271 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:14.438273 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:14.438578 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:14.438703 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:14.439281 (+ 578us) server_negotiation.cc:299] Negotiation successful
0923 17:14:14.439415 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260923 17:14:14.440557 14813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:14.425831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:39405 (local address 127.11.229.129:54903)
0923 17:14:14.426335 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:14.426388 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:14.427599 (+ 1211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:14.428130 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:14.428136 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:14.428509 (+ 373us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:14.429173 (+ 664us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:14.429196 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:14.430015 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:14.430021 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:14.431634 (+ 1613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:14.431648 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:14.432167 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:14.432174 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:14.432414 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:14.433101 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:14.433128 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:14.435096 (+ 1968us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:14.437323 (+ 2227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:14.437331 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:14.437349 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:14.437628 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:14.437954 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:14.437959 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:14.437961 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:14.438118 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:14.438705 (+ 587us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:14.438715 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:14.438999 (+ 284us) client_negotiation.cc:769] Sending connection context
0923 17:14:14.439227 (+ 228us) client_negotiation.cc:240] Negotiation successful
0923 17:14:14.439582 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":133,"threads_started":1}
I20260923 17:14:14.441995 14811 heartbeater.cc:347] Connected to a master server at 127.11.229.190:39405
I20260923 17:14:14.442374 14811 heartbeater.cc:464] Registering TS with master...
I20260923 17:14:14.442972 14811 heartbeater.cc:511] Master 127.11.229.190:39405 requested a full tablet report, sending...
I20260923 17:14:14.444784 14620 ts_manager.cc:194] Registered new tserver with Master: 0945e9e1a7bf44d99a8dbca059921a70 (127.11.229.129:39033)
I20260923 17:14:14.445953 14620 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.129@KRBTEST.COM'} at 127.11.229.129:54903
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab.
Entry for principal kudu/127.11.229.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab.
I20260923 17:14:14.459805 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.130:0
--local_ip_for_outbound_sockets=127.11.229.130
--webserver_interface=127.11.229.130
--webserver_port=0
--tserver_master_addrs=127.11.229.190:39405
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab
--principal=kudu/127.11.229.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:33529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:14:14.573746 14816 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:14.574034 14816 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:14.574091 14816 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:14.578204 14816 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:14.578332 14816 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:14.578395 14816 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.130
I20260923 17:14:14.583673 14816 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:33529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab
--principal=kudu/127.11.229.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.229.130
--webserver_port=0
--tserver_master_addrs=127.11.229.190:39405
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14816
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.130
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:14.584692 14816 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:14.585654 14816 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:14.595578 14824 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:14.595677 14821 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:14.595794 14816 server_base.cc:1034] running on GCE node
W20260923 17:14:14.595844 14822 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:14.596292 14816 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:14.597049 14816 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:14.598260 14816 hybrid_clock.cc:648] HybridClock initialized: now 1790183654598199 us; error 43 us; skew 500 ppm
Sep 23 17:14:14 dist-test-slave-1x1f krb5kdc[14575](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183654, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:14.602880 14816 init.cc:377] Logged in from keytab as kudu/127.11.229.130@KRBTEST.COM (short username kudu)
I20260923 17:14:14.603891 14816 webserver.cc:460] Webserver started at http://127.11.229.130:37435/ using document root <none> and password file <none>
I20260923 17:14:14.604513 14816 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:14.604606 14816 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:14.604854 14816 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:14.607091 14816 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-1/data/instance:
uuid: "4f4dde12bfa94842b682e7bc99739ee1"
format_stamp: "Formatted at 2026-09-23 17:14:14 on dist-test-slave-1x1f"
server_key: "f7949e4d53d130d6a166eb267edeafa4"
server_key_iv: "c6b9c893efea3dae7a607e40a52a8ca2"
server_key_version: "encryptionkey@0"
I20260923 17:14:14.607681 14816 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance:
uuid: "4f4dde12bfa94842b682e7bc99739ee1"
format_stamp: "Formatted at 2026-09-23 17:14:14 on dist-test-slave-1x1f"
server_key: "f7949e4d53d130d6a166eb267edeafa4"
server_key_iv: "c6b9c893efea3dae7a607e40a52a8ca2"
server_key_version: "encryptionkey@0"
I20260923 17:14:14.611534 14816 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260923 17:14:14.614334 14831 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:14.615715 14816 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 17:14:14.615859 14816 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-1/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-1/wal
uuid: "4f4dde12bfa94842b682e7bc99739ee1"
format_stamp: "Formatted at 2026-09-23 17:14:14 on dist-test-slave-1x1f"
server_key: "f7949e4d53d130d6a166eb267edeafa4"
server_key_iv: "c6b9c893efea3dae7a607e40a52a8ca2"
server_key_version: "encryptionkey@0"
I20260923 17:14:14.615988 14816 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:14.632162 14816 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:14.635541 14816 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:14.635759 14816 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:14.636353 14816 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:14:14.637197 14816 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:14:14.637269 14816 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:14.637337 14816 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:14:14.637388 14816 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:14.646425 14816 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.130:39283
I20260923 17:14:14.646489 14944 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.130:39283 every 8 connection(s)
I20260923 17:14:14.647372 14816 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
Sep 23 17:14:14 dist-test-slave-1x1f krb5kdc[14575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183654, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.130@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:14:14.656916 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 14816
I20260923 17:14:14.657105 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance
I20260923 17:14:14.657450 12182 external_mini_cluster.cc:1428] Setting key ddbeb46779fb1afc8b4cc10c54f4858e
I20260923 17:14:14.661543 14659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:14.649221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:38485 (local address 127.11.229.190:39405)
0923 17:14:14.649465 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:14.649468 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:14.650262 (+ 794us) server_negotiation.cc:407] Connection header received
0923 17:14:14.651514 (+ 1252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:14.651517 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:14.651561 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:14.651639 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:14.652786 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:14.653315 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:14.654479 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:14.654697 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:14.654778 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:14.657356 (+ 2578us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:14.657360 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:14.657362 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:14.657398 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:14.659204 (+ 1806us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:14.659691 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:14.659697 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:14.659702 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:14.659790 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:14.660151 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:14.660157 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:14.660162 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:14.660410 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:14.660514 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:14.661191 (+ 677us) server_negotiation.cc:299] Negotiation successful
0923 17:14:14.661330 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155}
I20260923 17:14:14.662658 14947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:14.649598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:39405 (local address 127.11.229.130:38485)
0923 17:14:14.650036 (+ 438us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:14.650079 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:14.651305 (+ 1226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:14.651794 (+ 489us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:14.651801 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:14.652180 (+ 379us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:14.652648 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:14.652661 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:14.653423 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:14.653426 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:14.654349 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:14.654358 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:14.654834 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:14.654836 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:14.654973 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:14.655577 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:14.655593 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:14.657110 (+ 1517us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:14.659317 (+ 2207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:14.659322 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:14.659335 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:14.659588 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:14.659886 (+ 298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:14.659888 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:14.659890 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:14.660022 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:14.660618 (+ 596us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:14.660624 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:14.660906 (+ 282us) client_negotiation.cc:769] Sending connection context
0923 17:14:14.661118 (+ 212us) client_negotiation.cc:240] Negotiation successful
0923 17:14:14.661560 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":110,"threads_started":1}
I20260923 17:14:14.663902 14945 heartbeater.cc:347] Connected to a master server at 127.11.229.190:39405
I20260923 17:14:14.664198 14945 heartbeater.cc:464] Registering TS with master...
I20260923 17:14:14.664703 14945 heartbeater.cc:511] Master 127.11.229.190:39405 requested a full tablet report, sending...
I20260923 17:14:14.665822 14620 ts_manager.cc:194] Registered new tserver with Master: 4f4dde12bfa94842b682e7bc99739ee1 (127.11.229.130:39283)
I20260923 17:14:14.666466 14620 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.130@KRBTEST.COM'} at 127.11.229.130:38485
WARNING: no policy specified for kudu/127.11.229.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab.
Entry for principal kudu/127.11.229.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab.
I20260923 17:14:14.689667 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.131:0
--local_ip_for_outbound_sockets=127.11.229.131
--webserver_interface=127.11.229.131
--webserver_port=0
--tserver_master_addrs=127.11.229.190:39405
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab
--principal=kudu/127.11.229.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:33529
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:14:14.800674 14950 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:14.800978 14950 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:14.801091 14950 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:14.805269 14950 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:14.805356 14950 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:14.805451 14950 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.131
I20260923 17:14:14.810885 14950 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:33529
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab
--principal=kudu/127.11.229.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.229.131
--webserver_port=0
--tserver_master_addrs=127.11.229.190:39405
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14950
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.131
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:14.811980 14950 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:14.813038 14950 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:14.822680 14956 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:14.822696 14958 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:14.822719 14955 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:14.822956 14950 server_base.cc:1034] running on GCE node
I20260923 17:14:14.823313 14950 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:14.823915 14950 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:14.825183 14950 hybrid_clock.cc:648] HybridClock initialized: now 1790183654825149 us; error 46 us; skew 500 ppm
Sep 23 17:14:14 dist-test-slave-1x1f krb5kdc[14575](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183654, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:14.828398 14950 init.cc:377] Logged in from keytab as kudu/127.11.229.131@KRBTEST.COM (short username kudu)
I20260923 17:14:14.829303 14950 webserver.cc:460] Webserver started at http://127.11.229.131:37743/ using document root <none> and password file <none>
I20260923 17:14:14.829886 14950 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:14.829947 14950 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:14.830194 14950 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:14.832356 14950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-2/data/instance:
uuid: "6dec0cbaadac4048b94de5e421bdd267"
format_stamp: "Formatted at 2026-09-23 17:14:14 on dist-test-slave-1x1f"
server_key: "f6bd25bbb1a5f4ba8543cffa1f402876"
server_key_iv: "d29f053c05ea2915bb95b80f478ed1ac"
server_key_version: "encryptionkey@0"
I20260923 17:14:14.832912 14950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance:
uuid: "6dec0cbaadac4048b94de5e421bdd267"
format_stamp: "Formatted at 2026-09-23 17:14:14 on dist-test-slave-1x1f"
server_key: "f6bd25bbb1a5f4ba8543cffa1f402876"
server_key_iv: "d29f053c05ea2915bb95b80f478ed1ac"
server_key_version: "encryptionkey@0"
I20260923 17:14:14.836680 14950 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260923 17:14:14.839102 14965 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:14.840426 14950 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.003s
I20260923 17:14:14.840517 14950 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-2/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-2/wal
uuid: "6dec0cbaadac4048b94de5e421bdd267"
format_stamp: "Formatted at 2026-09-23 17:14:14 on dist-test-slave-1x1f"
server_key: "f6bd25bbb1a5f4ba8543cffa1f402876"
server_key_iv: "d29f053c05ea2915bb95b80f478ed1ac"
server_key_version: "encryptionkey@0"
I20260923 17:14:14.840646 14950 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:14.853725 14950 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:14.856956 14950 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:14.857164 14950 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:14.857736 14950 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:14:14.858603 14950 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:14:14.858649 14950 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:14.858714 14950 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:14:14.858749 14950 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:14.867997 14950 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.131:37695
I20260923 17:14:14.868017 15078 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.131:37695 every 8 connection(s)
I20260923 17:14:14.868860 14950 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
I20260923 17:14:14.876441 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 14950
I20260923 17:14:14.876591 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance
I20260923 17:14:14.877005 12182 external_mini_cluster.cc:1428] Setting key dc970f919b8fde90af69e5d0356a025c
Sep 23 17:14:14 dist-test-slave-1x1f krb5kdc[14575](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183654, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.131@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:14:14.883412 14659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:14.870916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:40219 (local address 127.11.229.190:39405)
0923 17:14:14.871086 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:14.871090 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:14.872035 (+ 945us) server_negotiation.cc:407] Connection header received
0923 17:14:14.873295 (+ 1260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:14.873298 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:14.873353 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:14.873466 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:14.874701 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:14.875242 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:14.876385 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:14.876657 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:14.876779 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:14.879897 (+ 3118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:14.879900 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:14.879902 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:14.879925 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:14.881356 (+ 1431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:14.881857 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:14.881860 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:14.881861 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:14.881934 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:14.882340 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:14.882343 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:14.882344 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:14.882544 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:14.882628 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:14.883197 (+ 569us) server_negotiation.cc:299] Negotiation successful
0923 17:14:14.883295 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260923 17:14:14.884249 15081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:14.871321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:39405 (local address 127.11.229.131:40219)
0923 17:14:14.871803 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:14.871845 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:14.873084 (+ 1239us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:14.873648 (+ 564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:14.873656 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:14.874008 (+ 352us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:14.874561 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:14.874573 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:14.875386 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:14.875388 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:14.876256 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:14.876265 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:14.876852 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:14.876857 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:14.877085 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:14.877845 (+ 760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:14.877867 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:14.879735 (+ 1868us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:14.881471 (+ 1736us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:14.881476 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:14.881488 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:14.881767 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:14.882017 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:14.882020 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:14.882021 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:14.882163 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:14.882712 (+ 549us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:14.882717 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:14.882946 (+ 229us) client_negotiation.cc:769] Sending connection context
0923 17:14:14.883105 (+ 159us) client_negotiation.cc:240] Negotiation successful
0923 17:14:14.883359 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":111,"threads_started":1}
I20260923 17:14:14.885551 15079 heartbeater.cc:347] Connected to a master server at 127.11.229.190:39405
I20260923 17:14:14.885838 15079 heartbeater.cc:464] Registering TS with master...
I20260923 17:14:14.886466 15079 heartbeater.cc:511] Master 127.11.229.190:39405 requested a full tablet report, sending...
I20260923 17:14:14.887595 14620 ts_manager.cc:194] Registered new tserver with Master: 6dec0cbaadac4048b94de5e421bdd267 (127.11.229.131:37695)
I20260923 17:14:14.888243 14620 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.131@KRBTEST.COM'} at 127.11.229.131:40219
I20260923 17:14:14.891343 12182 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260923 17:14:14.904433 14659 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:14.902889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59276 (local address 127.11.229.190:39405)
0923 17:14:14.903029 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:14.903034 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:14.903200 (+ 166us) server_negotiation.cc:407] Connection header received
0923 17:14:14.903379 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:14.903386 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:14.903435 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:14.903527 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:14.904281 (+ 754us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59276: BlockingRecv error: recv got EOF from 127.0.0.1:59276 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
I20260923 17:14:14.905727 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 14682
I20260923 17:14:14.911231 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 14816
I20260923 17:14:14.916776 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 14950
I20260923 17:14:14.922335 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 14588
2026-09-23T17:14:14Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2250 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790183633736342-12182-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 17:14:14 dist-test-slave-1x1f krb5kdc[15091](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 17:14:14 dist-test-slave-1x1f krb5kdc[15091](info): set up 2 sockets
Sep 23 17:14:14 dist-test-slave-1x1f krb5kdc[15091](info): commencing operation
krb5kdc: starting...
W20260923 17:14:15.978830 12182 mini_kdc.cc:121] Time spent starting KDC: real 1.035s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Sep 23 17:14:16 dist-test-slave-1x1f krb5kdc[15091](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183656, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T17:14:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:14:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.229.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
I20260923 17:14:16.110790 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:46447
--webserver_interface=127.11.229.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:40913
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:46447
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:14:16.235280 15104 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:16.235562 15104 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:16.235602 15104 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:16.239853 15104 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:14:16.239924 15104 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:16.239943 15104 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:16.239960 15104 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:14:16.239976 15104 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:14:16.245369 15104 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:40913
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:46447
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:46447
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.229.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15104
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:16.246417 15104 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:16.247481 15104 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:16.255877 15110 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:16.255913 15112 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:16.255915 15109 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:16.256109 15104 server_base.cc:1034] running on GCE node
I20260923 17:14:16.256688 15104 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:16.257786 15104 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:16.258978 15104 hybrid_clock.cc:648] HybridClock initialized: now 1790183656258941 us; error 49 us; skew 500 ppm
Sep 23 17:14:16 dist-test-slave-1x1f krb5kdc[15091](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183656, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:16.261720 15104 init.cc:377] Logged in from keytab as kudu/127.11.229.190@KRBTEST.COM (short username kudu)
I20260923 17:14:16.262666 15104 webserver.cc:460] Webserver started at http://127.11.229.190:33853/ using document root <none> and password file <none>
I20260923 17:14:16.263226 15104 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:16.263315 15104 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:16.263548 15104 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:16.265604 15104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "d4470e3f778b43e9bd0fef964b77fde6"
format_stamp: "Formatted at 2026-09-23 17:14:16 on dist-test-slave-1x1f"
server_key: "d1bcb31607c4f301fcf82eae8c308174"
server_key_iv: "5ed305807e128be001808d0b2eef316e"
server_key_version: "encryptionkey@0"
I20260923 17:14:16.266176 15104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "d4470e3f778b43e9bd0fef964b77fde6"
format_stamp: "Formatted at 2026-09-23 17:14:16 on dist-test-slave-1x1f"
server_key: "d1bcb31607c4f301fcf82eae8c308174"
server_key_iv: "5ed305807e128be001808d0b2eef316e"
server_key_version: "encryptionkey@0"
I20260923 17:14:16.269912 15104 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260923 17:14:16.272467 15119 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:16.273910 15104 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 17:14:16.274068 15104 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "d4470e3f778b43e9bd0fef964b77fde6"
format_stamp: "Formatted at 2026-09-23 17:14:16 on dist-test-slave-1x1f"
server_key: "d1bcb31607c4f301fcf82eae8c308174"
server_key_iv: "5ed305807e128be001808d0b2eef316e"
server_key_version: "encryptionkey@0"
I20260923 17:14:16.274225 15104 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:16.287166 15104 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:16.290402 15104 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:16.290634 15104 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:16.299168 15104 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.190:46447
I20260923 17:14:16.299517 15171 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.190:46447 every 8 connection(s)
I20260923 17:14:16.300228 15104 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:14:16.303081 15172 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:16.307911 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 15104
I20260923 17:14:16.308034 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:14:16.308324 12182 external_mini_cluster.cc:1428] Setting key fb96993c2deed92bd6d20484a61aab5e
I20260923 17:14:16.308877 15172 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4470e3f778b43e9bd0fef964b77fde6: Bootstrap starting.
I20260923 17:14:16.311316 15172 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d4470e3f778b43e9bd0fef964b77fde6: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:16.312086 15172 log.cc:824] T 00000000000000000000000000000000 P d4470e3f778b43e9bd0fef964b77fde6: Log is configured to *not* fsync() on all Append() calls
I20260923 17:14:16.313911 15172 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4470e3f778b43e9bd0fef964b77fde6: No bootstrap required, opened a new log
Sep 23 17:14:16 dist-test-slave-1x1f krb5kdc[15091](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183656, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:14:16.318130 15172 raft_consensus.cc:348] T 00000000000000000000000000000000 P d4470e3f778b43e9bd0fef964b77fde6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4470e3f778b43e9bd0fef964b77fde6" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 46447 } }
I20260923 17:14:16.318475 15172 raft_consensus.cc:374] T 00000000000000000000000000000000 P d4470e3f778b43e9bd0fef964b77fde6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:16.318565 15172 raft_consensus.cc:729] T 00000000000000000000000000000000 P d4470e3f778b43e9bd0fef964b77fde6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4470e3f778b43e9bd0fef964b77fde6, State: Initialized, Role: FOLLOWER
I20260923 17:14:16.319105 15172 consensus_queue.cc:260] T 00000000000000000000000000000000 P d4470e3f778b43e9bd0fef964b77fde6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4470e3f778b43e9bd0fef964b77fde6" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 46447 } }
I20260923 17:14:16.319268 15172 raft_consensus.cc:388] T 00000000000000000000000000000000 P d4470e3f778b43e9bd0fef964b77fde6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:14:16.319339 15172 raft_consensus.cc:482] T 00000000000000000000000000000000 P d4470e3f778b43e9bd0fef964b77fde6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:14:16.319440 15172 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d4470e3f778b43e9bd0fef964b77fde6 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:16.320570 15172 raft_consensus.cc:504] T 00000000000000000000000000000000 P d4470e3f778b43e9bd0fef964b77fde6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4470e3f778b43e9bd0fef964b77fde6" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 46447 } }
I20260923 17:14:16.320974 15172 leader_election.cc:302] T 00000000000000000000000000000000 P d4470e3f778b43e9bd0fef964b77fde6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d4470e3f778b43e9bd0fef964b77fde6; no voters:
I20260923 17:14:16.321296 15172 leader_election.cc:288] T 00000000000000000000000000000000 P d4470e3f778b43e9bd0fef964b77fde6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 17:14:16.321451 15177 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d4470e3f778b43e9bd0fef964b77fde6 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:14:16.321666 15177 raft_consensus.cc:686] T 00000000000000000000000000000000 P d4470e3f778b43e9bd0fef964b77fde6 [term 1 LEADER]: Becoming Leader. State: Replica: d4470e3f778b43e9bd0fef964b77fde6, State: Running, Role: LEADER
I20260923 17:14:16.322005 15177 consensus_queue.cc:237] T 00000000000000000000000000000000 P d4470e3f778b43e9bd0fef964b77fde6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4470e3f778b43e9bd0fef964b77fde6" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 46447 } }
I20260923 17:14:16.322696 15172 sys_catalog.cc:564] T 00000000000000000000000000000000 P d4470e3f778b43e9bd0fef964b77fde6 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:14:16.323177 15179 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4470e3f778b43e9bd0fef964b77fde6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d4470e3f778b43e9bd0fef964b77fde6. Latest consensus state: current_term: 1 leader_uuid: "d4470e3f778b43e9bd0fef964b77fde6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4470e3f778b43e9bd0fef964b77fde6" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 46447 } } }
I20260923 17:14:16.323290 15179 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4470e3f778b43e9bd0fef964b77fde6 [sys.catalog]: This master's current role is: LEADER
I20260923 17:14:16.323889 15175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:16.309655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40406 (local address 127.11.229.190:46447)
0923 17:14:16.310082 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:16.310097 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:16.310131 (+ 34us) server_negotiation.cc:407] Connection header received
0923 17:14:16.310846 (+ 715us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:16.310863 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:16.311223 (+ 360us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:16.311569 (+ 346us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:16.312431 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:16.313399 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:16.314367 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:16.314828 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:16.314998 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:16.317819 (+ 2821us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:16.317824 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:16.317837 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:16.317865 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:16.319903 (+ 2038us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:16.320437 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:16.320442 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:16.320447 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:16.320579 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:16.320873 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:16.320876 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:16.320877 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:16.321493 (+ 616us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:16.321703 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:16.322203 (+ 500us) server_negotiation.cc:299] Negotiation successful
0923 17:14:16.322555 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":274,"thread_start_us":138,"threads_started":1}
I20260923 17:14:16.323943 15178 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4470e3f778b43e9bd0fef964b77fde6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d4470e3f778b43e9bd0fef964b77fde6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d4470e3f778b43e9bd0fef964b77fde6" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 46447 } } }
I20260923 17:14:16.324229 15178 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4470e3f778b43e9bd0fef964b77fde6 [sys.catalog]: This master's current role is: LEADER
I20260923 17:14:16.324234 15182 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:14:16.327643 12182 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 17:14:16.327970 15182 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:14:16.334152 15182 catalog_manager.cc:1347] Generated new cluster ID: 09e06926bfcb45bc9c5b4459e9a9404a
I20260923 17:14:16.334250 15182 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:14:16.353995 15175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:16.348255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40408 (local address 127.11.229.190:46447)
0923 17:14:16.348376 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:16.348382 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:16.348607 (+ 225us) server_negotiation.cc:407] Connection header received
0923 17:14:16.348718 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:16.348721 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:16.348773 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:16.348876 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:16.349435 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:16.350286 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:16.351405 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:16.351771 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:16.351875 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:16.352816 (+ 941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:16.352820 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:16.352823 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:14:16.353510 (+ 687us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:16.353546 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:14:16.353567 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:16.353660 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:16.353772 (+ 112us) server_negotiation.cc:299] Negotiation successful
0923 17:14:16.353838 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260923 17:14:16.374953 15182 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:14:16.375972 15182 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:14:16.384951 15182 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d4470e3f778b43e9bd0fef964b77fde6: Generated new TSK 0
I20260923 17:14:16.385684 15182 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 17:14:16.395888 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 15104
2026-09-23T17:14:16Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1470 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 17:14:16 dist-test-slave-1x1f krb5kdc[15205](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 17:14:16 dist-test-slave-1x1f krb5kdc[15205](info): set up 2 sockets
Sep 23 17:14:16 dist-test-slave-1x1f krb5kdc[15205](info): commencing operation
krb5kdc: starting...
W20260923 17:14:17.451107 12182 mini_kdc.cc:121] Time spent starting KDC: real 1.036s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Sep 23 17:14:17 dist-test-slave-1x1f krb5kdc[15205](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183657, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T17:14:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:14:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.229.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
I20260923 17:14:17.582600 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:38261
--webserver_interface=127.11.229.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:40621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:38261
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:14:17.693750 15218 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:17.694084 15218 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:17.694154 15218 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:17.698213 15218 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:14:17.698334 15218 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:17.698372 15218 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:17.698410 15218 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:14:17.698444 15218 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:14:17.703833 15218 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:40621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:38261
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:38261
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.229.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15218
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:17.704979 15218 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:17.706027 15218 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:17.714963 15223 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:17.714970 15224 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:17.715023 15218 server_base.cc:1034] running on GCE node
W20260923 17:14:17.714970 15226 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:17.715759 15218 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:17.716951 15218 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:17.718178 15218 hybrid_clock.cc:648] HybridClock initialized: now 1790183657718147 us; error 58 us; skew 500 ppm
Sep 23 17:14:17 dist-test-slave-1x1f krb5kdc[15205](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183657, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:17.721042 15218 init.cc:377] Logged in from keytab as kudu/127.11.229.190@KRBTEST.COM (short username kudu)
I20260923 17:14:17.721904 15218 webserver.cc:460] Webserver started at http://127.11.229.190:36353/ using document root <none> and password file <none>
I20260923 17:14:17.722487 15218 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:17.722556 15218 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:17.722718 15218 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:17.724699 15218 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "26ba7f04eb9a4d6f974c98abdb07c8c1"
format_stamp: "Formatted at 2026-09-23 17:14:17 on dist-test-slave-1x1f"
server_key: "fc113a6bd0fedba24548ca2efb61ce3a"
server_key_iv: "86723bf57cb28f4e8cd536a0bcf0c2a6"
server_key_version: "encryptionkey@0"
I20260923 17:14:17.725198 15218 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "26ba7f04eb9a4d6f974c98abdb07c8c1"
format_stamp: "Formatted at 2026-09-23 17:14:17 on dist-test-slave-1x1f"
server_key: "fc113a6bd0fedba24548ca2efb61ce3a"
server_key_iv: "86723bf57cb28f4e8cd536a0bcf0c2a6"
server_key_version: "encryptionkey@0"
I20260923 17:14:17.728936 15218 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260923 17:14:17.731511 15233 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:17.732986 15218 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260923 17:14:17.733165 15218 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "26ba7f04eb9a4d6f974c98abdb07c8c1"
format_stamp: "Formatted at 2026-09-23 17:14:17 on dist-test-slave-1x1f"
server_key: "fc113a6bd0fedba24548ca2efb61ce3a"
server_key_iv: "86723bf57cb28f4e8cd536a0bcf0c2a6"
server_key_version: "encryptionkey@0"
I20260923 17:14:17.733299 15218 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:17.770509 15218 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:17.774398 15218 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:17.774647 15218 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:17.782302 15218 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.190:38261
I20260923 17:14:17.782616 15285 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.190:38261 every 8 connection(s)
I20260923 17:14:17.783427 15218 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:14:17.786309 15286 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:17.789515 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 15218
I20260923 17:14:17.789629 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:14:17.789938 12182 external_mini_cluster.cc:1428] Setting key d63b1041fad4f1886f62e004d14be410
I20260923 17:14:17.792177 15286 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26ba7f04eb9a4d6f974c98abdb07c8c1: Bootstrap starting.
I20260923 17:14:17.794898 15286 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 26ba7f04eb9a4d6f974c98abdb07c8c1: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:17.795835 15286 log.cc:824] T 00000000000000000000000000000000 P 26ba7f04eb9a4d6f974c98abdb07c8c1: Log is configured to *not* fsync() on all Append() calls
I20260923 17:14:17.798075 15286 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26ba7f04eb9a4d6f974c98abdb07c8c1: No bootstrap required, opened a new log
Sep 23 17:14:17 dist-test-slave-1x1f krb5kdc[15205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183657, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:14:17.802955 15286 raft_consensus.cc:348] T 00000000000000000000000000000000 P 26ba7f04eb9a4d6f974c98abdb07c8c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26ba7f04eb9a4d6f974c98abdb07c8c1" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 38261 } }
I20260923 17:14:17.803254 15286 raft_consensus.cc:374] T 00000000000000000000000000000000 P 26ba7f04eb9a4d6f974c98abdb07c8c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:17.803323 15286 raft_consensus.cc:729] T 00000000000000000000000000000000 P 26ba7f04eb9a4d6f974c98abdb07c8c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26ba7f04eb9a4d6f974c98abdb07c8c1, State: Initialized, Role: FOLLOWER
I20260923 17:14:17.803855 15286 consensus_queue.cc:260] T 00000000000000000000000000000000 P 26ba7f04eb9a4d6f974c98abdb07c8c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26ba7f04eb9a4d6f974c98abdb07c8c1" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 38261 } }
I20260923 17:14:17.804023 15286 raft_consensus.cc:388] T 00000000000000000000000000000000 P 26ba7f04eb9a4d6f974c98abdb07c8c1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:14:17.804113 15286 raft_consensus.cc:482] T 00000000000000000000000000000000 P 26ba7f04eb9a4d6f974c98abdb07c8c1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:14:17.804217 15286 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 26ba7f04eb9a4d6f974c98abdb07c8c1 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:17.805473 15286 raft_consensus.cc:504] T 00000000000000000000000000000000 P 26ba7f04eb9a4d6f974c98abdb07c8c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26ba7f04eb9a4d6f974c98abdb07c8c1" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 38261 } }
I20260923 17:14:17.805845 15286 leader_election.cc:302] T 00000000000000000000000000000000 P 26ba7f04eb9a4d6f974c98abdb07c8c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 26ba7f04eb9a4d6f974c98abdb07c8c1; no voters:
I20260923 17:14:17.806169 15286 leader_election.cc:288] T 00000000000000000000000000000000 P 26ba7f04eb9a4d6f974c98abdb07c8c1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 17:14:17.806368 15291 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 26ba7f04eb9a4d6f974c98abdb07c8c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:14:17.806641 15291 raft_consensus.cc:686] T 00000000000000000000000000000000 P 26ba7f04eb9a4d6f974c98abdb07c8c1 [term 1 LEADER]: Becoming Leader. State: Replica: 26ba7f04eb9a4d6f974c98abdb07c8c1, State: Running, Role: LEADER
I20260923 17:14:17.806658 15289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:17.791485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50662 (local address 127.11.229.190:38261)
0923 17:14:17.791951 (+ 466us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:17.791974 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:17.792220 (+ 246us) server_negotiation.cc:407] Connection header received
0923 17:14:17.793142 (+ 922us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:17.793163 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:17.793609 (+ 446us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:17.793959 (+ 350us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:17.794939 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:17.796414 (+ 1475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:17.797343 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:17.798059 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:17.798258 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:17.801048 (+ 2790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:17.801055 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:17.801077 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:17.801116 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:17.803175 (+ 2059us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:17.803732 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:17.803737 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:17.803743 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:17.803878 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:17.804260 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:17.804265 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:17.804269 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:17.804811 (+ 542us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:17.805021 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:17.805318 (+ 297us) server_negotiation.cc:299] Negotiation successful
0923 17:14:17.805630 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":297,"thread_start_us":151,"threads_started":1}
I20260923 17:14:17.807021 15291 consensus_queue.cc:237] T 00000000000000000000000000000000 P 26ba7f04eb9a4d6f974c98abdb07c8c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26ba7f04eb9a4d6f974c98abdb07c8c1" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 38261 } }
I20260923 17:14:17.807509 15286 sys_catalog.cc:564] T 00000000000000000000000000000000 P 26ba7f04eb9a4d6f974c98abdb07c8c1 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:14:17.808264 15291 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26ba7f04eb9a4d6f974c98abdb07c8c1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 26ba7f04eb9a4d6f974c98abdb07c8c1. Latest consensus state: current_term: 1 leader_uuid: "26ba7f04eb9a4d6f974c98abdb07c8c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26ba7f04eb9a4d6f974c98abdb07c8c1" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 38261 } } }
I20260923 17:14:17.808378 15291 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26ba7f04eb9a4d6f974c98abdb07c8c1 [sys.catalog]: This master's current role is: LEADER
I20260923 17:14:17.808683 15292 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26ba7f04eb9a4d6f974c98abdb07c8c1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "26ba7f04eb9a4d6f974c98abdb07c8c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26ba7f04eb9a4d6f974c98abdb07c8c1" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 38261 } } }
I20260923 17:14:17.808745 15292 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26ba7f04eb9a4d6f974c98abdb07c8c1 [sys.catalog]: This master's current role is: LEADER
W20260923 17:14:17.812158 15306 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 26ba7f04eb9a4d6f974c98abdb07c8c1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 17:14:17.812253 15306 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 17:14:17.812322 15300 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:14:17.813010 15300 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:14:17.818794 15300 catalog_manager.cc:1347] Generated new cluster ID: 188682ff90f44d69b1e144e01ac62a0b
I20260923 17:14:17.818871 15300 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:14:17.827256 15300 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:14:17.828562 15300 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:14:17.835219 15300 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 26ba7f04eb9a4d6f974c98abdb07c8c1: Generated new TSK 0
I20260923 17:14:17.836004 15300 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.229.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab.
Entry for principal kudu/127.11.229.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab.
I20260923 17:14:17.871186 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.129:0
--local_ip_for_outbound_sockets=127.11.229.129
--webserver_interface=127.11.229.129
--webserver_port=0
--tserver_master_addrs=127.11.229.190:38261
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab
--principal=kudu/127.11.229.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:40621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:14:17.986733 15312 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:17.987133 15312 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:17.987232 15312 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:17.991536 15312 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:17.991640 15312 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:17.991739 15312 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.129
I20260923 17:14:17.997260 15312 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:40621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab
--principal=kudu/127.11.229.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.229.129
--webserver_port=0
--tserver_master_addrs=127.11.229.190:38261
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15312
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.129
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:17.998497 15312 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:17.999547 15312 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:18.009939 15317 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:18.009976 15320 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:18.009940 15318 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:18.010385 15312 server_base.cc:1034] running on GCE node
I20260923 17:14:18.010890 15312 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:18.011690 15312 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:18.012917 15312 hybrid_clock.cc:648] HybridClock initialized: now 1790183658012896 us; error 35 us; skew 500 ppm
Sep 23 17:14:18 dist-test-slave-1x1f krb5kdc[15205](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183658, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:18.016011 15312 init.cc:377] Logged in from keytab as kudu/127.11.229.129@KRBTEST.COM (short username kudu)
I20260923 17:14:18.016933 15312 webserver.cc:460] Webserver started at http://127.11.229.129:36967/ using document root <none> and password file <none>
I20260923 17:14:18.017534 15312 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:18.017630 15312 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:18.017903 15312 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:18.020174 15312 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-0/data/instance:
uuid: "a23cbc651d704c65ab43639351d64f2b"
format_stamp: "Formatted at 2026-09-23 17:14:18 on dist-test-slave-1x1f"
server_key: "15b6de880d5ef75a0746b601e0b5209f"
server_key_iv: "3a33fd2aa7fe0e0c14bae9ac47835d01"
server_key_version: "encryptionkey@0"
I20260923 17:14:18.020797 15312 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance:
uuid: "a23cbc651d704c65ab43639351d64f2b"
format_stamp: "Formatted at 2026-09-23 17:14:18 on dist-test-slave-1x1f"
server_key: "15b6de880d5ef75a0746b601e0b5209f"
server_key_iv: "3a33fd2aa7fe0e0c14bae9ac47835d01"
server_key_version: "encryptionkey@0"
I20260923 17:14:18.024789 15312 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260923 17:14:18.027814 15327 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:18.029254 15312 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260923 17:14:18.029417 15312 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-0/wal
uuid: "a23cbc651d704c65ab43639351d64f2b"
format_stamp: "Formatted at 2026-09-23 17:14:18 on dist-test-slave-1x1f"
server_key: "15b6de880d5ef75a0746b601e0b5209f"
server_key_iv: "3a33fd2aa7fe0e0c14bae9ac47835d01"
server_key_version: "encryptionkey@0"
I20260923 17:14:18.029547 15312 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:18.050187 15312 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:18.054626 15312 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:18.054872 15312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:18.055542 15312 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:14:18.056484 15312 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:14:18.056569 15312 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:18.056644 15312 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:14:18.056699 15312 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:18.066797 15312 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.129:35337
I20260923 17:14:18.066819 15440 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.129:35337 every 8 connection(s)
I20260923 17:14:18.067811 15312 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
I20260923 17:14:18.068918 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 15312
I20260923 17:14:18.069067 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance
I20260923 17:14:18.069432 12182 external_mini_cluster.cc:1428] Setting key 3f9cf4a22774dd702d6c9c2bca9f0ab5
WARNING: no policy specified for kudu/127.11.229.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.130@KRBTEST.COM" created.
Sep 23 17:14:18 dist-test-slave-1x1f krb5kdc[15205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183658, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.129@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:14:18.086462 15289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:18.069896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:42533 (local address 127.11.229.190:38261)
0923 17:14:18.070070 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:18.070075 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:18.071162 (+ 1087us) server_negotiation.cc:407] Connection header received
0923 17:14:18.072688 (+ 1526us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:18.072692 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:18.072749 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:18.072835 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:18.074135 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:18.074805 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:18.076140 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:18.076414 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:18.076537 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:18.082288 (+ 5751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:18.082293 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:18.082295 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:18.082326 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:18.084113 (+ 1787us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:18.084769 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:18.084778 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:18.084779 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:18.084861 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:18.085240 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:18.085244 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:18.085246 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:18.085451 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:18.085559 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:18.086111 (+ 552us) server_negotiation.cc:299] Negotiation successful
0923 17:14:18.086287 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260923 17:14:18.087383 15443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:18.070464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:38261 (local address 127.11.229.129:42533)
0923 17:14:18.070982 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:18.071039 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:18.072443 (+ 1404us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:18.073027 (+ 584us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:18.073036 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:18.073428 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:18.073967 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:18.073981 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:18.074954 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:18.074958 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:18.075991 (+ 1033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:18.076002 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:18.076610 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:18.076616 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:18.076808 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:18.077505 (+ 697us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:18.077525 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:18.082009 (+ 4484us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:18.084289 (+ 2280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:18.084302 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:18.084327 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:18.084641 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:18.084962 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:18.084965 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:18.084968 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:18.085131 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:18.085573 (+ 442us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:18.085582 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:18.085866 (+ 284us) client_negotiation.cc:769] Sending connection context
0923 17:14:18.086083 (+ 217us) client_negotiation.cc:240] Negotiation successful
0923 17:14:18.086481 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":299,"thread_start_us":149,"threads_started":1}
I20260923 17:14:18.088776 15441 heartbeater.cc:347] Connected to a master server at 127.11.229.190:38261
I20260923 17:14:18.089042 15441 heartbeater.cc:464] Registering TS with master...
I20260923 17:14:18.089581 15441 heartbeater.cc:511] Master 127.11.229.190:38261 requested a full tablet report, sending...
I20260923 17:14:18.091409 15250 ts_manager.cc:194] Registered new tserver with Master: a23cbc651d704c65ab43639351d64f2b (127.11.229.129:35337)
I20260923 17:14:18.092743 15250 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.129@KRBTEST.COM'} at 127.11.229.129:42533
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab.
Entry for principal kudu/127.11.229.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab.
I20260923 17:14:18.101394 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.130:0
--local_ip_for_outbound_sockets=127.11.229.130
--webserver_interface=127.11.229.130
--webserver_port=0
--tserver_master_addrs=127.11.229.190:38261
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab
--principal=kudu/127.11.229.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:40621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:14:18.221705 15446 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:18.222008 15446 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:18.222065 15446 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:18.226779 15446 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:18.226859 15446 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:18.226928 15446 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.130
I20260923 17:14:18.233014 15446 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:40621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab
--principal=kudu/127.11.229.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.229.130
--webserver_port=0
--tserver_master_addrs=127.11.229.190:38261
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15446
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.130
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:18.234242 15446 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:18.235297 15446 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:18.246053 15451 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:18.246187 15454 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:18.246578 15452 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:18.246632 15446 server_base.cc:1034] running on GCE node
I20260923 17:14:18.247073 15446 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:18.247774 15446 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:18.248965 15446 hybrid_clock.cc:648] HybridClock initialized: now 1790183658248950 us; error 27 us; skew 500 ppm
Sep 23 17:14:18 dist-test-slave-1x1f krb5kdc[15205](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183658, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:18.251929 15446 init.cc:377] Logged in from keytab as kudu/127.11.229.130@KRBTEST.COM (short username kudu)
I20260923 17:14:18.252838 15446 webserver.cc:460] Webserver started at http://127.11.229.130:33961/ using document root <none> and password file <none>
I20260923 17:14:18.253372 15446 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:18.253432 15446 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:18.253594 15446 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:18.255692 15446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-1/data/instance:
uuid: "5f96ada2879043ec8fc10690675a6ec9"
format_stamp: "Formatted at 2026-09-23 17:14:18 on dist-test-slave-1x1f"
server_key: "f04c69ce92dbd733e90ec537469a0a3f"
server_key_iv: "4289ad3971258ff9d5da50678d5a1b52"
server_key_version: "encryptionkey@0"
I20260923 17:14:18.256238 15446 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance:
uuid: "5f96ada2879043ec8fc10690675a6ec9"
format_stamp: "Formatted at 2026-09-23 17:14:18 on dist-test-slave-1x1f"
server_key: "f04c69ce92dbd733e90ec537469a0a3f"
server_key_iv: "4289ad3971258ff9d5da50678d5a1b52"
server_key_version: "encryptionkey@0"
I20260923 17:14:18.260071 15446 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260923 17:14:18.262701 15461 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:18.264036 15446 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 17:14:18.264138 15446 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-1/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-1/wal
uuid: "5f96ada2879043ec8fc10690675a6ec9"
format_stamp: "Formatted at 2026-09-23 17:14:18 on dist-test-slave-1x1f"
server_key: "f04c69ce92dbd733e90ec537469a0a3f"
server_key_iv: "4289ad3971258ff9d5da50678d5a1b52"
server_key_version: "encryptionkey@0"
I20260923 17:14:18.264331 15446 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:18.275326 15446 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:18.278738 15446 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:18.278940 15446 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:18.279541 15446 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:14:18.280371 15446 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:14:18.280416 15446 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:18.280457 15446 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:14:18.280472 15446 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:18.290719 15446 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.130:44563
I20260923 17:14:18.290736 15574 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.130:44563 every 8 connection(s)
I20260923 17:14:18.291675 15446 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
I20260923 17:14:18.298905 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 15446
I20260923 17:14:18.299026 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance
I20260923 17:14:18.299362 12182 external_mini_cluster.cc:1428] Setting key da6643e4b8f1fd19c324ef1d6cb02015
Sep 23 17:14:18 dist-test-slave-1x1f krb5kdc[15205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183658, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.130@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:14:18.308075 15289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:18.293657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:49715 (local address 127.11.229.190:38261)
0923 17:14:18.293818 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:18.293822 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:18.294866 (+ 1044us) server_negotiation.cc:407] Connection header received
0923 17:14:18.296460 (+ 1594us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:18.296465 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:18.296529 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:18.296654 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:18.297932 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:18.298605 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:18.300093 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:18.300330 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:18.300453 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:18.303367 (+ 2914us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:18.303373 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:18.303378 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:18.303410 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:18.305260 (+ 1850us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:18.306072 (+ 812us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:18.306083 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:18.306084 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:18.306263 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:18.306807 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:18.306809 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:18.306811 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:18.307068 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:18.307238 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:18.307771 (+ 533us) server_negotiation.cc:299] Negotiation successful
0923 17:14:18.307907 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260923 17:14:18.309266 15577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:18.294071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:38261 (local address 127.11.229.130:49715)
0923 17:14:18.294677 (+ 606us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:18.294735 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:18.296210 (+ 1475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:18.296844 (+ 634us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:18.296852 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:18.297259 (+ 407us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:18.297772 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:18.297787 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:18.298767 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:18.298770 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:18.299879 (+ 1109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:18.299890 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:18.300494 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:18.300499 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:18.300691 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:18.301325 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:18.301342 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:18.303153 (+ 1811us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:18.305427 (+ 2274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:18.305436 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:18.305457 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:18.305949 (+ 492us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:18.306382 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:18.306389 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:18.306394 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:18.306626 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:18.307235 (+ 609us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:18.307242 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:18.307517 (+ 275us) client_negotiation.cc:769] Sending connection context
0923 17:14:18.307732 (+ 215us) client_negotiation.cc:240] Negotiation successful
0923 17:14:18.308172 (+ 440us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":392,"thread_start_us":191,"threads_started":1}
WARNING: no policy specified for kudu/127.11.229.131@KRBTEST.COM; defaulting to no policy
I20260923 17:14:18.310736 15575 heartbeater.cc:347] Connected to a master server at 127.11.229.190:38261
I20260923 17:14:18.310992 15575 heartbeater.cc:464] Registering TS with master...
I20260923 17:14:18.311599 15575 heartbeater.cc:511] Master 127.11.229.190:38261 requested a full tablet report, sending...
I20260923 17:14:18.312788 15250 ts_manager.cc:194] Registered new tserver with Master: 5f96ada2879043ec8fc10690675a6ec9 (127.11.229.130:44563)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.131@KRBTEST.COM" created.
I20260923 17:14:18.313581 15250 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.130@KRBTEST.COM'} at 127.11.229.130:49715
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab.
Entry for principal kudu/127.11.229.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab.
I20260923 17:14:18.333575 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.131:0
--local_ip_for_outbound_sockets=127.11.229.131
--webserver_interface=127.11.229.131
--webserver_port=0
--tserver_master_addrs=127.11.229.190:38261
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab
--principal=kudu/127.11.229.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:40621
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:14:18.451426 15580 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:18.451756 15580 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:18.451833 15580 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:18.456009 15580 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:18.456249 15580 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:18.456439 15580 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.131
I20260923 17:14:18.462133 15580 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:40621
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab
--principal=kudu/127.11.229.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.229.131
--webserver_port=0
--tserver_master_addrs=127.11.229.190:38261
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15580
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.131
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:18.463379 15580 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:18.464521 15580 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:18.475095 15586 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:18.475185 15588 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:18.475095 15585 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:18.476172 15580 server_base.cc:1034] running on GCE node
I20260923 17:14:18.476629 15580 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:18.477378 15580 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:18.478554 15580 hybrid_clock.cc:648] HybridClock initialized: now 1790183658478517 us; error 57 us; skew 500 ppm
Sep 23 17:14:18 dist-test-slave-1x1f krb5kdc[15205](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183658, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:18.481642 15580 init.cc:377] Logged in from keytab as kudu/127.11.229.131@KRBTEST.COM (short username kudu)
I20260923 17:14:18.482728 15580 webserver.cc:460] Webserver started at http://127.11.229.131:34333/ using document root <none> and password file <none>
I20260923 17:14:18.483332 15580 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:18.483425 15580 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:18.483668 15580 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:18.485855 15580 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-2/data/instance:
uuid: "fac32767eda546e093e8ba3cf58edbcd"
format_stamp: "Formatted at 2026-09-23 17:14:18 on dist-test-slave-1x1f"
server_key: "c5c0dc0fb7d543aca39a163aceb0f43a"
server_key_iv: "00a441574fc9653bb43906121dd48020"
server_key_version: "encryptionkey@0"
I20260923 17:14:18.486501 15580 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance:
uuid: "fac32767eda546e093e8ba3cf58edbcd"
format_stamp: "Formatted at 2026-09-23 17:14:18 on dist-test-slave-1x1f"
server_key: "c5c0dc0fb7d543aca39a163aceb0f43a"
server_key_iv: "00a441574fc9653bb43906121dd48020"
server_key_version: "encryptionkey@0"
I20260923 17:14:18.491873 15580 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260923 17:14:18.495126 15595 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:18.496584 15580 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 17:14:18.496749 15580 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-2/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-2/wal
uuid: "fac32767eda546e093e8ba3cf58edbcd"
format_stamp: "Formatted at 2026-09-23 17:14:18 on dist-test-slave-1x1f"
server_key: "c5c0dc0fb7d543aca39a163aceb0f43a"
server_key_iv: "00a441574fc9653bb43906121dd48020"
server_key_version: "encryptionkey@0"
I20260923 17:14:18.496886 15580 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:18.517772 15580 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:18.521373 15580 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:18.521632 15580 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:18.522321 15580 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:14:18.523202 15580 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:14:18.523272 15580 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:18.523344 15580 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:14:18.523388 15580 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:18.534595 15580 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.131:42139
I20260923 17:14:18.534658 15708 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.131:42139 every 8 connection(s)
I20260923 17:14:18.535561 15580 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
I20260923 17:14:18.541635 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 15580
I20260923 17:14:18.541774 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance
I20260923 17:14:18.542080 12182 external_mini_cluster.cc:1428] Setting key efeaf6259dff698689b03c10e49ade10
Sep 23 17:14:18 dist-test-slave-1x1f krb5kdc[15205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183658, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.131@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:14:18.551636 15289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:18.537523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:45531 (local address 127.11.229.190:38261)
0923 17:14:18.537726 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:18.537729 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:18.538638 (+ 909us) server_negotiation.cc:407] Connection header received
0923 17:14:18.540097 (+ 1459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:18.540100 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:18.540149 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:18.540229 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:18.541772 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:18.542610 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:18.544131 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:18.544371 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:18.544486 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:18.547163 (+ 2677us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:18.547167 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:18.547168 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:18.547195 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:18.548726 (+ 1531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:18.549418 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:18.549421 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:18.549422 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:18.549527 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:18.549950 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:18.549956 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:18.549957 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:18.550586 (+ 629us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:18.550698 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:18.551362 (+ 664us) server_negotiation.cc:299] Negotiation successful
0923 17:14:18.551494 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260923 17:14:18.552553 15711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:18.537969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:38261 (local address 127.11.229.131:45531)
0923 17:14:18.538492 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:18.538537 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:18.539860 (+ 1323us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:18.540447 (+ 587us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:18.540461 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:18.540886 (+ 425us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:18.541521 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:18.541543 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:18.542762 (+ 1219us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:18.542765 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:18.543989 (+ 1224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:18.544006 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:18.544525 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:18.544529 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:18.544705 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:18.545319 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:18.545337 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:18.546986 (+ 1649us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:18.548856 (+ 1870us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:18.548861 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:18.548875 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:18.549186 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:18.549618 (+ 432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:18.549620 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:18.549621 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:18.549767 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:18.550738 (+ 971us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:18.550744 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:18.551034 (+ 290us) client_negotiation.cc:769] Sending connection context
0923 17:14:18.551277 (+ 243us) client_negotiation.cc:240] Negotiation successful
0923 17:14:18.551586 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":119,"threads_started":1}
I20260923 17:14:18.554184 15709 heartbeater.cc:347] Connected to a master server at 127.11.229.190:38261
I20260923 17:14:18.554445 15709 heartbeater.cc:464] Registering TS with master...
I20260923 17:14:18.555100 15709 heartbeater.cc:511] Master 127.11.229.190:38261 requested a full tablet report, sending...
I20260923 17:14:18.556389 15249 ts_manager.cc:194] Registered new tserver with Master: fac32767eda546e093e8ba3cf58edbcd (127.11.229.131:42139)
I20260923 17:14:18.557024 15249 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.131@KRBTEST.COM'} at 127.11.229.131:45531
I20260923 17:14:18.569432 12182 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 23 17:14:18 dist-test-slave-1x1f krb5kdc[15205](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183658, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Sep 23 17:14:18 dist-test-slave-1x1f krb5kdc[15205](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183658, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:14:18.596309 15289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:18.587341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50670 (local address 127.11.229.190:38261)
0923 17:14:18.587501 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:18.587506 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:18.587680 (+ 174us) server_negotiation.cc:407] Connection header received
0923 17:14:18.587895 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:18.587897 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:18.587939 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:18.588025 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:18.588892 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:18.589417 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:18.590294 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:18.590515 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:18.590625 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:18.593080 (+ 2455us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:18.593084 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:18.593086 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:18.593109 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:18.594597 (+ 1488us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:18.595043 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:18.595049 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:18.595051 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:18.595128 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:18.595404 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:18.595408 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:18.595410 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:18.595638 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:18.595786 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:18.596018 (+ 232us) server_negotiation.cc:299] Negotiation successful
0923 17:14:18.596136 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
W20260923 17:14:18.596727 15249 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:50670
I20260923 17:14:18.598179 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 15312
I20260923 17:14:18.604398 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 15446
I20260923 17:14:18.610499 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 15580
I20260923 17:14:18.616143 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 15218
2026-09-23T17:14:18Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2223 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 17:14:18 dist-test-slave-1x1f krb5kdc[15721](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 17:14:18 dist-test-slave-1x1f krb5kdc[15721](info): set up 2 sockets
Sep 23 17:14:18 dist-test-slave-1x1f krb5kdc[15721](info): commencing operation
krb5kdc: starting...
W20260923 17:14:19.675099 12182 mini_kdc.cc:121] Time spent starting KDC: real 1.036s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Sep 23 17:14:19 dist-test-slave-1x1f krb5kdc[15721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183659, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T17:14:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:14:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.229.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
I20260923 17:14:19.802080 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:35509
--webserver_interface=127.11.229.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:33851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:35509
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:14:19.915342 15734 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:19.915720 15734 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:19.915799 15734 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:19.920243 15734 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:14:19.920368 15734 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:19.920410 15734 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:19.920450 15734 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:14:19.920488 15734 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:14:19.926635 15734 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:33851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:35509
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:35509
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.229.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15734
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:19.927855 15734 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:19.928939 15734 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:19.938297 15739 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:19.938413 15742 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:19.938472 15734 server_base.cc:1034] running on GCE node
W20260923 17:14:19.938323 15740 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:19.939044 15734 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:19.940161 15734 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:19.941363 15734 hybrid_clock.cc:648] HybridClock initialized: now 1790183659941322 us; error 53 us; skew 500 ppm
Sep 23 17:14:19 dist-test-slave-1x1f krb5kdc[15721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183659, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:19.944222 15734 init.cc:377] Logged in from keytab as kudu/127.11.229.190@KRBTEST.COM (short username kudu)
I20260923 17:14:19.945137 15734 webserver.cc:460] Webserver started at http://127.11.229.190:38495/ using document root <none> and password file <none>
I20260923 17:14:19.945741 15734 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:19.945844 15734 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:19.946084 15734 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:19.948271 15734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "70609ceed9e34a7dbc603334db8bf2e5"
format_stamp: "Formatted at 2026-09-23 17:14:19 on dist-test-slave-1x1f"
server_key: "d684cd092c913ec680bd98b371b20e87"
server_key_iv: "aedd14411dc95aef607dba3dbc5ca9ff"
server_key_version: "encryptionkey@0"
I20260923 17:14:19.948889 15734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "70609ceed9e34a7dbc603334db8bf2e5"
format_stamp: "Formatted at 2026-09-23 17:14:19 on dist-test-slave-1x1f"
server_key: "d684cd092c913ec680bd98b371b20e87"
server_key_iv: "aedd14411dc95aef607dba3dbc5ca9ff"
server_key_version: "encryptionkey@0"
I20260923 17:14:19.952807 15734 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260923 17:14:19.955511 15749 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:19.957020 15734 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260923 17:14:19.957209 15734 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "70609ceed9e34a7dbc603334db8bf2e5"
format_stamp: "Formatted at 2026-09-23 17:14:19 on dist-test-slave-1x1f"
server_key: "d684cd092c913ec680bd98b371b20e87"
server_key_iv: "aedd14411dc95aef607dba3dbc5ca9ff"
server_key_version: "encryptionkey@0"
I20260923 17:14:19.957365 15734 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:19.977062 15734 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:19.981436 15734 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:19.981698 15734 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:19.989356 15734 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.190:35509
I20260923 17:14:19.989646 15801 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.190:35509 every 8 connection(s)
I20260923 17:14:19.990532 15734 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:14:19.993727 15802 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:19.999421 15802 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70609ceed9e34a7dbc603334db8bf2e5: Bootstrap starting.
I20260923 17:14:19.999655 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 15734
I20260923 17:14:19.999806 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:14:20.000110 12182 external_mini_cluster.cc:1428] Setting key fcaee72306bb14ecaa97b2995b9824ad
I20260923 17:14:20.002151 15802 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 70609ceed9e34a7dbc603334db8bf2e5: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:20.002919 15802 log.cc:824] T 00000000000000000000000000000000 P 70609ceed9e34a7dbc603334db8bf2e5: Log is configured to *not* fsync() on all Append() calls
I20260923 17:14:20.004777 15802 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70609ceed9e34a7dbc603334db8bf2e5: No bootstrap required, opened a new log
I20260923 17:14:20.008636 15802 raft_consensus.cc:348] T 00000000000000000000000000000000 P 70609ceed9e34a7dbc603334db8bf2e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70609ceed9e34a7dbc603334db8bf2e5" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 35509 } }
I20260923 17:14:20.008963 15802 raft_consensus.cc:374] T 00000000000000000000000000000000 P 70609ceed9e34a7dbc603334db8bf2e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:20.009024 15802 raft_consensus.cc:729] T 00000000000000000000000000000000 P 70609ceed9e34a7dbc603334db8bf2e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70609ceed9e34a7dbc603334db8bf2e5, State: Initialized, Role: FOLLOWER
Sep 23 17:14:20 dist-test-slave-1x1f krb5kdc[15721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183659, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:14:20.009536 15802 consensus_queue.cc:260] T 00000000000000000000000000000000 P 70609ceed9e34a7dbc603334db8bf2e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70609ceed9e34a7dbc603334db8bf2e5" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 35509 } }
I20260923 17:14:20.009711 15802 raft_consensus.cc:388] T 00000000000000000000000000000000 P 70609ceed9e34a7dbc603334db8bf2e5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:14:20.009793 15802 raft_consensus.cc:482] T 00000000000000000000000000000000 P 70609ceed9e34a7dbc603334db8bf2e5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:14:20.009920 15802 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 70609ceed9e34a7dbc603334db8bf2e5 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:20.011284 15802 raft_consensus.cc:504] T 00000000000000000000000000000000 P 70609ceed9e34a7dbc603334db8bf2e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70609ceed9e34a7dbc603334db8bf2e5" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 35509 } }
I20260923 17:14:20.011693 15802 leader_election.cc:302] T 00000000000000000000000000000000 P 70609ceed9e34a7dbc603334db8bf2e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 70609ceed9e34a7dbc603334db8bf2e5; no voters:
I20260923 17:14:20.012061 15802 leader_election.cc:288] T 00000000000000000000000000000000 P 70609ceed9e34a7dbc603334db8bf2e5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 17:14:20.012194 15807 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 70609ceed9e34a7dbc603334db8bf2e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:14:20.012480 15807 raft_consensus.cc:686] T 00000000000000000000000000000000 P 70609ceed9e34a7dbc603334db8bf2e5 [term 1 LEADER]: Becoming Leader. State: Replica: 70609ceed9e34a7dbc603334db8bf2e5, State: Running, Role: LEADER
I20260923 17:14:20.012872 15807 consensus_queue.cc:237] T 00000000000000000000000000000000 P 70609ceed9e34a7dbc603334db8bf2e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70609ceed9e34a7dbc603334db8bf2e5" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 35509 } }
I20260923 17:14:20.013494 15802 sys_catalog.cc:564] T 00000000000000000000000000000000 P 70609ceed9e34a7dbc603334db8bf2e5 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:14:20.014740 15808 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70609ceed9e34a7dbc603334db8bf2e5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "70609ceed9e34a7dbc603334db8bf2e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70609ceed9e34a7dbc603334db8bf2e5" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 35509 } } }
I20260923 17:14:20.014882 15808 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70609ceed9e34a7dbc603334db8bf2e5 [sys.catalog]: This master's current role is: LEADER
I20260923 17:14:20.015236 15809 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70609ceed9e34a7dbc603334db8bf2e5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 70609ceed9e34a7dbc603334db8bf2e5. Latest consensus state: current_term: 1 leader_uuid: "70609ceed9e34a7dbc603334db8bf2e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70609ceed9e34a7dbc603334db8bf2e5" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 35509 } } }
I20260923 17:14:20.015369 15816 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:14:20.015410 15809 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70609ceed9e34a7dbc603334db8bf2e5 [sys.catalog]: This master's current role is: LEADER
I20260923 17:14:20.017654 15805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:20.001508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38626 (local address 127.11.229.190:35509)
0923 17:14:20.001964 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:20.001980 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:20.002016 (+ 36us) server_negotiation.cc:407] Connection header received
0923 17:14:20.002749 (+ 733us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:20.002768 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:20.003172 (+ 404us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:20.003505 (+ 333us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:20.004302 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:20.005362 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:20.006215 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:20.006757 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:20.006936 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:20.009996 (+ 3060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:20.010004 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:20.010029 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:20.010066 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:20.012261 (+ 2195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:20.012820 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:20.012826 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:20.012832 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:20.012964 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:20.013280 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:20.013284 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:20.013286 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:20.013881 (+ 595us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:20.015459 (+ 1578us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:20.016536 (+ 1077us) server_negotiation.cc:299] Negotiation successful
0923 17:14:20.016865 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":139,"threads_started":1}
I20260923 17:14:20.018793 15816 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:14:20.024652 15816 catalog_manager.cc:1347] Generated new cluster ID: 840f3ae94ca84e49a4c3a963932b15fb
I20260923 17:14:20.024796 15816 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:14:20.031947 15816 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:14:20.033046 15816 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:14:20.041915 15816 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 70609ceed9e34a7dbc603334db8bf2e5: Generated new TSK 0
I20260923 17:14:20.042796 15816 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.229.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab.
Entry for principal kudu/127.11.229.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab.
I20260923 17:14:20.085409 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.129:0
--local_ip_for_outbound_sockets=127.11.229.129
--webserver_interface=127.11.229.129
--webserver_port=0
--tserver_master_addrs=127.11.229.190:35509
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab
--principal=kudu/127.11.229.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:33851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:14:20.200564 15828 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:20.200897 15828 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:20.200984 15828 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:20.205196 15828 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:20.205309 15828 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:20.205410 15828 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.129
I20260923 17:14:20.210942 15828 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:33851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab
--principal=kudu/127.11.229.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.229.129
--webserver_port=0
--tserver_master_addrs=127.11.229.190:35509
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15828
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.129
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:20.212188 15828 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:20.213248 15828 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:20.223381 15834 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:20.223371 15836 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:20.223376 15833 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:20.223729 15828 server_base.cc:1034] running on GCE node
I20260923 17:14:20.224273 15828 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:20.224867 15828 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:20.226046 15828 hybrid_clock.cc:648] HybridClock initialized: now 1790183660226019 us; error 31 us; skew 500 ppm
Sep 23 17:14:20 dist-test-slave-1x1f krb5kdc[15721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183660, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:20.229025 15828 init.cc:377] Logged in from keytab as kudu/127.11.229.129@KRBTEST.COM (short username kudu)
I20260923 17:14:20.229991 15828 webserver.cc:460] Webserver started at http://127.11.229.129:40959/ using document root <none> and password file <none>
I20260923 17:14:20.230682 15828 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:20.230746 15828 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:20.230976 15828 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:20.233027 15828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/ts-0/data/instance:
uuid: "85c1f48981f64df796f7d5d932c94bc5"
format_stamp: "Formatted at 2026-09-23 17:14:20 on dist-test-slave-1x1f"
server_key: "a53bf89d096b11d87d666fee0293636c"
server_key_iv: "3d02662fba365f10c81c317a09e34375"
server_key_version: "encryptionkey@0"
I20260923 17:14:20.233600 15828 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance:
uuid: "85c1f48981f64df796f7d5d932c94bc5"
format_stamp: "Formatted at 2026-09-23 17:14:20 on dist-test-slave-1x1f"
server_key: "a53bf89d096b11d87d666fee0293636c"
server_key_iv: "3d02662fba365f10c81c317a09e34375"
server_key_version: "encryptionkey@0"
I20260923 17:14:20.237390 15828 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260923 17:14:20.239979 15843 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:20.241396 15828 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260923 17:14:20.241560 15828 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/ts-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/ts-0/wal
uuid: "85c1f48981f64df796f7d5d932c94bc5"
format_stamp: "Formatted at 2026-09-23 17:14:20 on dist-test-slave-1x1f"
server_key: "a53bf89d096b11d87d666fee0293636c"
server_key_iv: "3d02662fba365f10c81c317a09e34375"
server_key_version: "encryptionkey@0"
I20260923 17:14:20.241691 15828 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:20.259863 15828 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:20.263639 15828 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:20.263890 15828 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:20.264544 15828 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:14:20.265443 15828 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:14:20.265522 15828 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:20.265596 15828 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:14:20.265661 15828 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:20.276134 15828 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.129:43257
I20260923 17:14:20.276158 15956 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.129:43257 every 8 connection(s)
I20260923 17:14:20.277169 15828 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
I20260923 17:14:20.282917 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 15828
I20260923 17:14:20.283059 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance
I20260923 17:14:20.283463 12182 external_mini_cluster.cc:1428] Setting key 8f11d2b723413bf2574c45c428b94946
Sep 23 17:14:20 dist-test-slave-1x1f krb5kdc[15721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183660, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.129@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.229.130@KRBTEST.COM; defaulting to no policy
I20260923 17:14:20.294973 15805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:20.279332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:49389 (local address 127.11.229.190:35509)
0923 17:14:20.279496 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:20.279502 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:20.280467 (+ 965us) server_negotiation.cc:407] Connection header received
0923 17:14:20.281849 (+ 1382us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:20.281852 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:20.281905 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:20.281990 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:20.283878 (+ 1888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:20.284607 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:20.286624 (+ 2017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:20.286929 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:20.287093 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:20.290331 (+ 3238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:20.290339 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:20.290346 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:20.290384 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:20.292359 (+ 1975us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:20.292957 (+ 598us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:20.292961 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:20.292963 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:20.293096 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:20.293490 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:20.293495 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:20.293498 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:20.293784 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:20.293920 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:20.294579 (+ 659us) server_negotiation.cc:299] Negotiation successful
0923 17:14:20.294738 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260923 17:14:20.295950 15959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:20.279814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:35509 (local address 127.11.229.129:49389)
0923 17:14:20.280301 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:20.280345 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:20.281619 (+ 1274us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:20.282308 (+ 689us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:20.282320 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:20.282904 (+ 584us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:20.283683 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:20.283707 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:20.284777 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:20.284783 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:20.286474 (+ 1691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:20.286491 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:20.287198 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:20.287204 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:20.287378 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:20.288085 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:20.288134 (+ 49us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:20.290093 (+ 1959us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:20.292516 (+ 2423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:20.292522 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:20.292536 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:20.292833 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:20.293216 (+ 383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:20.293219 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:20.293220 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:20.293378 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:20.293922 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:20.293928 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:20.294213 (+ 285us) client_negotiation.cc:769] Sending connection context
0923 17:14:20.294501 (+ 288us) client_negotiation.cc:240] Negotiation successful
0923 17:14:20.294858 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"thread_start_us":121,"threads_started":1}
I20260923 17:14:20.297400 15957 heartbeater.cc:347] Connected to a master server at 127.11.229.190:35509
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.130@KRBTEST.COM" created.
I20260923 17:14:20.297724 15957 heartbeater.cc:464] Registering TS with master...
I20260923 17:14:20.298357 15957 heartbeater.cc:511] Master 127.11.229.190:35509 requested a full tablet report, sending...
I20260923 17:14:20.299944 15764 ts_manager.cc:194] Registered new tserver with Master: 85c1f48981f64df796f7d5d932c94bc5 (127.11.229.129:43257)
I20260923 17:14:20.301733 15764 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.129@KRBTEST.COM'} at 127.11.229.129:49389
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab.
Entry for principal kudu/127.11.229.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab.
I20260923 17:14:20.318003 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.130:0
--local_ip_for_outbound_sockets=127.11.229.130
--webserver_interface=127.11.229.130
--webserver_port=0
--tserver_master_addrs=127.11.229.190:35509
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab
--principal=kudu/127.11.229.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:33851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:14:20.433377 15962 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:20.433668 15962 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:20.433714 15962 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:20.437981 15962 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:20.438062 15962 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:20.438126 15962 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.130
I20260923 17:14:20.444240 15962 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:33851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab
--principal=kudu/127.11.229.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.229.130
--webserver_port=0
--tserver_master_addrs=127.11.229.190:35509
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15962
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.130
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:20.445506 15962 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:20.446715 15962 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:20.457088 15968 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:20.457321 15962 server_base.cc:1034] running on GCE node
W20260923 17:14:20.457108 15970 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:20.457093 15967 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:20.457875 15962 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:20.458696 15962 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:20.459898 15962 hybrid_clock.cc:648] HybridClock initialized: now 1790183660459851 us; error 61 us; skew 500 ppm
Sep 23 17:14:20 dist-test-slave-1x1f krb5kdc[15721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183660, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:20.463052 15962 init.cc:377] Logged in from keytab as kudu/127.11.229.130@KRBTEST.COM (short username kudu)
I20260923 17:14:20.464090 15962 webserver.cc:460] Webserver started at http://127.11.229.130:44395/ using document root <none> and password file <none>
I20260923 17:14:20.464709 15962 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:20.464807 15962 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:20.465054 15962 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:20.467363 15962 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/ts-1/data/instance:
uuid: "35461c53c1e14004bb453d79512c72aa"
format_stamp: "Formatted at 2026-09-23 17:14:20 on dist-test-slave-1x1f"
server_key: "ebe702dab1b96a0e2cc73cb8bed76a7d"
server_key_iv: "e96254bd7dbfe0633900c8d5a2b02199"
server_key_version: "encryptionkey@0"
I20260923 17:14:20.467984 15962 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance:
uuid: "35461c53c1e14004bb453d79512c72aa"
format_stamp: "Formatted at 2026-09-23 17:14:20 on dist-test-slave-1x1f"
server_key: "ebe702dab1b96a0e2cc73cb8bed76a7d"
server_key_iv: "e96254bd7dbfe0633900c8d5a2b02199"
server_key_version: "encryptionkey@0"
I20260923 17:14:20.471988 15962 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260923 17:14:20.474782 15977 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:20.476229 15962 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 17:14:20.476388 15962 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/ts-1/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/ts-1/wal
uuid: "35461c53c1e14004bb453d79512c72aa"
format_stamp: "Formatted at 2026-09-23 17:14:20 on dist-test-slave-1x1f"
server_key: "ebe702dab1b96a0e2cc73cb8bed76a7d"
server_key_iv: "e96254bd7dbfe0633900c8d5a2b02199"
server_key_version: "encryptionkey@0"
I20260923 17:14:20.476521 15962 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:20.511018 15962 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:20.515189 15962 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:20.515420 15962 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:20.516072 15962 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:14:20.517006 15962 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:14:20.517086 15962 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:20.517158 15962 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:14:20.517210 15962 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:20.526822 15962 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.130:34903
I20260923 17:14:20.526845 16090 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.130:34903 every 8 connection(s)
I20260923 17:14:20.527750 15962 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
I20260923 17:14:20.535954 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 15962
I20260923 17:14:20.536100 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance
I20260923 17:14:20.536412 12182 external_mini_cluster.cc:1428] Setting key c1cd28f09b93402406ed169294fd4057
Sep 23 17:14:20 dist-test-slave-1x1f krb5kdc[15721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183660, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.130@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:14:20.543324 15805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:20.529594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:54827 (local address 127.11.229.190:35509)
0923 17:14:20.529757 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:20.529762 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:20.530645 (+ 883us) server_negotiation.cc:407] Connection header received
0923 17:14:20.531950 (+ 1305us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:20.531953 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:20.531999 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:20.532078 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:20.533460 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:20.534039 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:20.535345 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:20.535596 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:20.535687 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:20.539059 (+ 3372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:20.539062 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:20.539064 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:20.539089 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:20.540711 (+ 1622us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:20.541411 (+ 700us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:20.541414 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:20.541416 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:20.541508 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:20.541956 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:20.541960 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:20.541962 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:20.542295 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:20.542401 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:20.542986 (+ 585us) server_negotiation.cc:299] Negotiation successful
0923 17:14:20.543135 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260923 17:14:20.544297 16093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:20.529990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:35509 (local address 127.11.229.130:54827)
0923 17:14:20.530494 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:20.530542 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:20.531756 (+ 1214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:20.532293 (+ 537us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:20.532300 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:20.532709 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:20.533285 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:20.533299 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:20.534219 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:20.534221 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:20.535202 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:20.535213 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:20.535869 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:20.535874 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:20.536188 (+ 314us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:20.536863 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:20.536884 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:20.538870 (+ 1986us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:20.540850 (+ 1980us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:20.540859 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:20.540877 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:20.541274 (+ 397us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:20.541621 (+ 347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:20.541626 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:20.541630 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:20.541841 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:20.542412 (+ 571us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:20.542421 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:20.542715 (+ 294us) client_negotiation.cc:769] Sending connection context
0923 17:14:20.542924 (+ 209us) client_negotiation.cc:240] Negotiation successful
0923 17:14:20.543291 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":173,"threads_started":1}
I20260923 17:14:20.545755 16091 heartbeater.cc:347] Connected to a master server at 127.11.229.190:35509
I20260923 17:14:20.546058 16091 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.11.229.131@KRBTEST.COM; defaulting to no policy
I20260923 17:14:20.546713 16091 heartbeater.cc:511] Master 127.11.229.190:35509 requested a full tablet report, sending...
I20260923 17:14:20.548319 15764 ts_manager.cc:194] Registered new tserver with Master: 35461c53c1e14004bb453d79512c72aa (127.11.229.130:34903)
I20260923 17:14:20.549072 15764 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.130@KRBTEST.COM'} at 127.11.229.130:54827
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab.
Entry for principal kudu/127.11.229.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab.
I20260923 17:14:20.570636 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.131:0
--local_ip_for_outbound_sockets=127.11.229.131
--webserver_interface=127.11.229.131
--webserver_port=0
--tserver_master_addrs=127.11.229.190:35509
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab
--principal=kudu/127.11.229.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:33851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:14:20.686628 16096 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:20.686909 16096 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:20.686955 16096 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:20.691134 16096 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:20.691200 16096 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:20.691259 16096 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.131
I20260923 17:14:20.696749 16096 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:33851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab
--principal=kudu/127.11.229.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.229.131
--webserver_port=0
--tserver_master_addrs=127.11.229.190:35509
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16096
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.131
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:20.697805 16096 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:20.698877 16096 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260923 17:14:20.708989 16096 server_base.cc:1034] running on GCE node
W20260923 17:14:20.708949 16102 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:20.708966 16101 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:20.708949 16104 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:20.709600 16096 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:20.710353 16096 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:20.711529 16096 hybrid_clock.cc:648] HybridClock initialized: now 1790183660711495 us; error 47 us; skew 500 ppm
Sep 23 17:14:20 dist-test-slave-1x1f krb5kdc[15721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183660, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:20.714615 16096 init.cc:377] Logged in from keytab as kudu/127.11.229.131@KRBTEST.COM (short username kudu)
I20260923 17:14:20.715577 16096 webserver.cc:460] Webserver started at http://127.11.229.131:40787/ using document root <none> and password file <none>
I20260923 17:14:20.716184 16096 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:20.716279 16096 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:20.716513 16096 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:20.718731 16096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/ts-2/data/instance:
uuid: "e3682bdabd2345658fd336e575ed963a"
format_stamp: "Formatted at 2026-09-23 17:14:20 on dist-test-slave-1x1f"
server_key: "d051f39b2e5ca5206a45c36043ed93c8"
server_key_iv: "ca040cf8da1028b67b4a7720d02502e9"
server_key_version: "encryptionkey@0"
I20260923 17:14:20.719333 16096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance:
uuid: "e3682bdabd2345658fd336e575ed963a"
format_stamp: "Formatted at 2026-09-23 17:14:20 on dist-test-slave-1x1f"
server_key: "d051f39b2e5ca5206a45c36043ed93c8"
server_key_iv: "ca040cf8da1028b67b4a7720d02502e9"
server_key_version: "encryptionkey@0"
I20260923 17:14:20.723389 16096 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260923 17:14:20.725965 16111 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:20.727404 16096 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 17:14:20.727561 16096 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/ts-2/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/ts-2/wal
uuid: "e3682bdabd2345658fd336e575ed963a"
format_stamp: "Formatted at 2026-09-23 17:14:20 on dist-test-slave-1x1f"
server_key: "d051f39b2e5ca5206a45c36043ed93c8"
server_key_iv: "ca040cf8da1028b67b4a7720d02502e9"
server_key_version: "encryptionkey@0"
I20260923 17:14:20.727695 16096 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:20.745087 16096 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:20.748735 16096 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:20.748956 16096 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:20.749644 16096 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:14:20.750617 16096 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:14:20.750701 16096 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:20.750770 16096 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:14:20.750823 16096 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:20.759970 16096 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.131:40971
I20260923 17:14:20.760022 16224 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.131:40971 every 8 connection(s)
I20260923 17:14:20.760957 16096 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
I20260923 17:14:20.767683 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 16096
I20260923 17:14:20.767827 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance
I20260923 17:14:20.768126 12182 external_mini_cluster.cc:1428] Setting key fa7bd9b104768f0a406fe94a69c7b9e2
Sep 23 17:14:20 dist-test-slave-1x1f krb5kdc[15721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183660, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.131@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:14:20.779150 15805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:20.763884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:44793 (local address 127.11.229.190:35509)
0923 17:14:20.764056 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:20.764062 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:20.765469 (+ 1407us) server_negotiation.cc:407] Connection header received
0923 17:14:20.766725 (+ 1256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:20.766728 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:20.766781 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:20.766864 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:20.768683 (+ 1819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:20.769394 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:20.771204 (+ 1810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:20.771490 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:20.771584 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:20.774351 (+ 2767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:20.774354 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:20.774357 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:20.774382 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:20.776488 (+ 2106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:20.777189 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:20.777193 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:20.777195 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:20.777314 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:20.777796 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:20.777799 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:20.777800 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:20.778006 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:20.778144 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:20.778807 (+ 663us) server_negotiation.cc:299] Negotiation successful
0923 17:14:20.778971 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260923 17:14:20.780057 16227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:20.764317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:35509 (local address 127.11.229.131:44793)
0923 17:14:20.765260 (+ 943us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:20.765326 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:20.766520 (+ 1194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:20.767065 (+ 545us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:20.767073 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:20.767610 (+ 537us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:20.768369 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:20.768390 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:20.769635 (+ 1245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:20.769639 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:20.770999 (+ 1360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:20.771010 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:20.771639 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:20.771641 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:20.771797 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:20.772410 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:20.772426 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:20.774073 (+ 1647us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:20.776660 (+ 2587us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:20.776681 (+ 21us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:20.776697 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:20.777009 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:20.777454 (+ 445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:20.777456 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:20.777458 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:20.777672 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:20.778180 (+ 508us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:20.778187 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:20.778531 (+ 344us) client_negotiation.cc:769] Sending connection context
0923 17:14:20.778760 (+ 229us) client_negotiation.cc:240] Negotiation successful
0923 17:14:20.779122 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":560,"thread_start_us":137,"threads_started":1}
I20260923 17:14:20.781342 16225 heartbeater.cc:347] Connected to a master server at 127.11.229.190:35509
I20260923 17:14:20.781606 16225 heartbeater.cc:464] Registering TS with master...
I20260923 17:14:20.782191 16225 heartbeater.cc:511] Master 127.11.229.190:35509 requested a full tablet report, sending...
I20260923 17:14:20.783571 15764 ts_manager.cc:194] Registered new tserver with Master: e3682bdabd2345658fd336e575ed963a (127.11.229.131:40971)
I20260923 17:14:20.784119 15764 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.131@KRBTEST.COM'} at 127.11.229.131:44793
I20260923 17:14:20.795939 12182 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 23 17:14:20 dist-test-slave-1x1f krb5kdc[15721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183660, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 23 17:14:20 dist-test-slave-1x1f krb5kdc[15721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183660, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.229.129@KRBTEST.COM
I20260923 17:14:20.822937 16232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:20.812985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46440 (local address 127.11.229.129:43257)
0923 17:14:20.813410 (+ 425us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:20.813418 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:20.813442 (+ 24us) server_negotiation.cc:407] Connection header received
0923 17:14:20.813495 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:20.813501 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:20.813712 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:20.813836 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:20.814709 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:20.815546 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:20.816410 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:20.816786 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:20.816871 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:20.819463 (+ 2592us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:20.819472 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:20.819485 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:20.819510 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:20.821012 (+ 1502us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:20.821428 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:20.821434 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:20.821435 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:20.821508 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:20.821845 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:20.821848 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:20.821849 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:20.822112 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:20.822356 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:20.822564 (+ 208us) server_negotiation.cc:299] Negotiation successful
0923 17:14:20.822738 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":271,"thread_start_us":157,"threads_started":1}
Sep 23 17:14:20 dist-test-slave-1x1f krb5kdc[15721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183660, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:14:20.838157 15805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:20.826457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38632 (local address 127.11.229.190:35509)
0923 17:14:20.826611 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:20.826617 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:20.826861 (+ 244us) server_negotiation.cc:407] Connection header received
0923 17:14:20.827032 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:20.827035 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:20.827080 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:20.827246 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:20.828550 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:20.829491 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:20.830456 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:20.830822 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:20.830935 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:20.834290 (+ 3355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:20.834295 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:20.834297 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:20.834329 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:20.836033 (+ 1704us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:20.836477 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:20.836481 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:20.836483 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:20.836579 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:20.836866 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:20.836870 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:20.836871 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:20.837192 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:20.837338 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:20.837852 (+ 514us) server_negotiation.cc:299] Negotiation successful
0923 17:14:20.837983 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
W20260923 17:14:20.838639 15764 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38632
I20260923 17:14:20.839407 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 15828
I20260923 17:14:20.845382 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 15962
I20260923 17:14:20.850944 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 16096
I20260923 17:14:20.856330 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 15734
2026-09-23T17:14:20Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2240 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 17:14:20 dist-test-slave-1x1f krb5kdc[16237](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 17:14:20 dist-test-slave-1x1f krb5kdc[16237](info): set up 2 sockets
Sep 23 17:14:20 dist-test-slave-1x1f krb5kdc[16237](info): commencing operation
krb5kdc: starting...
W20260923 17:14:21.910933 12182 mini_kdc.cc:121] Time spent starting KDC: real 1.032s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Sep 23 17:14:22 dist-test-slave-1x1f krb5kdc[16237](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183662, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T17:14:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:14:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.229.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
I20260923 17:14:22.050391 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:35399
--webserver_interface=127.11.229.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:36937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:35399
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:14:22.167941 16250 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:22.168277 16250 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:22.168355 16250 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:22.172533 16250 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:14:22.172631 16250 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:22.172667 16250 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:22.172708 16250 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:14:22.172747 16250 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:14:22.178355 16250 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:36937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:35399
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:35399
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.229.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16250
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:22.179538 16250 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:22.180603 16250 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:22.190766 16256 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:22.190768 16255 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:22.190766 16258 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:22.191238 16250 server_base.cc:1034] running on GCE node
I20260923 17:14:22.191871 16250 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:22.193115 16250 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:22.194321 16250 hybrid_clock.cc:648] HybridClock initialized: now 1790183662194291 us; error 40 us; skew 500 ppm
Sep 23 17:14:22 dist-test-slave-1x1f krb5kdc[16237](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183662, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:22.201866 16250 init.cc:377] Logged in from keytab as kudu/127.11.229.190@KRBTEST.COM (short username kudu)
I20260923 17:14:22.202768 16250 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:22.202868 16250 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:22.203213 16250 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:22.205402 16250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "a12711e9a61a43f0a823ba790766f4f1"
format_stamp: "Formatted at 2026-09-23 17:14:22 on dist-test-slave-1x1f"
server_key: "7bbcdc3ef309f79cfc0a6cdd87d08fe7"
server_key_iv: "8a1a8e0c05a692e2696aa77a907d07e9"
server_key_version: "encryptionkey@0"
I20260923 17:14:22.206017 16250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "a12711e9a61a43f0a823ba790766f4f1"
format_stamp: "Formatted at 2026-09-23 17:14:22 on dist-test-slave-1x1f"
server_key: "7bbcdc3ef309f79cfc0a6cdd87d08fe7"
server_key_iv: "8a1a8e0c05a692e2696aa77a907d07e9"
server_key_version: "encryptionkey@0"
I20260923 17:14:22.209812 16250 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260923 17:14:22.212529 16264 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:22.213792 16250 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 17:14:22.213933 16250 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "a12711e9a61a43f0a823ba790766f4f1"
format_stamp: "Formatted at 2026-09-23 17:14:22 on dist-test-slave-1x1f"
server_key: "7bbcdc3ef309f79cfc0a6cdd87d08fe7"
server_key_iv: "8a1a8e0c05a692e2696aa77a907d07e9"
server_key_version: "encryptionkey@0"
I20260923 17:14:22.214051 16250 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:22.227859 16250 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:22.231112 16250 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:22.231329 16250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:22.238752 16250 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.190:35399
I20260923 17:14:22.239024 16316 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.190:35399 every 8 connection(s)
I20260923 17:14:22.239449 16250 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:14:22.242483 16317 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:22.243220 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 16250
I20260923 17:14:22.243355 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:14:22.243665 12182 external_mini_cluster.cc:1428] Setting key 5196f614d923ddb6d62046f7adfaa5cd
I20260923 17:14:22.249483 16317 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a12711e9a61a43f0a823ba790766f4f1: Bootstrap starting.
I20260923 17:14:22.252482 16317 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a12711e9a61a43f0a823ba790766f4f1: Neither blocks nor log segments found. Creating new log.
Sep 23 17:14:22 dist-test-slave-1x1f krb5kdc[16237](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183662, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:14:22.253479 16317 log.cc:824] T 00000000000000000000000000000000 P a12711e9a61a43f0a823ba790766f4f1: Log is configured to *not* fsync() on all Append() calls
I20260923 17:14:22.255625 16317 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a12711e9a61a43f0a823ba790766f4f1: No bootstrap required, opened a new log
I20260923 17:14:22.259339 16320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:22.245200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53544 (local address 127.11.229.190:35399)
0923 17:14:22.245715 (+ 515us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:22.245731 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:22.245768 (+ 37us) server_negotiation.cc:407] Connection header received
0923 17:14:22.246594 (+ 826us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:22.246615 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:22.246965 (+ 350us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:22.247278 (+ 313us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:22.248247 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:22.249269 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:22.250551 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:22.251059 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:22.251214 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:22.254111 (+ 2897us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:22.254121 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:22.254144 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:22.254174 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:22.256188 (+ 2014us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:22.256722 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:22.256727 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:22.256731 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:22.256860 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:22.257171 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:22.257173 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:22.257174 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:22.257611 (+ 437us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:22.257774 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:22.258199 (+ 425us) server_negotiation.cc:299] Negotiation successful
0923 17:14:22.258578 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":345,"thread_start_us":158,"threads_started":1}
I20260923 17:14:22.260057 16317 raft_consensus.cc:348] T 00000000000000000000000000000000 P a12711e9a61a43f0a823ba790766f4f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a12711e9a61a43f0a823ba790766f4f1" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 35399 } }
I20260923 17:14:22.260290 16317 raft_consensus.cc:374] T 00000000000000000000000000000000 P a12711e9a61a43f0a823ba790766f4f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:22.260324 16317 raft_consensus.cc:729] T 00000000000000000000000000000000 P a12711e9a61a43f0a823ba790766f4f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a12711e9a61a43f0a823ba790766f4f1, State: Initialized, Role: FOLLOWER
I20260923 17:14:22.260768 16317 consensus_queue.cc:260] T 00000000000000000000000000000000 P a12711e9a61a43f0a823ba790766f4f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a12711e9a61a43f0a823ba790766f4f1" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 35399 } }
I20260923 17:14:22.260878 16317 raft_consensus.cc:388] T 00000000000000000000000000000000 P a12711e9a61a43f0a823ba790766f4f1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:14:22.260918 16317 raft_consensus.cc:482] T 00000000000000000000000000000000 P a12711e9a61a43f0a823ba790766f4f1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:14:22.260982 16317 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a12711e9a61a43f0a823ba790766f4f1 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:22.261971 16317 raft_consensus.cc:504] T 00000000000000000000000000000000 P a12711e9a61a43f0a823ba790766f4f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a12711e9a61a43f0a823ba790766f4f1" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 35399 } }
I20260923 17:14:22.262370 16317 leader_election.cc:302] T 00000000000000000000000000000000 P a12711e9a61a43f0a823ba790766f4f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a12711e9a61a43f0a823ba790766f4f1; no voters:
I20260923 17:14:22.262698 16317 leader_election.cc:288] T 00000000000000000000000000000000 P a12711e9a61a43f0a823ba790766f4f1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 17:14:22.262876 16322 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a12711e9a61a43f0a823ba790766f4f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:14:22.263132 16322 raft_consensus.cc:686] T 00000000000000000000000000000000 P a12711e9a61a43f0a823ba790766f4f1 [term 1 LEADER]: Becoming Leader. State: Replica: a12711e9a61a43f0a823ba790766f4f1, State: Running, Role: LEADER
I20260923 17:14:22.263438 16322 consensus_queue.cc:237] T 00000000000000000000000000000000 P a12711e9a61a43f0a823ba790766f4f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a12711e9a61a43f0a823ba790766f4f1" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 35399 } }
I20260923 17:14:22.263955 16317 sys_catalog.cc:564] T 00000000000000000000000000000000 P a12711e9a61a43f0a823ba790766f4f1 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:14:22.265312 16323 sys_catalog.cc:455] T 00000000000000000000000000000000 P a12711e9a61a43f0a823ba790766f4f1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a12711e9a61a43f0a823ba790766f4f1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a12711e9a61a43f0a823ba790766f4f1" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 35399 } } }
I20260923 17:14:22.265455 16323 sys_catalog.cc:458] T 00000000000000000000000000000000 P a12711e9a61a43f0a823ba790766f4f1 [sys.catalog]: This master's current role is: LEADER
I20260923 17:14:22.265782 16324 sys_catalog.cc:455] T 00000000000000000000000000000000 P a12711e9a61a43f0a823ba790766f4f1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a12711e9a61a43f0a823ba790766f4f1. Latest consensus state: current_term: 1 leader_uuid: "a12711e9a61a43f0a823ba790766f4f1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a12711e9a61a43f0a823ba790766f4f1" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 35399 } } }
I20260923 17:14:22.265875 16324 sys_catalog.cc:458] T 00000000000000000000000000000000 P a12711e9a61a43f0a823ba790766f4f1 [sys.catalog]: This master's current role is: LEADER
W20260923 17:14:22.268680 16337 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a12711e9a61a43f0a823ba790766f4f1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 17:14:22.268751 16337 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 17:14:22.268839 16333 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:14:22.269549 16333 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:14:22.274904 16333 catalog_manager.cc:1347] Generated new cluster ID: f842abb2bccf46bca100c8e4eacf5a9b
I20260923 17:14:22.274976 16333 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:14:22.281965 16333 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:14:22.283123 16333 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:14:22.292713 16333 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a12711e9a61a43f0a823ba790766f4f1: Generated new TSK 0
I20260923 17:14:22.293457 16333 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.229.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab.
Entry for principal kudu/127.11.229.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab.
I20260923 17:14:22.328922 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.129:0
--local_ip_for_outbound_sockets=127.11.229.129
--webserver_interface=127.11.229.129
--webserver_port=0
--tserver_master_addrs=127.11.229.190:35399
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab
--principal=kudu/127.11.229.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:36937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:14:22.447244 16343 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:22.447537 16343 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:22.447585 16343 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:22.451807 16343 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:22.451880 16343 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:22.451977 16343 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.129
I20260923 17:14:22.457670 16343 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:36937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab
--principal=kudu/127.11.229.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.229.129
--webserver_port=0
--tserver_master_addrs=127.11.229.190:35399
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16343
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.129
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:22.458853 16343 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:22.459889 16343 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:22.469792 16348 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:22.469846 16351 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:22.469879 16343 server_base.cc:1034] running on GCE node
W20260923 17:14:22.469799 16349 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:22.470604 16343 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:22.471385 16343 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:22.472589 16343 hybrid_clock.cc:648] HybridClock initialized: now 1790183662472559 us; error 43 us; skew 500 ppm
Sep 23 17:14:22 dist-test-slave-1x1f krb5kdc[16237](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183662, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:22.475744 16343 init.cc:377] Logged in from keytab as kudu/127.11.229.129@KRBTEST.COM (short username kudu)
I20260923 17:14:22.476514 16343 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:22.476612 16343 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:22.476845 16343 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:22.479146 16343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-0/data/instance:
uuid: "0810d58df85d411f9f91c791e918f50d"
format_stamp: "Formatted at 2026-09-23 17:14:22 on dist-test-slave-1x1f"
server_key: "3457c1357b2133abac7fec40b86df249"
server_key_iv: "07bab8f1ce3755e0ce7677917c7f7a6f"
server_key_version: "encryptionkey@0"
I20260923 17:14:22.479723 16343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance:
uuid: "0810d58df85d411f9f91c791e918f50d"
format_stamp: "Formatted at 2026-09-23 17:14:22 on dist-test-slave-1x1f"
server_key: "3457c1357b2133abac7fec40b86df249"
server_key_iv: "07bab8f1ce3755e0ce7677917c7f7a6f"
server_key_version: "encryptionkey@0"
I20260923 17:14:22.483695 16343 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260923 17:14:22.486357 16357 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:22.487819 16343 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 17:14:22.487929 16343 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-0/wal
uuid: "0810d58df85d411f9f91c791e918f50d"
format_stamp: "Formatted at 2026-09-23 17:14:22 on dist-test-slave-1x1f"
server_key: "3457c1357b2133abac7fec40b86df249"
server_key_iv: "07bab8f1ce3755e0ce7677917c7f7a6f"
server_key_version: "encryptionkey@0"
I20260923 17:14:22.488099 16343 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:22.500540 16343 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:22.503877 16343 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:22.504087 16343 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:22.504675 16343 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:14:22.505491 16343 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:14:22.505564 16343 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:22.505640 16343 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:14:22.505694 16343 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:22.515453 16343 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.129:32991
I20260923 17:14:22.515493 16470 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.129:32991 every 8 connection(s)
I20260923 17:14:22.516129 16343 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
Sep 23 17:14:22 dist-test-slave-1x1f krb5kdc[16237](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183662, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.129@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:14:22.525848 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 16343
I20260923 17:14:22.525942 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance
I20260923 17:14:22.526352 12182 external_mini_cluster.cc:1428] Setting key 1e7deb1f510b19818655c66a9247d863
I20260923 17:14:22.530086 16320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:22.517959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:55275 (local address 127.11.229.190:35399)
0923 17:14:22.518126 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:22.518130 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:22.519477 (+ 1347us) server_negotiation.cc:407] Connection header received
0923 17:14:22.520287 (+ 810us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:22.520290 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:22.520335 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:22.520420 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:22.521582 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:22.522138 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:22.523318 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:22.523552 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:22.523647 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:22.526188 (+ 2541us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:22.526192 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:22.526195 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:22.526256 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:22.527989 (+ 1733us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:22.528512 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:22.528516 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:22.528518 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:22.528605 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:22.528955 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:22.528960 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:22.528962 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:22.529160 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:22.529270 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:22.529793 (+ 523us) server_negotiation.cc:299] Negotiation successful
0923 17:14:22.529918 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260923 17:14:22.531002 16473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:22.518390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:35399 (local address 127.11.229.129:55275)
0923 17:14:22.519296 (+ 906us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:22.519349 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:22.520106 (+ 757us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:22.520596 (+ 490us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:22.520603 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:22.520944 (+ 341us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:22.521411 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:22.521424 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:22.522317 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:22.522320 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:22.523188 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:22.523198 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:22.523688 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:22.523691 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:22.523825 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:22.524378 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:22.524393 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:22.525944 (+ 1551us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:22.528114 (+ 2170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:22.528120 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:22.528137 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:22.528405 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:22.528704 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:22.528707 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:22.528709 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:22.528859 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:22.529270 (+ 411us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:22.529278 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:22.529544 (+ 266us) client_negotiation.cc:769] Sending connection context
0923 17:14:22.529742 (+ 198us) client_negotiation.cc:240] Negotiation successful
0923 17:14:22.530074 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":299,"thread_start_us":165,"threads_started":1}
I20260923 17:14:22.532292 16471 heartbeater.cc:347] Connected to a master server at 127.11.229.190:35399
I20260923 17:14:22.532650 16471 heartbeater.cc:464] Registering TS with master...
I20260923 17:14:22.533250 16471 heartbeater.cc:511] Master 127.11.229.190:35399 requested a full tablet report, sending...
I20260923 17:14:22.535173 16281 ts_manager.cc:194] Registered new tserver with Master: 0810d58df85d411f9f91c791e918f50d (127.11.229.129:32991)
WARNING: no policy specified for kudu/127.11.229.130@KRBTEST.COM; defaulting to no policy
I20260923 17:14:22.536731 16281 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.129@KRBTEST.COM'} at 127.11.229.129:55275
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab.
Entry for principal kudu/127.11.229.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab.
I20260923 17:14:22.557682 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.130:0
--local_ip_for_outbound_sockets=127.11.229.130
--webserver_interface=127.11.229.130
--webserver_port=0
--tserver_master_addrs=127.11.229.190:35399
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab
--principal=kudu/127.11.229.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:36937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:14:22.671932 16476 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:22.672195 16476 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:22.672241 16476 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:22.676231 16476 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:22.676290 16476 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:22.676352 16476 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.130
I20260923 17:14:22.681906 16476 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:36937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab
--principal=kudu/127.11.229.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.229.130
--webserver_port=0
--tserver_master_addrs=127.11.229.190:35399
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16476
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.130
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:22.683107 16476 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:22.684114 16476 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:22.694160 16481 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:22.694160 16482 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:22.694536 16476 server_base.cc:1034] running on GCE node
W20260923 17:14:22.694721 16484 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:22.695617 16476 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:22.696563 16476 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:22.697818 16476 hybrid_clock.cc:648] HybridClock initialized: now 1790183662697779 us; error 50 us; skew 500 ppm
Sep 23 17:14:22 dist-test-slave-1x1f krb5kdc[16237](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183662, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:22.701180 16476 init.cc:377] Logged in from keytab as kudu/127.11.229.130@KRBTEST.COM (short username kudu)
I20260923 17:14:22.702008 16476 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:22.702105 16476 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:22.702404 16476 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:22.704573 16476 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-1/data/instance:
uuid: "0d63c46fccac41f78d22db436716876f"
format_stamp: "Formatted at 2026-09-23 17:14:22 on dist-test-slave-1x1f"
server_key: "073ce6a78c44cf08ec34fb1dc49e1e2d"
server_key_iv: "2fadd83a44e2ec44807a3a4d41826199"
server_key_version: "encryptionkey@0"
I20260923 17:14:22.705170 16476 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance:
uuid: "0d63c46fccac41f78d22db436716876f"
format_stamp: "Formatted at 2026-09-23 17:14:22 on dist-test-slave-1x1f"
server_key: "073ce6a78c44cf08ec34fb1dc49e1e2d"
server_key_iv: "2fadd83a44e2ec44807a3a4d41826199"
server_key_version: "encryptionkey@0"
I20260923 17:14:22.709486 16476 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260923 17:14:22.712218 16490 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:22.713531 16476 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260923 17:14:22.713639 16476 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-1/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-1/wal
uuid: "0d63c46fccac41f78d22db436716876f"
format_stamp: "Formatted at 2026-09-23 17:14:22 on dist-test-slave-1x1f"
server_key: "073ce6a78c44cf08ec34fb1dc49e1e2d"
server_key_iv: "2fadd83a44e2ec44807a3a4d41826199"
server_key_version: "encryptionkey@0"
I20260923 17:14:22.713785 16476 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:22.741725 16476 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:22.745180 16476 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:22.745456 16476 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:22.746069 16476 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:14:22.747036 16476 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:14:22.747113 16476 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:22.747205 16476 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:14:22.747257 16476 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:22.757113 16476 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.130:36549
I20260923 17:14:22.757170 16603 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.130:36549 every 8 connection(s)
I20260923 17:14:22.757849 16476 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
I20260923 17:14:22.764796 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 16476
I20260923 17:14:22.764928 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance
I20260923 17:14:22.765273 12182 external_mini_cluster.cc:1428] Setting key 2d16cc8da66ee522c61ed137eeb43407
Sep 23 17:14:22 dist-test-slave-1x1f krb5kdc[16237](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183662, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.130@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:14:22.773471 16320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:22.759817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:40447 (local address 127.11.229.190:35399)
0923 17:14:22.760037 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:22.760041 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:22.760839 (+ 798us) server_negotiation.cc:407] Connection header received
0923 17:14:22.762144 (+ 1305us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:22.762148 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:22.762205 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:22.762308 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:22.763506 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:22.764117 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:22.765529 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:22.765799 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:22.765914 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:22.769173 (+ 3259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:22.769176 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:22.769178 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:22.769206 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:22.770857 (+ 1651us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:22.771598 (+ 741us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:22.771601 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:22.771603 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:22.771688 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:22.772122 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:22.772125 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:22.772127 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:22.772354 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:22.772436 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:22.773212 (+ 776us) server_negotiation.cc:299] Negotiation successful
0923 17:14:22.773339 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116}
I20260923 17:14:22.774760 16606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:22.760213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:35399 (local address 127.11.229.130:40447)
0923 17:14:22.760685 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:22.760728 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:22.761920 (+ 1192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:22.762474 (+ 554us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:22.762481 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:22.762848 (+ 367us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:22.763359 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:22.763372 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:22.764246 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:22.764254 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:22.765387 (+ 1133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:22.765400 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:22.765971 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:22.765977 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:22.766201 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:22.766996 (+ 795us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:22.767018 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:22.768935 (+ 1917us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:22.770996 (+ 2061us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:22.771006 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:22.771029 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:22.771462 (+ 433us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:22.771795 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:22.771801 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:22.771806 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:22.772006 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:22.772470 (+ 464us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:22.772478 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:22.772891 (+ 413us) client_negotiation.cc:769] Sending connection context
0923 17:14:22.773147 (+ 256us) client_negotiation.cc:240] Negotiation successful
0923 17:14:22.773557 (+ 410us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":115,"threads_started":1}
WARNING: no policy specified for kudu/127.11.229.131@KRBTEST.COM; defaulting to no policy
I20260923 17:14:22.776074 16604 heartbeater.cc:347] Connected to a master server at 127.11.229.190:35399
I20260923 17:14:22.776350 16604 heartbeater.cc:464] Registering TS with master...
I20260923 17:14:22.776872 16604 heartbeater.cc:511] Master 127.11.229.190:35399 requested a full tablet report, sending...
I20260923 17:14:22.778047 16281 ts_manager.cc:194] Registered new tserver with Master: 0d63c46fccac41f78d22db436716876f (127.11.229.130:36549)
I20260923 17:14:22.778749 16281 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.130@KRBTEST.COM'} at 127.11.229.130:40447
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab.
Entry for principal kudu/127.11.229.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab.
I20260923 17:14:22.797554 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.131:0
--local_ip_for_outbound_sockets=127.11.229.131
--webserver_interface=127.11.229.131
--webserver_port=0
--tserver_master_addrs=127.11.229.190:35399
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab
--principal=kudu/127.11.229.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:36937
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:14:22.913882 16609 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:22.914229 16609 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:22.914376 16609 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:22.918810 16609 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:22.918908 16609 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:22.919009 16609 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.131
I20260923 17:14:22.924562 16609 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:36937
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab
--principal=kudu/127.11.229.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.229.131
--webserver_port=0
--tserver_master_addrs=127.11.229.190:35399
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16609
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.131
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:22.925742 16609 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:22.926836 16609 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260923 17:14:22.937372 16609 server_base.cc:1034] running on GCE node
W20260923 17:14:22.937264 16615 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:22.937270 16617 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:22.937338 16614 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:22.938072 16609 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:22.938812 16609 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:22.940030 16609 hybrid_clock.cc:648] HybridClock initialized: now 1790183662939995 us; error 45 us; skew 500 ppm
Sep 23 17:14:22 dist-test-slave-1x1f krb5kdc[16237](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183662, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:22.943286 16609 init.cc:377] Logged in from keytab as kudu/127.11.229.131@KRBTEST.COM (short username kudu)
I20260923 17:14:22.944190 16609 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:22.944291 16609 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:22.944551 16609 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:22.946949 16609 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-2/data/instance:
uuid: "958e10c0ab2f41c3842537d3fef8c9b8"
format_stamp: "Formatted at 2026-09-23 17:14:22 on dist-test-slave-1x1f"
server_key: "2a5f97c1b847471aaca8309f6d6cc461"
server_key_iv: "5c91e6b0caca4928bc13c329a994aed3"
server_key_version: "encryptionkey@0"
I20260923 17:14:22.947613 16609 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance:
uuid: "958e10c0ab2f41c3842537d3fef8c9b8"
format_stamp: "Formatted at 2026-09-23 17:14:22 on dist-test-slave-1x1f"
server_key: "2a5f97c1b847471aaca8309f6d6cc461"
server_key_iv: "5c91e6b0caca4928bc13c329a994aed3"
server_key_version: "encryptionkey@0"
I20260923 17:14:22.952765 16609 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260923 17:14:22.956355 16623 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:22.957767 16609 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 17:14:22.957975 16609 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-2/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-2/wal
uuid: "958e10c0ab2f41c3842537d3fef8c9b8"
format_stamp: "Formatted at 2026-09-23 17:14:22 on dist-test-slave-1x1f"
server_key: "2a5f97c1b847471aaca8309f6d6cc461"
server_key_iv: "5c91e6b0caca4928bc13c329a994aed3"
server_key_version: "encryptionkey@0"
I20260923 17:14:22.958127 16609 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:22.976876 16609 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:22.980960 16609 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:22.981323 16609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:22.981967 16609 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:14:22.983086 16609 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:14:22.983162 16609 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:22.983247 16609 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:14:22.983291 16609 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:22.993106 16736 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.131:38907 every 8 connection(s)
I20260923 17:14:22.993108 16609 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.131:38907
I20260923 17:14:22.993824 16609 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
I20260923 17:14:22.994884 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 16609
I20260923 17:14:22.994994 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance
I20260923 17:14:22.995278 12182 external_mini_cluster.cc:1428] Setting key 0075bdeb926d6d3086821ab54746ee4b
Sep 23 17:14:23 dist-test-slave-1x1f krb5kdc[16237](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183662, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.131@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:14:23.010175 16320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:22.996548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:45039 (local address 127.11.229.190:35399)
0923 17:14:22.996729 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:22.996736 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:22.998218 (+ 1482us) server_negotiation.cc:407] Connection header received
0923 17:14:22.999236 (+ 1018us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:22.999239 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:22.999297 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:22.999420 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:23.000751 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:23.001358 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:23.002776 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:23.003022 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:23.003153 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:23.006169 (+ 3016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:23.006172 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:23.006174 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:23.006202 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:23.007798 (+ 1596us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:23.008346 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:23.008350 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:23.008352 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:23.008438 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:23.008841 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:23.008843 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:23.008845 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:23.009107 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:23.009226 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:23.009888 (+ 662us) server_negotiation.cc:299] Negotiation successful
0923 17:14:23.010020 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260923 17:14:23.011108 16739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:22.997015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:35399 (local address 127.11.229.131:45039)
0923 17:14:22.997964 (+ 949us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:22.998010 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:22.998999 (+ 989us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:22.999603 (+ 604us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:22.999610 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:23.000012 (+ 402us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:23.000576 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:23.000591 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:23.001518 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:23.001523 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:23.002629 (+ 1106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:23.002639 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:23.003196 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:23.003201 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:23.003392 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:23.004106 (+ 714us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:23.004291 (+ 185us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:23.005958 (+ 1667us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:23.007932 (+ 1974us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:23.007939 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:23.007957 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:23.008239 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:23.008531 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:23.008535 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:23.008537 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:23.008718 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:23.009245 (+ 527us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:23.009254 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:23.009598 (+ 344us) client_negotiation.cc:769] Sending connection context
0923 17:14:23.009828 (+ 230us) client_negotiation.cc:240] Negotiation successful
0923 17:14:23.010221 (+ 393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":175,"threads_started":1}
I20260923 17:14:23.012251 16737 heartbeater.cc:347] Connected to a master server at 127.11.229.190:35399
I20260923 17:14:23.012562 16737 heartbeater.cc:464] Registering TS with master...
I20260923 17:14:23.013059 16737 heartbeater.cc:511] Master 127.11.229.190:35399 requested a full tablet report, sending...
I20260923 17:14:23.014106 16281 ts_manager.cc:194] Registered new tserver with Master: 958e10c0ab2f41c3842537d3fef8c9b8 (127.11.229.131:38907)
I20260923 17:14:23.014734 16281 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.131@KRBTEST.COM'} at 127.11.229.131:45039
I20260923 17:14:23.022848 12182 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 17:14:23.032743 16320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:23.024971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51450 (local address 127.11.229.190:35399)
0923 17:14:23.025117 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:23.025121 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:23.025240 (+ 119us) server_negotiation.cc:407] Connection header received
0923 17:14:23.025401 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:23.025404 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:23.025452 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:23.025535 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:23.026321 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:23.026900 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:23.027816 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:23.028055 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:23.028194 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:23.029621 (+ 1427us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:23.029624 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:23.029626 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:23.029651 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:23.031157 (+ 1506us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:23.031556 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:23.031559 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:23.031560 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:23.031637 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:23.031942 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:23.031944 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:23.031945 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:23.032166 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:23.032278 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:23.032516 (+ 238us) server_negotiation.cc:299] Negotiation successful
0923 17:14:23.032610 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260923 17:14:23.035976 16281 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51450:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 17:14:23.039032 16281 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 17:14:23.055040 16748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:23.048014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.131:38907 (local address 127.0.0.1:46408)
0923 17:14:23.048747 (+ 733us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:23.048762 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:23.048847 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:23.049396 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:23.049402 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:23.049424 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:14:23.049567 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:23.049575 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:23.051246 (+ 1671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:23.051250 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:23.052939 (+ 1689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:23.052950 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:23.054441 (+ 1491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:23.054447 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:23.054564 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:23.054586 (+ 22us) client_negotiation.cc:769] Sending connection context
0923 17:14:23.054642 (+ 56us) client_negotiation.cc:240] Negotiation successful
0923 17:14:23.054704 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":663,"mutex_wait_us":39,"thread_start_us":120,"threads_started":1}
I20260923 17:14:23.055191 16749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:23.047852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54784 (local address 127.11.229.129:32991)
0923 17:14:23.049296 (+ 1444us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:23.049305 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:23.049331 (+ 26us) server_negotiation.cc:407] Connection header received
0923 17:14:23.049403 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:23.049408 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:23.049571 (+ 163us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:23.049708 (+ 137us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:14:23.049998 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:23.051128 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:23.052795 (+ 1667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:23.053891 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:23.054031 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:23.054191 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:23.054908 (+ 717us) server_negotiation.cc:299] Negotiation successful
0923 17:14:23.055027 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1340,"thread_start_us":69,"threads_started":1}
I20260923 17:14:23.055929 16751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:23.048390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46408 (local address 127.11.229.131:38907)
0923 17:14:23.048802 (+ 412us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:23.048819 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:23.048844 (+ 25us) server_negotiation.cc:407] Connection header received
0923 17:14:23.048993 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:23.049003 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:23.049224 (+ 221us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:23.049720 (+ 496us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:14:23.049847 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:23.051082 (+ 1235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:23.053180 (+ 2098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:23.054283 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:23.055490 (+ 1207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:23.055592 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:23.055674 (+ 82us) server_negotiation.cc:299] Negotiation successful
0923 17:14:23.055786 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":119,"threads_started":1}
I20260923 17:14:23.054826 16750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:23.047664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:32991 (local address 127.0.0.1:54784)
0923 17:14:23.048373 (+ 709us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:23.048569 (+ 196us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:23.048719 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:23.049769 (+ 1050us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:23.049774 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:23.049794 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:14:23.049882 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:23.049889 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:23.051228 (+ 1339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:23.051232 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:23.052632 (+ 1400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:23.052642 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:23.054052 (+ 1410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:23.054056 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:23.054261 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:23.054317 (+ 56us) client_negotiation.cc:769] Sending connection context
0923 17:14:23.054452 (+ 135us) client_negotiation.cc:240] Negotiation successful
0923 17:14:23.054610 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":538,"mutex_wait_us":164,"thread_start_us":114,"threads_started":1}
I20260923 17:14:23.056360 16752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:23.048452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.130:36549 (local address 127.0.0.1:38846)
0923 17:14:23.048970 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:23.048983 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:23.049058 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:23.049576 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:23.049579 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:23.049596 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:14:23.049704 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:23.049712 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:23.051227 (+ 1515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:23.051232 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:23.054307 (+ 3075us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:23.054317 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:23.055863 (+ 1546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:23.055867 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:23.055968 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:23.055999 (+ 31us) client_negotiation.cc:769] Sending connection context
0923 17:14:23.056096 (+ 97us) client_negotiation.cc:240] Negotiation successful
0923 17:14:23.056185 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":461,"mutex_wait_us":1638,"thread_start_us":96,"threads_started":1}
I20260923 17:14:23.056803 16753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:23.048648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38846 (local address 127.11.229.130:36549)
0923 17:14:23.049108 (+ 460us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:23.049120 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:23.049147 (+ 27us) server_negotiation.cc:407] Connection header received
0923 17:14:23.049226 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:23.049233 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:23.049426 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:23.049605 (+ 179us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:14:23.049842 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:23.051001 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:23.054452 (+ 3451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:23.055535 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:23.055679 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:23.055798 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:23.056538 (+ 740us) server_negotiation.cc:299] Negotiation successful
0923 17:14:23.056647 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":362,"thread_start_us":93,"threads_started":1}
I20260923 17:14:23.059191 16671 tablet_service.cc:1467] Processing CreateTablet for tablet 6c665686d6de4abea60e58aead18ec60 (DEFAULT_TABLE table=test-table [id=df12a15e966b45b48c2164406059188a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:14:23.059149 16405 tablet_service.cc:1467] Processing CreateTablet for tablet 6c665686d6de4abea60e58aead18ec60 (DEFAULT_TABLE table=test-table [id=df12a15e966b45b48c2164406059188a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:14:23.059758 16538 tablet_service.cc:1467] Processing CreateTablet for tablet 6c665686d6de4abea60e58aead18ec60 (DEFAULT_TABLE table=test-table [id=df12a15e966b45b48c2164406059188a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:14:23.060353 16405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c665686d6de4abea60e58aead18ec60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:23.060369 16671 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c665686d6de4abea60e58aead18ec60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:23.060691 16538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c665686d6de4abea60e58aead18ec60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:23.068579 16754 tablet_bootstrap.cc:492] T 6c665686d6de4abea60e58aead18ec60 P 0810d58df85d411f9f91c791e918f50d: Bootstrap starting.
I20260923 17:14:23.069736 16756 tablet_bootstrap.cc:492] T 6c665686d6de4abea60e58aead18ec60 P 0d63c46fccac41f78d22db436716876f: Bootstrap starting.
I20260923 17:14:23.070580 16755 tablet_bootstrap.cc:492] T 6c665686d6de4abea60e58aead18ec60 P 958e10c0ab2f41c3842537d3fef8c9b8: Bootstrap starting.
I20260923 17:14:23.071969 16754 tablet_bootstrap.cc:654] T 6c665686d6de4abea60e58aead18ec60 P 0810d58df85d411f9f91c791e918f50d: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:23.071985 16756 tablet_bootstrap.cc:654] T 6c665686d6de4abea60e58aead18ec60 P 0d63c46fccac41f78d22db436716876f: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:23.072631 16755 tablet_bootstrap.cc:654] T 6c665686d6de4abea60e58aead18ec60 P 958e10c0ab2f41c3842537d3fef8c9b8: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:23.072818 16754 log.cc:824] T 6c665686d6de4abea60e58aead18ec60 P 0810d58df85d411f9f91c791e918f50d: Log is configured to *not* fsync() on all Append() calls
I20260923 17:14:23.073324 16756 log.cc:824] T 6c665686d6de4abea60e58aead18ec60 P 0d63c46fccac41f78d22db436716876f: Log is configured to *not* fsync() on all Append() calls
I20260923 17:14:23.073706 16755 log.cc:824] T 6c665686d6de4abea60e58aead18ec60 P 958e10c0ab2f41c3842537d3fef8c9b8: Log is configured to *not* fsync() on all Append() calls
I20260923 17:14:23.075225 16754 tablet_bootstrap.cc:492] T 6c665686d6de4abea60e58aead18ec60 P 0810d58df85d411f9f91c791e918f50d: No bootstrap required, opened a new log
I20260923 17:14:23.075443 16754 ts_tablet_manager.cc:1397] T 6c665686d6de4abea60e58aead18ec60 P 0810d58df85d411f9f91c791e918f50d: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260923 17:14:23.075640 16756 tablet_bootstrap.cc:492] T 6c665686d6de4abea60e58aead18ec60 P 0d63c46fccac41f78d22db436716876f: No bootstrap required, opened a new log
I20260923 17:14:23.075774 16755 tablet_bootstrap.cc:492] T 6c665686d6de4abea60e58aead18ec60 P 958e10c0ab2f41c3842537d3fef8c9b8: No bootstrap required, opened a new log
I20260923 17:14:23.075845 16756 ts_tablet_manager.cc:1397] T 6c665686d6de4abea60e58aead18ec60 P 0d63c46fccac41f78d22db436716876f: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260923 17:14:23.075959 16755 ts_tablet_manager.cc:1397] T 6c665686d6de4abea60e58aead18ec60 P 958e10c0ab2f41c3842537d3fef8c9b8: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260923 17:14:23.079170 16756 raft_consensus.cc:348] T 6c665686d6de4abea60e58aead18ec60 P 0d63c46fccac41f78d22db436716876f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0810d58df85d411f9f91c791e918f50d" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 32991 } } peers { permanent_uuid: "0d63c46fccac41f78d22db436716876f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 36549 } } peers { permanent_uuid: "958e10c0ab2f41c3842537d3fef8c9b8" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38907 } }
I20260923 17:14:23.079442 16756 raft_consensus.cc:374] T 6c665686d6de4abea60e58aead18ec60 P 0d63c46fccac41f78d22db436716876f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:23.079495 16756 raft_consensus.cc:729] T 6c665686d6de4abea60e58aead18ec60 P 0d63c46fccac41f78d22db436716876f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d63c46fccac41f78d22db436716876f, State: Initialized, Role: FOLLOWER
I20260923 17:14:23.079969 16756 consensus_queue.cc:260] T 6c665686d6de4abea60e58aead18ec60 P 0d63c46fccac41f78d22db436716876f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0810d58df85d411f9f91c791e918f50d" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 32991 } } peers { permanent_uuid: "0d63c46fccac41f78d22db436716876f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 36549 } } peers { permanent_uuid: "958e10c0ab2f41c3842537d3fef8c9b8" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38907 } }
I20260923 17:14:23.080253 16755 raft_consensus.cc:348] T 6c665686d6de4abea60e58aead18ec60 P 958e10c0ab2f41c3842537d3fef8c9b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0810d58df85d411f9f91c791e918f50d" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 32991 } } peers { permanent_uuid: "0d63c46fccac41f78d22db436716876f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 36549 } } peers { permanent_uuid: "958e10c0ab2f41c3842537d3fef8c9b8" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38907 } }
I20260923 17:14:23.080542 16755 raft_consensus.cc:374] T 6c665686d6de4abea60e58aead18ec60 P 958e10c0ab2f41c3842537d3fef8c9b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:23.080607 16755 raft_consensus.cc:729] T 6c665686d6de4abea60e58aead18ec60 P 958e10c0ab2f41c3842537d3fef8c9b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 958e10c0ab2f41c3842537d3fef8c9b8, State: Initialized, Role: FOLLOWER
I20260923 17:14:23.080775 16604 heartbeater.cc:503] Master 127.11.229.190:35399 was elected leader, sending a full tablet report...
I20260923 17:14:23.080884 16754 raft_consensus.cc:348] T 6c665686d6de4abea60e58aead18ec60 P 0810d58df85d411f9f91c791e918f50d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0810d58df85d411f9f91c791e918f50d" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 32991 } } peers { permanent_uuid: "0d63c46fccac41f78d22db436716876f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 36549 } } peers { permanent_uuid: "958e10c0ab2f41c3842537d3fef8c9b8" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38907 } }
I20260923 17:14:23.081089 16756 ts_tablet_manager.cc:1428] T 6c665686d6de4abea60e58aead18ec60 P 0d63c46fccac41f78d22db436716876f: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260923 17:14:23.081073 16755 consensus_queue.cc:260] T 6c665686d6de4abea60e58aead18ec60 P 958e10c0ab2f41c3842537d3fef8c9b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0810d58df85d411f9f91c791e918f50d" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 32991 } } peers { permanent_uuid: "0d63c46fccac41f78d22db436716876f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 36549 } } peers { permanent_uuid: "958e10c0ab2f41c3842537d3fef8c9b8" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38907 } }
I20260923 17:14:23.081161 16754 raft_consensus.cc:374] T 6c665686d6de4abea60e58aead18ec60 P 0810d58df85d411f9f91c791e918f50d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:23.081213 16754 raft_consensus.cc:729] T 6c665686d6de4abea60e58aead18ec60 P 0810d58df85d411f9f91c791e918f50d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0810d58df85d411f9f91c791e918f50d, State: Initialized, Role: FOLLOWER
I20260923 17:14:23.081750 16737 heartbeater.cc:503] Master 127.11.229.190:35399 was elected leader, sending a full tablet report...
I20260923 17:14:23.082113 16755 ts_tablet_manager.cc:1428] T 6c665686d6de4abea60e58aead18ec60 P 958e10c0ab2f41c3842537d3fef8c9b8: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260923 17:14:23.082690 16754 consensus_queue.cc:260] T 6c665686d6de4abea60e58aead18ec60 P 0810d58df85d411f9f91c791e918f50d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0810d58df85d411f9f91c791e918f50d" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 32991 } } peers { permanent_uuid: "0d63c46fccac41f78d22db436716876f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 36549 } } peers { permanent_uuid: "958e10c0ab2f41c3842537d3fef8c9b8" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38907 } }
I20260923 17:14:23.083487 16471 heartbeater.cc:503] Master 127.11.229.190:35399 was elected leader, sending a full tablet report...
I20260923 17:14:23.083765 16754 ts_tablet_manager.cc:1428] T 6c665686d6de4abea60e58aead18ec60 P 0810d58df85d411f9f91c791e918f50d: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260923 17:14:23.208666 16761 raft_consensus.cc:482] T 6c665686d6de4abea60e58aead18ec60 P 958e10c0ab2f41c3842537d3fef8c9b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 17:14:23.208901 16761 raft_consensus.cc:504] T 6c665686d6de4abea60e58aead18ec60 P 958e10c0ab2f41c3842537d3fef8c9b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0810d58df85d411f9f91c791e918f50d" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 32991 } } peers { permanent_uuid: "0d63c46fccac41f78d22db436716876f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 36549 } } peers { permanent_uuid: "958e10c0ab2f41c3842537d3fef8c9b8" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38907 } }
I20260923 17:14:23.210096 16761 leader_election.cc:288] T 6c665686d6de4abea60e58aead18ec60 P 958e10c0ab2f41c3842537d3fef8c9b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0810d58df85d411f9f91c791e918f50d (127.11.229.129:32991), 0d63c46fccac41f78d22db436716876f (127.11.229.130:36549)
I20260923 17:14:23.214521 16739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:23.210435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:32991 (local address 127.11.229.131:39477)
0923 17:14:23.210584 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:23.210600 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:23.210707 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:23.211056 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:23.211059 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:23.211083 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:14:23.211223 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:23.211230 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:23.212158 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:23.212161 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:23.213061 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:23.213070 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:23.214031 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:23.214035 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:23.214141 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:23.214167 (+ 26us) client_negotiation.cc:769] Sending connection context
0923 17:14:23.214285 (+ 118us) client_negotiation.cc:240] Negotiation successful
0923 17:14:23.214359 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260923 17:14:23.214570 16749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:23.210553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:39477 (local address 127.11.229.129:32991)
0923 17:14:23.210703 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:23.210708 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:23.210732 (+ 24us) server_negotiation.cc:407] Connection header received
0923 17:14:23.210824 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:23.210829 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:23.210881 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:23.210974 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:14:23.211424 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:23.212050 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:23.213215 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:23.213913 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:23.214017 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:23.214060 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:23.214353 (+ 293us) server_negotiation.cc:299] Negotiation successful
0923 17:14:23.214428 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260923 17:14:23.215080 16763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:23.210716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.130:36549 (local address 127.11.229.131:47721)
0923 17:14:23.211061 (+ 345us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:23.211076 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:23.211166 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:23.211424 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:23.211427 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:23.211445 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:14:23.211553 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:23.211558 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:23.212497 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:23.212500 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:23.213615 (+ 1115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:23.213626 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:23.214507 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:23.214511 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:23.214774 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:23.214813 (+ 39us) client_negotiation.cc:769] Sending connection context
0923 17:14:23.214892 (+ 79us) client_negotiation.cc:240] Negotiation successful
0923 17:14:23.214970 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":167,"threads_started":1}
I20260923 17:14:23.215178 16753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:23.210858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:47721 (local address 127.11.229.130:36549)
0923 17:14:23.211003 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:23.211010 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:23.211163 (+ 153us) server_negotiation.cc:407] Connection header received
0923 17:14:23.211238 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:23.211241 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:23.211294 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:23.211373 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:14:23.211729 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:23.212360 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:23.213756 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:23.214394 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:23.214502 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:23.214553 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:23.214919 (+ 366us) server_negotiation.cc:299] Negotiation successful
0923 17:14:23.215012 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260923 17:14:23.215267 16425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c665686d6de4abea60e58aead18ec60" candidate_uuid: "958e10c0ab2f41c3842537d3fef8c9b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0810d58df85d411f9f91c791e918f50d" is_pre_election: true
I20260923 17:14:23.215603 16425 raft_consensus.cc:2454] T 6c665686d6de4abea60e58aead18ec60 P 0810d58df85d411f9f91c791e918f50d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 958e10c0ab2f41c3842537d3fef8c9b8 in term 0.
I20260923 17:14:23.215817 16558 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c665686d6de4abea60e58aead18ec60" candidate_uuid: "958e10c0ab2f41c3842537d3fef8c9b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d63c46fccac41f78d22db436716876f" is_pre_election: true
I20260923 17:14:23.216128 16627 leader_election.cc:302] T 6c665686d6de4abea60e58aead18ec60 P 958e10c0ab2f41c3842537d3fef8c9b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0810d58df85d411f9f91c791e918f50d, 958e10c0ab2f41c3842537d3fef8c9b8; no voters:
I20260923 17:14:23.216141 16558 raft_consensus.cc:2454] T 6c665686d6de4abea60e58aead18ec60 P 0d63c46fccac41f78d22db436716876f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 958e10c0ab2f41c3842537d3fef8c9b8 in term 0.
I20260923 17:14:23.216415 16761 raft_consensus.cc:2781] T 6c665686d6de4abea60e58aead18ec60 P 958e10c0ab2f41c3842537d3fef8c9b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 17:14:23.216516 16761 raft_consensus.cc:482] T 6c665686d6de4abea60e58aead18ec60 P 958e10c0ab2f41c3842537d3fef8c9b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 17:14:23.216570 16761 raft_consensus.cc:3037] T 6c665686d6de4abea60e58aead18ec60 P 958e10c0ab2f41c3842537d3fef8c9b8 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:23.217795 16761 raft_consensus.cc:504] T 6c665686d6de4abea60e58aead18ec60 P 958e10c0ab2f41c3842537d3fef8c9b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0810d58df85d411f9f91c791e918f50d" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 32991 } } peers { permanent_uuid: "0d63c46fccac41f78d22db436716876f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 36549 } } peers { permanent_uuid: "958e10c0ab2f41c3842537d3fef8c9b8" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38907 } }
I20260923 17:14:23.218204 16761 leader_election.cc:288] T 6c665686d6de4abea60e58aead18ec60 P 958e10c0ab2f41c3842537d3fef8c9b8 [CANDIDATE]: Term 1 election: Requested vote from peers 0810d58df85d411f9f91c791e918f50d (127.11.229.129:32991), 0d63c46fccac41f78d22db436716876f (127.11.229.130:36549)
I20260923 17:14:23.218714 16558 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c665686d6de4abea60e58aead18ec60" candidate_uuid: "958e10c0ab2f41c3842537d3fef8c9b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d63c46fccac41f78d22db436716876f"
I20260923 17:14:23.218719 16425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c665686d6de4abea60e58aead18ec60" candidate_uuid: "958e10c0ab2f41c3842537d3fef8c9b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0810d58df85d411f9f91c791e918f50d"
I20260923 17:14:23.218825 16558 raft_consensus.cc:3037] T 6c665686d6de4abea60e58aead18ec60 P 0d63c46fccac41f78d22db436716876f [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:23.218886 16425 raft_consensus.cc:3037] T 6c665686d6de4abea60e58aead18ec60 P 0810d58df85d411f9f91c791e918f50d [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:23.219869 16558 raft_consensus.cc:2454] T 6c665686d6de4abea60e58aead18ec60 P 0d63c46fccac41f78d22db436716876f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 958e10c0ab2f41c3842537d3fef8c9b8 in term 1.
I20260923 17:14:23.220134 16425 raft_consensus.cc:2454] T 6c665686d6de4abea60e58aead18ec60 P 0810d58df85d411f9f91c791e918f50d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 958e10c0ab2f41c3842537d3fef8c9b8 in term 1.
I20260923 17:14:23.220191 16627 leader_election.cc:302] T 6c665686d6de4abea60e58aead18ec60 P 958e10c0ab2f41c3842537d3fef8c9b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d63c46fccac41f78d22db436716876f, 958e10c0ab2f41c3842537d3fef8c9b8; no voters:
I20260923 17:14:23.220353 16761 raft_consensus.cc:2781] T 6c665686d6de4abea60e58aead18ec60 P 958e10c0ab2f41c3842537d3fef8c9b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:14:23.220590 16761 raft_consensus.cc:686] T 6c665686d6de4abea60e58aead18ec60 P 958e10c0ab2f41c3842537d3fef8c9b8 [term 1 LEADER]: Becoming Leader. State: Replica: 958e10c0ab2f41c3842537d3fef8c9b8, State: Running, Role: LEADER
I20260923 17:14:23.220975 16761 consensus_queue.cc:237] T 6c665686d6de4abea60e58aead18ec60 P 958e10c0ab2f41c3842537d3fef8c9b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0810d58df85d411f9f91c791e918f50d" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 32991 } } peers { permanent_uuid: "0d63c46fccac41f78d22db436716876f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 36549 } } peers { permanent_uuid: "958e10c0ab2f41c3842537d3fef8c9b8" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38907 } }
I20260923 17:14:23.224587 16281 catalog_manager.cc:5495] T 6c665686d6de4abea60e58aead18ec60 P 958e10c0ab2f41c3842537d3fef8c9b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 958e10c0ab2f41c3842537d3fef8c9b8 (127.11.229.131). New cstate: current_term: 1 leader_uuid: "958e10c0ab2f41c3842537d3fef8c9b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0810d58df85d411f9f91c791e918f50d" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 32991 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d63c46fccac41f78d22db436716876f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 36549 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "958e10c0ab2f41c3842537d3fef8c9b8" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38907 } health_report { overall_health: HEALTHY } } }
W20260923 17:14:23.244751 16738 tablet.cc:2369] T 6c665686d6de4abea60e58aead18ec60 P 958e10c0ab2f41c3842537d3fef8c9b8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 17:14:23.246557 16751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:23.242144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46418 (local address 127.11.229.131:38907)
0923 17:14:23.242337 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:23.242343 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:23.242436 (+ 93us) server_negotiation.cc:407] Connection header received
0923 17:14:23.242618 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:23.242622 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:23.242694 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:23.242818 (+ 124us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 17:14:23.243059 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:23.243909 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:23.244885 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:23.245177 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:23.245311 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:23.245640 (+ 329us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 17:14:23.246071 (+ 431us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 17:14:23.246218 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:23.246318 (+ 100us) server_negotiation.cc:299] Negotiation successful
0923 17:14:23.246383 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260923 17:14:23.253153 16558 raft_consensus.cc:1261] T 6c665686d6de4abea60e58aead18ec60 P 0d63c46fccac41f78d22db436716876f [term 1 FOLLOWER]: Refusing update from remote peer 958e10c0ab2f41c3842537d3fef8c9b8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:14:23.253193 16425 raft_consensus.cc:1261] T 6c665686d6de4abea60e58aead18ec60 P 0810d58df85d411f9f91c791e918f50d [term 1 FOLLOWER]: Refusing update from remote peer 958e10c0ab2f41c3842537d3fef8c9b8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:14:23.253897 16761 consensus_queue.cc:1035] T 6c665686d6de4abea60e58aead18ec60 P 958e10c0ab2f41c3842537d3fef8c9b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0810d58df85d411f9f91c791e918f50d" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 32991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:14:23.254156 16764 consensus_queue.cc:1035] T 6c665686d6de4abea60e58aead18ec60 P 958e10c0ab2f41c3842537d3fef8c9b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d63c46fccac41f78d22db436716876f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 36549 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260923 17:14:23.258935 16605 tablet.cc:2369] T 6c665686d6de4abea60e58aead18ec60 P 0d63c46fccac41f78d22db436716876f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 17:14:23.273178 16281 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51450:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:14:23.273355 16281 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51450:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:14:23.275799 16281 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a12711e9a61a43f0a823ba790766f4f1: Sending DeleteTablet for 3 replicas of tablet 6c665686d6de4abea60e58aead18ec60
I20260923 17:14:23.276654 16671 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c665686d6de4abea60e58aead18ec60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:14:23 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:46408
I20260923 17:14:23.276808 16538 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c665686d6de4abea60e58aead18ec60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:14:23 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:38846
I20260923 17:14:23.276809 16405 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c665686d6de4abea60e58aead18ec60 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:14:23 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:54784
I20260923 17:14:23.277287 16779 tablet_replica.cc:330] T 6c665686d6de4abea60e58aead18ec60 P 0810d58df85d411f9f91c791e918f50d: stopping tablet replica
I20260923 17:14:23.277292 16777 tablet_replica.cc:330] T 6c665686d6de4abea60e58aead18ec60 P 958e10c0ab2f41c3842537d3fef8c9b8: stopping tablet replica
I20260923 17:14:23.277629 16779 raft_consensus.cc:2229] T 6c665686d6de4abea60e58aead18ec60 P 0810d58df85d411f9f91c791e918f50d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:14:23.277637 16777 raft_consensus.cc:2229] T 6c665686d6de4abea60e58aead18ec60 P 958e10c0ab2f41c3842537d3fef8c9b8 [term 1 LEADER]: Raft consensus shutting down.
I20260923 17:14:23.277647 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 16343
I20260923 17:14:23.278189 16777 raft_consensus.cc:2258] T 6c665686d6de4abea60e58aead18ec60 P 958e10c0ab2f41c3842537d3fef8c9b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:14:23.278338 16778 tablet_replica.cc:330] T 6c665686d6de4abea60e58aead18ec60 P 0d63c46fccac41f78d22db436716876f: stopping tablet replica
I20260923 17:14:23.278637 16778 raft_consensus.cc:2229] T 6c665686d6de4abea60e58aead18ec60 P 0d63c46fccac41f78d22db436716876f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:14:23.278918 16778 raft_consensus.cc:2258] T 6c665686d6de4abea60e58aead18ec60 P 0d63c46fccac41f78d22db436716876f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:14:23.280002 16777 ts_tablet_manager.cc:1905] T 6c665686d6de4abea60e58aead18ec60 P 958e10c0ab2f41c3842537d3fef8c9b8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:14:23.282294 16778 ts_tablet_manager.cc:1905] T 6c665686d6de4abea60e58aead18ec60 P 0d63c46fccac41f78d22db436716876f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:14:23.283041 16777 ts_tablet_manager.cc:1918] T 6c665686d6de4abea60e58aead18ec60 P 958e10c0ab2f41c3842537d3fef8c9b8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 17:14:23.283218 16777 log.cc:1196] T 6c665686d6de4abea60e58aead18ec60 P 958e10c0ab2f41c3842537d3fef8c9b8: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-2/wal/wals/6c665686d6de4abea60e58aead18ec60
I20260923 17:14:23.283603 16777 ts_tablet_manager.cc:1939] T 6c665686d6de4abea60e58aead18ec60 P 958e10c0ab2f41c3842537d3fef8c9b8: Deleting consensus metadata
I20260923 17:14:23.284976 16266 catalog_manager.cc:4841] TS 958e10c0ab2f41c3842537d3fef8c9b8 (127.11.229.131:38907): tablet 6c665686d6de4abea60e58aead18ec60 (table test-table [id=df12a15e966b45b48c2164406059188a]) successfully deleted
I20260923 17:14:23.285673 16778 ts_tablet_manager.cc:1918] T 6c665686d6de4abea60e58aead18ec60 P 0d63c46fccac41f78d22db436716876f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 17:14:23.285789 16778 log.cc:1196] T 6c665686d6de4abea60e58aead18ec60 P 0d63c46fccac41f78d22db436716876f: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790183633736342-12182-0/minicluster-data/ts-1/wal/wals/6c665686d6de4abea60e58aead18ec60
I20260923 17:14:23.286118 16778 ts_tablet_manager.cc:1939] T 6c665686d6de4abea60e58aead18ec60 P 0d63c46fccac41f78d22db436716876f: Deleting consensus metadata
W20260923 17:14:23.286270 16268 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.229.129:32991 (error 108)
I20260923 17:14:23.287355 16752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:23.287051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:32991 (local address 127.0.0.1:54796)
0923 17:14:23.287198 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:23.287269 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.129:32991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260923 17:14:23.287423 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 16476
I20260923 17:14:23.287459 16268 catalog_manager.cc:4841] TS 0d63c46fccac41f78d22db436716876f (127.11.229.130:36549): tablet 6c665686d6de4abea60e58aead18ec60 (table test-table [id=df12a15e966b45b48c2164406059188a]) successfully deleted
W20260923 17:14:23.287657 16268 catalog_manager.cc:4584] TS 0810d58df85d411f9f91c791e918f50d (127.11.229.129:32991): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6c665686d6de4abea60e58aead18ec60: Network error: Client connection negotiation failed: client connection to 127.11.229.129:32991: connect: Connection refused (error 111)
I20260923 17:14:23.294322 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 16609
I20260923 17:14:23.301385 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 16250
2026-09-23T17:14:23Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2446 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-09-23T17:14:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:14:23Z Disabled control of system clock
I20260923 17:14:23.333978 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:44201
--webserver_interface=127.11.229.190
--webserver_port=0
--builtin_ntp_servers=127.11.229.148:37347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:44201
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260923 17:14:23.445906 16784 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:23.446300 16784 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:23.446388 16784 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:23.451015 16784 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:14:23.451116 16784 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:23.451146 16784 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:23.451200 16784 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:14:23.451238 16784 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:14:23.456461 16784 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:37347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:44201
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:44201
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.229.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16784
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:23.457674 16784 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:23.459196 16784 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:23.467972 16792 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:23.467962 16789 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:23.468029 16784 server_base.cc:1034] running on GCE node
W20260923 17:14:23.467962 16790 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:23.468822 16784 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:23.469902 16784 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:23.471101 16784 hybrid_clock.cc:648] HybridClock initialized: now 1790183663471062 us; error 57 us; skew 500 ppm
I20260923 17:14:23.473027 16784 webserver.cc:460] Webserver started at http://127.11.229.190:44955/ using document root <none> and password file <none>
I20260923 17:14:23.473694 16784 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:23.473759 16784 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:23.473986 16784 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:23.476161 16784 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "1ca9ee456d0d4bd7bf18411119ee91b5"
format_stamp: "Formatted at 2026-09-23 17:14:23 on dist-test-slave-1x1f"
server_key: "bf6e0d3512c29f20fc356baa072b874a"
server_key_iv: "4453f623ac1fdbf485865b12e5ae56f7"
server_key_version: "encryptionkey@0"
I20260923 17:14:23.476732 16784 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "1ca9ee456d0d4bd7bf18411119ee91b5"
format_stamp: "Formatted at 2026-09-23 17:14:23 on dist-test-slave-1x1f"
server_key: "bf6e0d3512c29f20fc356baa072b874a"
server_key_iv: "4453f623ac1fdbf485865b12e5ae56f7"
server_key_version: "encryptionkey@0"
I20260923 17:14:23.481035 16784 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260923 17:14:23.483759 16798 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:23.485116 16784 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260923 17:14:23.485304 16784 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "1ca9ee456d0d4bd7bf18411119ee91b5"
format_stamp: "Formatted at 2026-09-23 17:14:23 on dist-test-slave-1x1f"
server_key: "bf6e0d3512c29f20fc356baa072b874a"
server_key_iv: "4453f623ac1fdbf485865b12e5ae56f7"
server_key_version: "encryptionkey@0"
I20260923 17:14:23.485432 16784 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:23.490578 16784 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:23.491240 16784 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:23.491442 16784 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:23.498705 16784 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.190:44201
I20260923 17:14:23.498719 16856 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.190:44201 every 8 connection(s)
I20260923 17:14:23.499708 16784 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:14:23.500406 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 16784
I20260923 17:14:23.500546 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:14:23.500854 12182 external_mini_cluster.cc:1428] Setting key 9544271f38e8b50ad61f41802d01ad60
I20260923 17:14:23.503176 16857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:23.507114 16860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:23.502439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47878 (local address 127.11.229.190:44201)
0923 17:14:23.503508 (+ 1069us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:23.503525 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:23.503559 (+ 34us) server_negotiation.cc:407] Connection header received
0923 17:14:23.504212 (+ 653us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:23.504229 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:23.504571 (+ 342us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:23.504869 (+ 298us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:23.505754 (+ 885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:23.505758 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:23.505770 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:14:23.505780 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:23.505834 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:14:23.505851 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:23.505962 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:23.506083 (+ 121us) server_negotiation.cc:299] Negotiation successful
0923 17:14:23.506377 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":707,"thread_start_us":556,"threads_started":1}
I20260923 17:14:23.509444 16857 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ca9ee456d0d4bd7bf18411119ee91b5: Bootstrap starting.
I20260923 17:14:23.511730 16857 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1ca9ee456d0d4bd7bf18411119ee91b5: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:23.512483 16857 log.cc:824] T 00000000000000000000000000000000 P 1ca9ee456d0d4bd7bf18411119ee91b5: Log is configured to *not* fsync() on all Append() calls
I20260923 17:14:23.514721 16857 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ca9ee456d0d4bd7bf18411119ee91b5: No bootstrap required, opened a new log
I20260923 17:14:23.518360 16857 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1ca9ee456d0d4bd7bf18411119ee91b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ca9ee456d0d4bd7bf18411119ee91b5" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 44201 } }
I20260923 17:14:23.518632 16857 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1ca9ee456d0d4bd7bf18411119ee91b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:23.518726 16857 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1ca9ee456d0d4bd7bf18411119ee91b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ca9ee456d0d4bd7bf18411119ee91b5, State: Initialized, Role: FOLLOWER
I20260923 17:14:23.519172 16857 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1ca9ee456d0d4bd7bf18411119ee91b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ca9ee456d0d4bd7bf18411119ee91b5" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 44201 } }
I20260923 17:14:23.519328 16857 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1ca9ee456d0d4bd7bf18411119ee91b5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:14:23.519414 16857 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1ca9ee456d0d4bd7bf18411119ee91b5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:14:23.519536 16857 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1ca9ee456d0d4bd7bf18411119ee91b5 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:23.520522 16857 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1ca9ee456d0d4bd7bf18411119ee91b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ca9ee456d0d4bd7bf18411119ee91b5" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 44201 } }
I20260923 17:14:23.520906 16857 leader_election.cc:302] T 00000000000000000000000000000000 P 1ca9ee456d0d4bd7bf18411119ee91b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1ca9ee456d0d4bd7bf18411119ee91b5; no voters:
I20260923 17:14:23.521263 16857 leader_election.cc:288] T 00000000000000000000000000000000 P 1ca9ee456d0d4bd7bf18411119ee91b5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 17:14:23.521412 16862 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1ca9ee456d0d4bd7bf18411119ee91b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:14:23.521690 16862 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1ca9ee456d0d4bd7bf18411119ee91b5 [term 1 LEADER]: Becoming Leader. State: Replica: 1ca9ee456d0d4bd7bf18411119ee91b5, State: Running, Role: LEADER
I20260923 17:14:23.521979 16862 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1ca9ee456d0d4bd7bf18411119ee91b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ca9ee456d0d4bd7bf18411119ee91b5" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 44201 } }
I20260923 17:14:23.522666 16857 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1ca9ee456d0d4bd7bf18411119ee91b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:14:23.523962 16863 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ca9ee456d0d4bd7bf18411119ee91b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1ca9ee456d0d4bd7bf18411119ee91b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ca9ee456d0d4bd7bf18411119ee91b5" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 44201 } } }
I20260923 17:14:23.523979 16864 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ca9ee456d0d4bd7bf18411119ee91b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1ca9ee456d0d4bd7bf18411119ee91b5. Latest consensus state: current_term: 1 leader_uuid: "1ca9ee456d0d4bd7bf18411119ee91b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ca9ee456d0d4bd7bf18411119ee91b5" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 44201 } } }
I20260923 17:14:23.524124 16863 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ca9ee456d0d4bd7bf18411119ee91b5 [sys.catalog]: This master's current role is: LEADER
I20260923 17:14:23.524124 16864 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ca9ee456d0d4bd7bf18411119ee91b5 [sys.catalog]: This master's current role is: LEADER
I20260923 17:14:23.524509 16871 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:14:23.527918 16871 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:14:23.535000 16871 catalog_manager.cc:1347] Generated new cluster ID: 0fdd358b8bbf463ba909aac82aa6ee6c
I20260923 17:14:23.535149 16871 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:14:23.547000 16871 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:14:23.547385 16871 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:14:23.555307 16871 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1ca9ee456d0d4bd7bf18411119ee91b5: Generated new TSK 0
I20260923 17:14:23.556221 16871 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 17:14:23.560766 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.129:0
--local_ip_for_outbound_sockets=127.11.229.129
--webserver_interface=127.11.229.129
--webserver_port=0
--tserver_master_addrs=127.11.229.190:44201
--builtin_ntp_servers=127.11.229.148:37347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260923 17:14:23.677297 16881 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:23.677572 16881 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:23.677613 16881 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:23.681768 16881 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:23.681841 16881 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:23.681931 16881 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.129
I20260923 17:14:23.686954 16881 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:37347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.229.129
--webserver_port=0
--tserver_master_addrs=127.11.229.190:44201
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16881
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.129
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:23.688423 16881 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:23.689966 16881 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:23.700850 16886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:23.700865 16889 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:23.700912 16887 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:23.701382 16881 server_base.cc:1034] running on GCE node
I20260923 17:14:23.701862 16881 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:23.702625 16881 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:23.703816 16881 hybrid_clock.cc:648] HybridClock initialized: now 1790183663703753 us; error 75 us; skew 500 ppm
I20260923 17:14:23.705935 16881 webserver.cc:460] Webserver started at http://127.11.229.129:41907/ using document root <none> and password file <none>
I20260923 17:14:23.706662 16881 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:23.706743 16881 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:23.706967 16881 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:23.709088 16881 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-0/data/instance:
uuid: "1c7914c7481f46fa857a1f3825d76361"
format_stamp: "Formatted at 2026-09-23 17:14:23 on dist-test-slave-1x1f"
server_key: "149304fc9f8bc6af1c56c94d6c389a56"
server_key_iv: "aba63470a00d415f95495eb7515644a6"
server_key_version: "encryptionkey@0"
I20260923 17:14:23.709676 16881 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance:
uuid: "1c7914c7481f46fa857a1f3825d76361"
format_stamp: "Formatted at 2026-09-23 17:14:23 on dist-test-slave-1x1f"
server_key: "149304fc9f8bc6af1c56c94d6c389a56"
server_key_iv: "aba63470a00d415f95495eb7515644a6"
server_key_version: "encryptionkey@0"
I20260923 17:14:23.713668 16881 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260923 17:14:23.716650 16895 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:23.718123 16881 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 17:14:23.718323 16881 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-0/wal
uuid: "1c7914c7481f46fa857a1f3825d76361"
format_stamp: "Formatted at 2026-09-23 17:14:23 on dist-test-slave-1x1f"
server_key: "149304fc9f8bc6af1c56c94d6c389a56"
server_key_iv: "aba63470a00d415f95495eb7515644a6"
server_key_version: "encryptionkey@0"
I20260923 17:14:23.718468 16881 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:23.723749 16881 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:23.724498 16881 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:23.724699 16881 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:23.725261 16881 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:14:23.726300 16881 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:14:23.726365 16881 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:23.726431 16881 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:14:23.726482 16881 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:23.735663 16881 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.129:46227
I20260923 17:14:23.735702 17008 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.129:46227 every 8 connection(s)
I20260923 17:14:23.736595 16881 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
I20260923 17:14:23.737413 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 16881
I20260923 17:14:23.737545 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance
I20260923 17:14:23.737844 12182 external_mini_cluster.cc:1428] Setting key 3eb92ed6b5a1ec85367ce3674612b07c
I20260923 17:14:23.740197 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.130:0
--local_ip_for_outbound_sockets=127.11.229.130
--webserver_interface=127.11.229.130
--webserver_port=0
--tserver_master_addrs=127.11.229.190:44201
--builtin_ntp_servers=127.11.229.148:37347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260923 17:14:23.744225 16860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:23.738622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:55053 (local address 127.11.229.190:44201)
0923 17:14:23.738761 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:23.738764 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:23.740350 (+ 1586us) server_negotiation.cc:407] Connection header received
0923 17:14:23.742334 (+ 1984us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:23.742337 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:23.742381 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:23.742467 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:23.743744 (+ 1277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:23.743748 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:23.743751 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:14:23.743763 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:23.743790 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:14:23.743798 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:23.743892 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:23.744046 (+ 154us) server_negotiation.cc:299] Negotiation successful
0923 17:14:23.744090 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260923 17:14:23.745154 17011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:23.739162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44201 (local address 127.11.229.129:55053)
0923 17:14:23.740095 (+ 933us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:23.740154 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:23.742079 (+ 1925us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:23.742655 (+ 576us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:23.742662 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:23.742798 (+ 136us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:23.743477 (+ 679us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 17:14:23.743479 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:23.743535 (+ 56us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 17:14:23.743604 (+ 69us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:23.743885 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:23.743894 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:23.743902 (+ 8us) client_negotiation.cc:769] Sending connection context
0923 17:14:23.744081 (+ 179us) client_negotiation.cc:240] Negotiation successful
0923 17:14:23.744428 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":152,"threads_started":1}
I20260923 17:14:23.746575 17009 heartbeater.cc:347] Connected to a master server at 127.11.229.190:44201
I20260923 17:14:23.746850 17009 heartbeater.cc:464] Registering TS with master...
I20260923 17:14:23.747381 17009 heartbeater.cc:511] Master 127.11.229.190:44201 requested a full tablet report, sending...
I20260923 17:14:23.749033 16815 ts_manager.cc:194] Registered new tserver with Master: 1c7914c7481f46fa857a1f3825d76361 (127.11.229.129:46227)
W20260923 17:14:23.856032 17012 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:23.856400 17012 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:23.856477 17012 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:23.860636 17012 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:23.860706 17012 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:23.860766 17012 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.130
I20260923 17:14:23.865784 17012 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:37347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.229.130
--webserver_port=0
--tserver_master_addrs=127.11.229.190:44201
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17012
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.130
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:23.867077 17012 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:23.868502 17012 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:23.878680 17018 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:23.878703 17017 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:23.878741 17020 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:23.878942 17012 server_base.cc:1034] running on GCE node
I20260923 17:14:23.879462 17012 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:23.880178 17012 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:23.881392 17012 hybrid_clock.cc:648] HybridClock initialized: now 1790183663881344 us; error 63 us; skew 500 ppm
I20260923 17:14:23.884130 17012 webserver.cc:460] Webserver started at http://127.11.229.130:46029/ using document root <none> and password file <none>
I20260923 17:14:23.884850 17012 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:23.884948 17012 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:23.885187 17012 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:23.887465 17012 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-1/data/instance:
uuid: "2a0eaf8f116042f9b80fb641959285e1"
format_stamp: "Formatted at 2026-09-23 17:14:23 on dist-test-slave-1x1f"
server_key: "b3385270c8963e9e408404076b69cba4"
server_key_iv: "de6c7fe80bf72075997afcdd993000a0"
server_key_version: "encryptionkey@0"
I20260923 17:14:23.888032 17012 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance:
uuid: "2a0eaf8f116042f9b80fb641959285e1"
format_stamp: "Formatted at 2026-09-23 17:14:23 on dist-test-slave-1x1f"
server_key: "b3385270c8963e9e408404076b69cba4"
server_key_iv: "de6c7fe80bf72075997afcdd993000a0"
server_key_version: "encryptionkey@0"
I20260923 17:14:23.892052 17012 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260923 17:14:23.894753 17026 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:23.896085 17012 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 17:14:23.896260 17012 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-1/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-1/wal
uuid: "2a0eaf8f116042f9b80fb641959285e1"
format_stamp: "Formatted at 2026-09-23 17:14:23 on dist-test-slave-1x1f"
server_key: "b3385270c8963e9e408404076b69cba4"
server_key_iv: "de6c7fe80bf72075997afcdd993000a0"
server_key_version: "encryptionkey@0"
I20260923 17:14:23.896395 17012 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:23.901079 17012 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:23.901702 17012 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:23.901883 17012 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:23.902484 17012 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:14:23.903400 17012 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:14:23.903469 17012 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:23.903537 17012 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:14:23.903587 17012 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:23.913965 17012 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.130:37235
I20260923 17:14:23.913987 17139 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.130:37235 every 8 connection(s)
I20260923 17:14:23.914968 17012 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
I20260923 17:14:23.917215 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 17012
I20260923 17:14:23.917335 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance
I20260923 17:14:23.917659 12182 external_mini_cluster.cc:1428] Setting key 9912785ae2bc14b46aae2e2d4143e18e
I20260923 17:14:23.920060 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.131:0
--local_ip_for_outbound_sockets=127.11.229.131
--webserver_interface=127.11.229.131
--webserver_port=0
--tserver_master_addrs=127.11.229.190:44201
--builtin_ntp_servers=127.11.229.148:37347
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260923 17:14:23.922363 16860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:23.916858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:45313 (local address 127.11.229.190:44201)
0923 17:14:23.917042 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:23.917047 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:23.918506 (+ 1459us) server_negotiation.cc:407] Connection header received
0923 17:14:23.920122 (+ 1616us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:23.920125 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:23.920201 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:23.920312 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:23.921614 (+ 1302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:23.921620 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:23.921626 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:14:23.921643 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:23.921671 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:14:23.921683 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:23.921791 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:23.922086 (+ 295us) server_negotiation.cc:299] Negotiation successful
0923 17:14:23.922168 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260923 17:14:23.923403 17142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:23.917315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44201 (local address 127.11.229.130:45313)
0923 17:14:23.918281 (+ 966us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:23.918336 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:23.919857 (+ 1521us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:23.920575 (+ 718us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:23.920582 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:23.920689 (+ 107us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:23.921341 (+ 652us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 17:14:23.921343 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:23.921386 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 17:14:23.921460 (+ 74us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:23.921777 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:23.921941 (+ 164us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:23.921949 (+ 8us) client_negotiation.cc:769] Sending connection context
0923 17:14:23.922116 (+ 167us) client_negotiation.cc:240] Negotiation successful
0923 17:14:23.922457 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":124,"threads_started":1}
I20260923 17:14:23.924863 17140 heartbeater.cc:347] Connected to a master server at 127.11.229.190:44201
I20260923 17:14:23.925158 17140 heartbeater.cc:464] Registering TS with master...
I20260923 17:14:23.925711 17140 heartbeater.cc:511] Master 127.11.229.190:44201 requested a full tablet report, sending...
I20260923 17:14:23.927022 16815 ts_manager.cc:194] Registered new tserver with Master: 2a0eaf8f116042f9b80fb641959285e1 (127.11.229.130:37235)
W20260923 17:14:24.033865 17143 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:24.034205 17143 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:24.034299 17143 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:24.038560 17143 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:24.038647 17143 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:24.038736 17143 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.131
I20260923 17:14:24.043723 17143 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:37347
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.229.131
--webserver_port=0
--tserver_master_addrs=127.11.229.190:44201
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17143
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.131
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:24.044906 17143 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:24.046322 17143 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:24.056375 17148 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:24.056375 17149 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:24.056403 17151 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:24.057264 17143 server_base.cc:1034] running on GCE node
I20260923 17:14:24.057742 17143 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:24.058501 17143 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:24.059705 17143 hybrid_clock.cc:648] HybridClock initialized: now 1790183664059684 us; error 35 us; skew 500 ppm
I20260923 17:14:24.061791 17143 webserver.cc:460] Webserver started at http://127.11.229.131:33683/ using document root <none> and password file <none>
I20260923 17:14:24.062487 17143 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:24.062584 17143 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:24.062824 17143 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:24.065032 17143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-2/data/instance:
uuid: "79f48c898e824a378f479ed9cbe803cf"
format_stamp: "Formatted at 2026-09-23 17:14:24 on dist-test-slave-1x1f"
server_key: "3da4c2c54e542687b645a97406aa44ed"
server_key_iv: "1dc8d49cba0092cccb2abd4b5c0338cf"
server_key_version: "encryptionkey@0"
I20260923 17:14:24.065605 17143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance:
uuid: "79f48c898e824a378f479ed9cbe803cf"
format_stamp: "Formatted at 2026-09-23 17:14:24 on dist-test-slave-1x1f"
server_key: "3da4c2c54e542687b645a97406aa44ed"
server_key_iv: "1dc8d49cba0092cccb2abd4b5c0338cf"
server_key_version: "encryptionkey@0"
I20260923 17:14:24.069505 17143 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260923 17:14:24.072350 17157 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:24.073724 17143 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260923 17:14:24.073901 17143 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-2/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-2/wal
uuid: "79f48c898e824a378f479ed9cbe803cf"
format_stamp: "Formatted at 2026-09-23 17:14:24 on dist-test-slave-1x1f"
server_key: "3da4c2c54e542687b645a97406aa44ed"
server_key_iv: "1dc8d49cba0092cccb2abd4b5c0338cf"
server_key_version: "encryptionkey@0"
I20260923 17:14:24.074038 17143 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:24.079222 17143 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:24.079906 17143 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:24.080123 17143 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:24.080709 17143 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:14:24.081723 17143 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:14:24.081810 17143 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:24.081887 17143 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:14:24.081926 17143 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:24.093330 17143 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.131:40893
I20260923 17:14:24.093351 17270 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.131:40893 every 8 connection(s)
I20260923 17:14:24.094480 17143 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
I20260923 17:14:24.097433 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 17143
I20260923 17:14:24.097604 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance
I20260923 17:14:24.097932 12182 external_mini_cluster.cc:1428] Setting key 178ee8ef647e0cad9c6f835e2c806ec7
I20260923 17:14:24.101446 16860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:24.096434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:36405 (local address 127.11.229.190:44201)
0923 17:14:24.096572 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:24.096576 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:24.097762 (+ 1186us) server_negotiation.cc:407] Connection header received
0923 17:14:24.099572 (+ 1810us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:24.099576 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:24.099621 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:24.099721 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:24.101030 (+ 1309us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:24.101034 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:24.101036 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:14:24.101048 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:24.101067 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:14:24.101075 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:24.101154 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:24.101296 (+ 142us) server_negotiation.cc:299] Negotiation successful
0923 17:14:24.101335 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260923 17:14:24.102447 17273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:24.096815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44201 (local address 127.11.229.131:36405)
0923 17:14:24.097598 (+ 783us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:24.097654 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:24.099289 (+ 1635us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:24.099913 (+ 624us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:24.099920 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:24.100016 (+ 96us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:24.100778 (+ 762us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 17:14:24.100780 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:24.100820 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 17:14:24.100889 (+ 69us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:24.101160 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:24.101166 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:24.101170 (+ 4us) client_negotiation.cc:769] Sending connection context
0923 17:14:24.101316 (+ 146us) client_negotiation.cc:240] Negotiation successful
0923 17:14:24.101554 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":150,"threads_started":1}
I20260923 17:14:24.103677 17271 heartbeater.cc:347] Connected to a master server at 127.11.229.190:44201
I20260923 17:14:24.103955 17271 heartbeater.cc:464] Registering TS with master...
I20260923 17:14:24.104418 17271 heartbeater.cc:511] Master 127.11.229.190:44201 requested a full tablet report, sending...
I20260923 17:14:24.105531 16815 ts_manager.cc:194] Registered new tserver with Master: 79f48c898e824a378f479ed9cbe803cf (127.11.229.131:40893)
I20260923 17:14:24.112753 12182 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 17:14:24.116565 16860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:24.114742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47882 (local address 127.11.229.190:44201)
0923 17:14:24.114910 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:24.114915 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:24.115017 (+ 102us) server_negotiation.cc:407] Connection header received
0923 17:14:24.115123 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:24.115125 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:24.115163 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:24.115253 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:24.116111 (+ 858us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:24.116115 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:24.116118 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:14:24.116148 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:24.116169 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:14:24.116178 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:24.116267 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:24.116414 (+ 147us) server_negotiation.cc:299] Negotiation successful
0923 17:14:24.116451 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260923 17:14:24.119787 16815 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47882:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 17:14:24.123415 16815 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 17:14:24.136751 17284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:24.133798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:46227 (local address 127.0.0.1:54334)
0923 17:14:24.134197 (+ 399us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:24.134276 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:24.134379 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:24.135188 (+ 809us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:24.135196 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:24.135277 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:24.135873 (+ 596us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 17:14:24.135875 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:24.135892 (+ 17us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 17:14:24.135948 (+ 56us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:24.136357 (+ 409us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:24.136369 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:24.136378 (+ 9us) client_negotiation.cc:769] Sending connection context
0923 17:14:24.136500 (+ 122us) client_negotiation.cc:240] Negotiation successful
0923 17:14:24.136582 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":87,"threads_started":1}
I20260923 17:14:24.136829 17285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:24.133522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60006 (local address 127.11.229.130:37235)
0923 17:14:24.133914 (+ 392us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:24.133929 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:24.134362 (+ 433us) server_negotiation.cc:407] Connection header received
0923 17:14:24.134535 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:24.134542 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:24.134746 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:24.134860 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:24.136217 (+ 1357us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:24.136226 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:24.136240 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:14:24.136258 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:24.136301 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:14:24.136332 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:24.136434 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:24.136605 (+ 171us) server_negotiation.cc:299] Negotiation successful
0923 17:14:24.136674 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":292,"thread_start_us":96,"threads_started":1}
I20260923 17:14:24.136772 17287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:24.134057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54334 (local address 127.11.229.129:46227)
0923 17:14:24.134731 (+ 674us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:24.134745 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:24.134770 (+ 25us) server_negotiation.cc:407] Connection header received
0923 17:14:24.134830 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:24.134837 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:24.135022 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:24.135188 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:24.136082 (+ 894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:24.136088 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:24.136102 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:14:24.136114 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:24.136163 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:14:24.136195 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:24.136308 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:24.136526 (+ 218us) server_negotiation.cc:299] Negotiation successful
0923 17:14:24.136606 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":571,"thread_start_us":183,"threads_started":1}
I20260923 17:14:24.137174 17282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:24.133326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.130:37235 (local address 127.0.0.1:60006)
0923 17:14:24.134197 (+ 871us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:24.134276 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:24.134414 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:24.135579 (+ 1165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:24.135582 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:24.135598 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:24.136046 (+ 448us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 17:14:24.136049 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:24.136059 (+ 10us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 17:14:24.136082 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:24.136479 (+ 397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:24.136484 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:24.136487 (+ 3us) client_negotiation.cc:769] Sending connection context
0923 17:14:24.136985 (+ 498us) client_negotiation.cc:240] Negotiation successful
0923 17:14:24.137024 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":743,"thread_start_us":90,"threads_started":1}
I20260923 17:14:24.137355 17286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:24.133030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.131:40893 (local address 127.0.0.1:49576)
0923 17:14:24.134197 (+ 1167us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:24.134277 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:24.134435 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:24.136054 (+ 1619us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:24.136057 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:24.136071 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:24.136479 (+ 408us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 17:14:24.136483 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:24.136494 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 17:14:24.136519 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:24.137076 (+ 557us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:24.137078 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:24.137081 (+ 3us) client_negotiation.cc:769] Sending connection context
0923 17:14:24.137148 (+ 67us) client_negotiation.cc:240] Negotiation successful
0923 17:14:24.137185 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":978,"thread_start_us":115,"threads_started":1}
I20260923 17:14:24.137794 17283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:24.133170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49576 (local address 127.11.229.131:40893)
0923 17:14:24.133708 (+ 538us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:24.133722 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:24.134366 (+ 644us) server_negotiation.cc:407] Connection header received
0923 17:14:24.134545 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:24.134550 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:24.134745 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:24.134865 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:24.136649 (+ 1784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:24.136655 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:24.136665 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:14:24.136677 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:24.136715 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:14:24.136743 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:24.136843 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:24.137581 (+ 738us) server_negotiation.cc:299] Negotiation successful
0923 17:14:24.137650 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":176,"threads_started":1}
I20260923 17:14:24.140019 17074 tablet_service.cc:1467] Processing CreateTablet for tablet 8a13c25bf3644fe6a15b3ff2c77d6543 (DEFAULT_TABLE table=test-table [id=7406e4d33df84c64990545c60bc9fb57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:14:24.140359 16943 tablet_service.cc:1467] Processing CreateTablet for tablet 8a13c25bf3644fe6a15b3ff2c77d6543 (DEFAULT_TABLE table=test-table [id=7406e4d33df84c64990545c60bc9fb57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:14:24.140360 17205 tablet_service.cc:1467] Processing CreateTablet for tablet 8a13c25bf3644fe6a15b3ff2c77d6543 (DEFAULT_TABLE table=test-table [id=7406e4d33df84c64990545c60bc9fb57]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:14:24.141052 17074 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a13c25bf3644fe6a15b3ff2c77d6543. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:24.141413 17205 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a13c25bf3644fe6a15b3ff2c77d6543. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:24.141413 16943 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a13c25bf3644fe6a15b3ff2c77d6543. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:24.148409 17288 tablet_bootstrap.cc:492] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 2a0eaf8f116042f9b80fb641959285e1: Bootstrap starting.
I20260923 17:14:24.149792 17289 tablet_bootstrap.cc:492] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 79f48c898e824a378f479ed9cbe803cf: Bootstrap starting.
I20260923 17:14:24.150527 17290 tablet_bootstrap.cc:492] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 1c7914c7481f46fa857a1f3825d76361: Bootstrap starting.
I20260923 17:14:24.150871 17288 tablet_bootstrap.cc:654] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 2a0eaf8f116042f9b80fb641959285e1: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:24.151914 17289 tablet_bootstrap.cc:654] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 79f48c898e824a378f479ed9cbe803cf: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:24.152192 17288 log.cc:824] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 2a0eaf8f116042f9b80fb641959285e1: Log is configured to *not* fsync() on all Append() calls
I20260923 17:14:24.152506 17290 tablet_bootstrap.cc:654] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 1c7914c7481f46fa857a1f3825d76361: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:24.152693 17289 log.cc:824] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 79f48c898e824a378f479ed9cbe803cf: Log is configured to *not* fsync() on all Append() calls
I20260923 17:14:24.153282 17290 log.cc:824] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 1c7914c7481f46fa857a1f3825d76361: Log is configured to *not* fsync() on all Append() calls
I20260923 17:14:24.154363 17288 tablet_bootstrap.cc:492] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 2a0eaf8f116042f9b80fb641959285e1: No bootstrap required, opened a new log
I20260923 17:14:24.154524 17289 tablet_bootstrap.cc:492] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 79f48c898e824a378f479ed9cbe803cf: No bootstrap required, opened a new log
I20260923 17:14:24.154556 17288 ts_tablet_manager.cc:1397] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 2a0eaf8f116042f9b80fb641959285e1: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260923 17:14:24.154723 17289 ts_tablet_manager.cc:1397] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 79f48c898e824a378f479ed9cbe803cf: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260923 17:14:24.155184 17290 tablet_bootstrap.cc:492] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 1c7914c7481f46fa857a1f3825d76361: No bootstrap required, opened a new log
I20260923 17:14:24.155354 17290 ts_tablet_manager.cc:1397] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 1c7914c7481f46fa857a1f3825d76361: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260923 17:14:24.158433 17289 raft_consensus.cc:348] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 79f48c898e824a378f479ed9cbe803cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f48c898e824a378f479ed9cbe803cf" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 40893 } } peers { permanent_uuid: "1c7914c7481f46fa857a1f3825d76361" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 46227 } } peers { permanent_uuid: "2a0eaf8f116042f9b80fb641959285e1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 37235 } }
I20260923 17:14:24.158676 17289 raft_consensus.cc:374] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 79f48c898e824a378f479ed9cbe803cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:24.158727 17289 raft_consensus.cc:729] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 79f48c898e824a378f479ed9cbe803cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79f48c898e824a378f479ed9cbe803cf, State: Initialized, Role: FOLLOWER
I20260923 17:14:24.159168 17289 consensus_queue.cc:260] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 79f48c898e824a378f479ed9cbe803cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f48c898e824a378f479ed9cbe803cf" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 40893 } } peers { permanent_uuid: "1c7914c7481f46fa857a1f3825d76361" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 46227 } } peers { permanent_uuid: "2a0eaf8f116042f9b80fb641959285e1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 37235 } }
I20260923 17:14:24.159461 17288 raft_consensus.cc:348] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 2a0eaf8f116042f9b80fb641959285e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f48c898e824a378f479ed9cbe803cf" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 40893 } } peers { permanent_uuid: "1c7914c7481f46fa857a1f3825d76361" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 46227 } } peers { permanent_uuid: "2a0eaf8f116042f9b80fb641959285e1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 37235 } }
I20260923 17:14:24.159708 17288 raft_consensus.cc:374] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 2a0eaf8f116042f9b80fb641959285e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:24.159758 17288 raft_consensus.cc:729] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 2a0eaf8f116042f9b80fb641959285e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a0eaf8f116042f9b80fb641959285e1, State: Initialized, Role: FOLLOWER
I20260923 17:14:24.159641 17290 raft_consensus.cc:348] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 1c7914c7481f46fa857a1f3825d76361 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f48c898e824a378f479ed9cbe803cf" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 40893 } } peers { permanent_uuid: "1c7914c7481f46fa857a1f3825d76361" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 46227 } } peers { permanent_uuid: "2a0eaf8f116042f9b80fb641959285e1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 37235 } }
I20260923 17:14:24.159860 17290 raft_consensus.cc:374] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 1c7914c7481f46fa857a1f3825d76361 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:24.159907 17290 raft_consensus.cc:729] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 1c7914c7481f46fa857a1f3825d76361 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c7914c7481f46fa857a1f3825d76361, State: Initialized, Role: FOLLOWER
I20260923 17:14:24.159996 17271 heartbeater.cc:503] Master 127.11.229.190:44201 was elected leader, sending a full tablet report...
I20260923 17:14:24.160193 17289 ts_tablet_manager.cc:1428] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 79f48c898e824a378f479ed9cbe803cf: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260923 17:14:24.160142 17288 consensus_queue.cc:260] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 2a0eaf8f116042f9b80fb641959285e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f48c898e824a378f479ed9cbe803cf" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 40893 } } peers { permanent_uuid: "1c7914c7481f46fa857a1f3825d76361" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 46227 } } peers { permanent_uuid: "2a0eaf8f116042f9b80fb641959285e1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 37235 } }
I20260923 17:14:24.160298 17290 consensus_queue.cc:260] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 1c7914c7481f46fa857a1f3825d76361 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f48c898e824a378f479ed9cbe803cf" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 40893 } } peers { permanent_uuid: "1c7914c7481f46fa857a1f3825d76361" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 46227 } } peers { permanent_uuid: "2a0eaf8f116042f9b80fb641959285e1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 37235 } }
I20260923 17:14:24.160892 17009 heartbeater.cc:503] Master 127.11.229.190:44201 was elected leader, sending a full tablet report...
I20260923 17:14:24.161041 17288 ts_tablet_manager.cc:1428] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 2a0eaf8f116042f9b80fb641959285e1: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260923 17:14:24.161074 17290 ts_tablet_manager.cc:1428] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 1c7914c7481f46fa857a1f3825d76361: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260923 17:14:24.161378 17140 heartbeater.cc:503] Master 127.11.229.190:44201 was elected leader, sending a full tablet report...
W20260923 17:14:24.165900 17141 tablet.cc:2369] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 2a0eaf8f116042f9b80fb641959285e1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 17:14:24.237847 17010 tablet.cc:2369] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 1c7914c7481f46fa857a1f3825d76361: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 17:14:24.291026 17294 raft_consensus.cc:482] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 79f48c898e824a378f479ed9cbe803cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 17:14:24.291271 17294 raft_consensus.cc:504] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 79f48c898e824a378f479ed9cbe803cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f48c898e824a378f479ed9cbe803cf" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 40893 } } peers { permanent_uuid: "1c7914c7481f46fa857a1f3825d76361" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 46227 } } peers { permanent_uuid: "2a0eaf8f116042f9b80fb641959285e1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 37235 } }
I20260923 17:14:24.292783 17294 leader_election.cc:288] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 79f48c898e824a378f479ed9cbe803cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c7914c7481f46fa857a1f3825d76361 (127.11.229.129:46227), 2a0eaf8f116042f9b80fb641959285e1 (127.11.229.130:37235)
I20260923 17:14:24.295231 17273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:24.293007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:46227 (local address 127.11.229.131:46667)
0923 17:14:24.293176 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:24.293195 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:24.293292 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:24.293621 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:24.293624 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:24.293641 (+ 17us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:24.294576 (+ 935us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 17:14:24.294580 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:24.294594 (+ 14us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 17:14:24.294626 (+ 32us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:24.294952 (+ 326us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:24.294955 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:24.294958 (+ 3us) client_negotiation.cc:769] Sending connection context
0923 17:14:24.295047 (+ 89us) client_negotiation.cc:240] Negotiation successful
0923 17:14:24.295083 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":70}
I20260923 17:14:24.295437 17287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:24.293163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:46667 (local address 127.11.229.129:46227)
0923 17:14:24.293321 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:24.293328 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:24.293348 (+ 20us) server_negotiation.cc:407] Connection header received
0923 17:14:24.293400 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:24.293403 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:24.293447 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:24.293545 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:24.294785 (+ 1240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:24.294790 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:24.294794 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:14:24.294810 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:24.294836 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:14:24.294847 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:24.294934 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:24.295248 (+ 314us) server_negotiation.cc:299] Negotiation successful
0923 17:14:24.295317 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260923 17:14:24.295476 17285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:24.293362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:57597 (local address 127.11.229.130:37235)
0923 17:14:24.293492 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:24.293495 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:24.293877 (+ 382us) server_negotiation.cc:407] Connection header received
0923 17:14:24.293937 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:24.293943 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:24.293982 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:24.294087 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:24.295074 (+ 987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:24.295077 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:24.295079 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:14:24.295089 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:24.295106 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:14:24.295113 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:24.295187 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:24.295334 (+ 147us) server_negotiation.cc:299] Negotiation successful
0923 17:14:24.295370 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260923 17:14:24.295485 17297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:24.293173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.130:37235 (local address 127.11.229.131:57597)
0923 17:14:24.293713 (+ 540us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:24.293730 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:24.293832 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:24.294412 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:24.294414 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:24.294428 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:24.294913 (+ 485us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 17:14:24.294923 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:24.294934 (+ 11us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 17:14:24.294960 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:24.295213 (+ 253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:24.295216 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:24.295219 (+ 3us) client_negotiation.cc:769] Sending connection context
0923 17:14:24.295307 (+ 88us) client_negotiation.cc:240] Negotiation successful
0923 17:14:24.295338 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":133,"threads_started":1}
I20260923 17:14:24.296084 16963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a13c25bf3644fe6a15b3ff2c77d6543" candidate_uuid: "79f48c898e824a378f479ed9cbe803cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c7914c7481f46fa857a1f3825d76361" is_pre_election: true
I20260923 17:14:24.296103 17094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a13c25bf3644fe6a15b3ff2c77d6543" candidate_uuid: "79f48c898e824a378f479ed9cbe803cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a0eaf8f116042f9b80fb641959285e1" is_pre_election: true
I20260923 17:14:24.296411 16963 raft_consensus.cc:2454] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 1c7914c7481f46fa857a1f3825d76361 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79f48c898e824a378f479ed9cbe803cf in term 0.
I20260923 17:14:24.296411 17094 raft_consensus.cc:2454] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 2a0eaf8f116042f9b80fb641959285e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79f48c898e824a378f479ed9cbe803cf in term 0.
I20260923 17:14:24.296936 17161 leader_election.cc:302] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 79f48c898e824a378f479ed9cbe803cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 1c7914c7481f46fa857a1f3825d76361, 2a0eaf8f116042f9b80fb641959285e1, 79f48c898e824a378f479ed9cbe803cf; no voters:
I20260923 17:14:24.297242 17294 raft_consensus.cc:2781] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 79f48c898e824a378f479ed9cbe803cf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 17:14:24.297348 17294 raft_consensus.cc:482] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 79f48c898e824a378f479ed9cbe803cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 17:14:24.297415 17294 raft_consensus.cc:3037] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 79f48c898e824a378f479ed9cbe803cf [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:24.298703 17294 raft_consensus.cc:504] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 79f48c898e824a378f479ed9cbe803cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f48c898e824a378f479ed9cbe803cf" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 40893 } } peers { permanent_uuid: "1c7914c7481f46fa857a1f3825d76361" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 46227 } } peers { permanent_uuid: "2a0eaf8f116042f9b80fb641959285e1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 37235 } }
I20260923 17:14:24.299147 17294 leader_election.cc:288] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 79f48c898e824a378f479ed9cbe803cf [CANDIDATE]: Term 1 election: Requested vote from peers 1c7914c7481f46fa857a1f3825d76361 (127.11.229.129:46227), 2a0eaf8f116042f9b80fb641959285e1 (127.11.229.130:37235)
I20260923 17:14:24.299594 16963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a13c25bf3644fe6a15b3ff2c77d6543" candidate_uuid: "79f48c898e824a378f479ed9cbe803cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c7914c7481f46fa857a1f3825d76361"
I20260923 17:14:24.299594 17094 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a13c25bf3644fe6a15b3ff2c77d6543" candidate_uuid: "79f48c898e824a378f479ed9cbe803cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a0eaf8f116042f9b80fb641959285e1"
I20260923 17:14:24.299746 16963 raft_consensus.cc:3037] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 1c7914c7481f46fa857a1f3825d76361 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:24.299746 17094 raft_consensus.cc:3037] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 2a0eaf8f116042f9b80fb641959285e1 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:24.301182 17094 raft_consensus.cc:2454] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 2a0eaf8f116042f9b80fb641959285e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79f48c898e824a378f479ed9cbe803cf in term 1.
I20260923 17:14:24.301189 16963 raft_consensus.cc:2454] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 1c7914c7481f46fa857a1f3825d76361 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79f48c898e824a378f479ed9cbe803cf in term 1.
I20260923 17:14:24.301510 17160 leader_election.cc:302] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 79f48c898e824a378f479ed9cbe803cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c7914c7481f46fa857a1f3825d76361, 79f48c898e824a378f479ed9cbe803cf; no voters:
I20260923 17:14:24.301781 17294 raft_consensus.cc:2781] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 79f48c898e824a378f479ed9cbe803cf [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:14:24.302057 17294 raft_consensus.cc:686] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 79f48c898e824a378f479ed9cbe803cf [term 1 LEADER]: Becoming Leader. State: Replica: 79f48c898e824a378f479ed9cbe803cf, State: Running, Role: LEADER
I20260923 17:14:24.302461 17294 consensus_queue.cc:237] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 79f48c898e824a378f479ed9cbe803cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f48c898e824a378f479ed9cbe803cf" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 40893 } } peers { permanent_uuid: "1c7914c7481f46fa857a1f3825d76361" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 46227 } } peers { permanent_uuid: "2a0eaf8f116042f9b80fb641959285e1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 37235 } }
I20260923 17:14:24.305858 16815 catalog_manager.cc:5495] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 79f48c898e824a378f479ed9cbe803cf reported cstate change: term changed from 0 to 1, leader changed from <none> to 79f48c898e824a378f479ed9cbe803cf (127.11.229.131). New cstate: current_term: 1 leader_uuid: "79f48c898e824a378f479ed9cbe803cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79f48c898e824a378f479ed9cbe803cf" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 40893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1c7914c7481f46fa857a1f3825d76361" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 46227 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a0eaf8f116042f9b80fb641959285e1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 37235 } health_report { overall_health: UNKNOWN } } }
I20260923 17:14:24.331629 17283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:24.329883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49578 (local address 127.11.229.131:40893)
0923 17:14:24.330050 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:24.330055 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:24.330069 (+ 14us) server_negotiation.cc:407] Connection header received
0923 17:14:24.330254 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:24.330257 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:24.330321 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:24.330419 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:24.331199 (+ 780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:24.331212 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:24.331214 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:14:24.331230 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:24.331256 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:14:24.331264 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:24.331361 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:24.331432 (+ 71us) server_negotiation.cc:299] Negotiation successful
0923 17:14:24.331475 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260923 17:14:24.338207 17094 raft_consensus.cc:1261] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 2a0eaf8f116042f9b80fb641959285e1 [term 1 FOLLOWER]: Refusing update from remote peer 79f48c898e824a378f479ed9cbe803cf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:14:24.338196 16963 raft_consensus.cc:1261] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 1c7914c7481f46fa857a1f3825d76361 [term 1 FOLLOWER]: Refusing update from remote peer 79f48c898e824a378f479ed9cbe803cf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:14:24.339174 17294 consensus_queue.cc:1035] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 79f48c898e824a378f479ed9cbe803cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "1c7914c7481f46fa857a1f3825d76361" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 46227 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:14:24.339418 17298 consensus_queue.cc:1035] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 79f48c898e824a378f479ed9cbe803cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a0eaf8f116042f9b80fb641959285e1" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 37235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260923 17:14:24.345492 17272 tablet.cc:2369] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 79f48c898e824a378f479ed9cbe803cf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 17:14:24.349309 17304 mvcc.cc:205] Tried to move back new op lower bound from 7332592289119916032 to 7332592288985722880. Current Snapshot: MvccSnapshot[applied={T|T < 7332592289119916032}]
I20260923 17:14:24.358502 16814 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47882:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:14:24.358714 16814 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47882:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:14:24.361299 16814 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1ca9ee456d0d4bd7bf18411119ee91b5: Sending DeleteTablet for 3 replicas of tablet 8a13c25bf3644fe6a15b3ff2c77d6543
I20260923 17:14:24.362272 16943 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a13c25bf3644fe6a15b3ff2c77d6543 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:14:24 UTC) from {username='slave'} at 127.0.0.1:54334
I20260923 17:14:24.362286 17074 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a13c25bf3644fe6a15b3ff2c77d6543 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:14:24 UTC) from {username='slave'} at 127.0.0.1:60006
I20260923 17:14:24.362658 17205 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a13c25bf3644fe6a15b3ff2c77d6543 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:14:24 UTC) from {username='slave'} at 127.0.0.1:49576
I20260923 17:14:24.362815 17313 tablet_replica.cc:330] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 2a0eaf8f116042f9b80fb641959285e1: stopping tablet replica
I20260923 17:14:24.363152 17314 tablet_replica.cc:330] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 79f48c898e824a378f479ed9cbe803cf: stopping tablet replica
I20260923 17:14:24.363226 17313 raft_consensus.cc:2229] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 2a0eaf8f116042f9b80fb641959285e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:14:24.363590 17313 raft_consensus.cc:2258] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 2a0eaf8f116042f9b80fb641959285e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:14:24.363691 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 16881
I20260923 17:14:24.363641 17314 raft_consensus.cc:2229] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 79f48c898e824a378f479ed9cbe803cf [term 1 LEADER]: Raft consensus shutting down.
I20260923 17:14:24.366067 17313 ts_tablet_manager.cc:1905] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 2a0eaf8f116042f9b80fb641959285e1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:14:24.366513 17314 raft_consensus.cc:2258] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 79f48c898e824a378f479ed9cbe803cf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:14:24.367954 17314 ts_tablet_manager.cc:1905] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 79f48c898e824a378f479ed9cbe803cf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:14:24.369031 17313 ts_tablet_manager.cc:1918] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 2a0eaf8f116042f9b80fb641959285e1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 17:14:24.369141 17313 log.cc:1196] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 2a0eaf8f116042f9b80fb641959285e1: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-1/wal/wals/8a13c25bf3644fe6a15b3ff2c77d6543
I20260923 17:14:24.369472 17313 ts_tablet_manager.cc:1939] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 2a0eaf8f116042f9b80fb641959285e1: Deleting consensus metadata
I20260923 17:14:24.370895 16802 catalog_manager.cc:4841] TS 2a0eaf8f116042f9b80fb641959285e1 (127.11.229.130:37235): tablet 8a13c25bf3644fe6a15b3ff2c77d6543 (table test-table [id=7406e4d33df84c64990545c60bc9fb57]) successfully deleted
I20260923 17:14:24.371325 17314 ts_tablet_manager.cc:1918] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 79f48c898e824a378f479ed9cbe803cf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 17:14:24.371449 17314 log.cc:1196] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 79f48c898e824a378f479ed9cbe803cf: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790183633736342-12182-0/minicluster-data/ts-2/wal/wals/8a13c25bf3644fe6a15b3ff2c77d6543
I20260923 17:14:24.371752 17314 ts_tablet_manager.cc:1939] T 8a13c25bf3644fe6a15b3ff2c77d6543 P 79f48c898e824a378f479ed9cbe803cf: Deleting consensus metadata
W20260923 17:14:24.372182 16801 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.229.129:46227 (error 108)
I20260923 17:14:24.372202 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 17012
I20260923 17:14:24.375653 16801 catalog_manager.cc:4841] TS 79f48c898e824a378f479ed9cbe803cf (127.11.229.131:40893): tablet 8a13c25bf3644fe6a15b3ff2c77d6543 (table test-table [id=7406e4d33df84c64990545c60bc9fb57]) successfully deleted
I20260923 17:14:24.376435 17286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:24.376115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:46227 (local address 127.0.0.1:54340)
0923 17:14:24.376264 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:24.376342 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.129:46227: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260923 17:14:24.376674 16801 catalog_manager.cc:4584] TS 1c7914c7481f46fa857a1f3825d76361 (127.11.229.129:46227): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8a13c25bf3644fe6a15b3ff2c77d6543: Network error: Client connection negotiation failed: client connection to 127.11.229.129:46227: connect: Connection refused (error 111)
I20260923 17:14:24.378883 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 17143
I20260923 17:14:24.384756 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 16784
2026-09-23T17:14:24Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (1080 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260923 17:14:24.405917 12182 mini_oidc.cc:152] Starting JWKS server
I20260923 17:14:24.407635 12182 webserver.cc:460] Webserver started at https://127.0.0.1:40701/ using document root <none> and password file <none>
I20260923 17:14:24.407832 12182 mini_oidc.cc:189] Starting OIDC Discovery server
I20260923 17:14:24.408516 12182 webserver.cc:460] Webserver started at http://127.0.0.1:40307/ using document root <none> and password file <none>
2026-09-23T17:14:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:14:24Z Disabled control of system clock
I20260923 17:14:24.417891 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:39549
--webserver_interface=127.11.229.190
--webserver_port=0
--builtin_ntp_servers=127.11.229.148:46355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:39549
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40701/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790183633736342-12182-0/testchainca.cert with env {}
W20260923 17:14:24.537709 17321 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:24.538003 17321 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:24.538055 17321 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:24.542932 17321 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:14:24.543001 17321 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:24.543018 17321 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:24.543035 17321 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:14:24.543057 17321 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260923 17:14:24.543074 17321 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260923 17:14:24.543088 17321 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:40701/jwks.json
I20260923 17:14:24.548787 17321 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:46355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:39549
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:39549
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40701/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.229.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790183633736342-12182-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17321
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:24.549866 17321 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:24.550879 17321 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:24.560146 17327 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:24.560153 17326 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:24.560153 17330 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:24.560582 17321 server_base.cc:1034] running on GCE node
I20260923 17:14:24.561275 17321 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:24.562628 17321 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:24.563853 17321 hybrid_clock.cc:648] HybridClock initialized: now 1790183664563817 us; error 50 us; skew 500 ppm
I20260923 17:14:24.565888 17321 webserver.cc:460] Webserver started at http://127.11.229.190:45875/ using document root <none> and password file <none>
I20260923 17:14:24.566635 17321 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:24.566737 17321 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:24.567001 17321 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:24.569335 17321 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "00f040d58f464b5680d877178225b4f0"
format_stamp: "Formatted at 2026-09-23 17:14:24 on dist-test-slave-1x1f"
server_key: "8a431408dd060728277cf1ee65c8e036"
server_key_iv: "9a3aa0fdd6f71d99c236a2dafe51fce1"
server_key_version: "encryptionkey@0"
I20260923 17:14:24.569958 17321 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "00f040d58f464b5680d877178225b4f0"
format_stamp: "Formatted at 2026-09-23 17:14:24 on dist-test-slave-1x1f"
server_key: "8a431408dd060728277cf1ee65c8e036"
server_key_iv: "9a3aa0fdd6f71d99c236a2dafe51fce1"
server_key_version: "encryptionkey@0"
I20260923 17:14:24.574189 17321 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.000s
I20260923 17:14:24.576933 17340 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:24.578457 17321 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 17:14:24.578609 17321 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "00f040d58f464b5680d877178225b4f0"
format_stamp: "Formatted at 2026-09-23 17:14:24 on dist-test-slave-1x1f"
server_key: "8a431408dd060728277cf1ee65c8e036"
server_key_iv: "9a3aa0fdd6f71d99c236a2dafe51fce1"
server_key_version: "encryptionkey@0"
I20260923 17:14:24.578742 17321 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:24.594058 17321 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:24.594892 17321 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:24.595124 17321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:24.602842 17321 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.190:39549
I20260923 17:14:24.602843 17392 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.190:39549 every 8 connection(s)
I20260923 17:14:24.603927 17321 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:14:24.604774 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 17321
I20260923 17:14:24.604930 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:14:24.605300 12182 external_mini_cluster.cc:1428] Setting key a0693e22f72c2d020d56dbc44fe2ca1c
I20260923 17:14:24.607905 17393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:24.613734 17393 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00f040d58f464b5680d877178225b4f0: Bootstrap starting.
I20260923 17:14:24.615716 17396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:24.606882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51890 (local address 127.11.229.190:39549)
0923 17:14:24.607593 (+ 711us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:24.607609 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:24.607659 (+ 50us) server_negotiation.cc:407] Connection header received
0923 17:14:24.608517 (+ 858us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:24.608538 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:24.609014 (+ 476us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:24.609378 (+ 364us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:24.609851 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:24.611006 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:24.612025 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:24.612521 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:24.612719 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:24.613668 (+ 949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:24.613673 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:24.613686 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:14:24.614175 (+ 489us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:24.614300 (+ 125us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:14:24.614325 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:24.614447 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:24.614605 (+ 158us) server_negotiation.cc:299] Negotiation successful
0923 17:14:24.614889 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":149,"threads_started":1}
I20260923 17:14:24.616520 17393 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 00f040d58f464b5680d877178225b4f0: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:24.617250 17393 log.cc:824] T 00000000000000000000000000000000 P 00f040d58f464b5680d877178225b4f0: Log is configured to *not* fsync() on all Append() calls
I20260923 17:14:24.618848 12182 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 17:14:24.619470 17393 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00f040d58f464b5680d877178225b4f0: No bootstrap required, opened a new log
I20260923 17:14:24.623193 17393 raft_consensus.cc:348] T 00000000000000000000000000000000 P 00f040d58f464b5680d877178225b4f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00f040d58f464b5680d877178225b4f0" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 39549 } }
I20260923 17:14:24.623458 17393 raft_consensus.cc:374] T 00000000000000000000000000000000 P 00f040d58f464b5680d877178225b4f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:24.623541 17393 raft_consensus.cc:729] T 00000000000000000000000000000000 P 00f040d58f464b5680d877178225b4f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00f040d58f464b5680d877178225b4f0, State: Initialized, Role: FOLLOWER
I20260923 17:14:24.623982 17393 consensus_queue.cc:260] T 00000000000000000000000000000000 P 00f040d58f464b5680d877178225b4f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00f040d58f464b5680d877178225b4f0" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 39549 } }
I20260923 17:14:24.624143 17393 raft_consensus.cc:388] T 00000000000000000000000000000000 P 00f040d58f464b5680d877178225b4f0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:14:24.624233 17393 raft_consensus.cc:482] T 00000000000000000000000000000000 P 00f040d58f464b5680d877178225b4f0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:14:24.624356 17393 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 00f040d58f464b5680d877178225b4f0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:24.625325 17393 raft_consensus.cc:504] T 00000000000000000000000000000000 P 00f040d58f464b5680d877178225b4f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00f040d58f464b5680d877178225b4f0" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 39549 } }
I20260923 17:14:24.625692 17393 leader_election.cc:302] T 00000000000000000000000000000000 P 00f040d58f464b5680d877178225b4f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 00f040d58f464b5680d877178225b4f0; no voters:
I20260923 17:14:24.626035 17393 leader_election.cc:288] T 00000000000000000000000000000000 P 00f040d58f464b5680d877178225b4f0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 17:14:24.626274 17398 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 00f040d58f464b5680d877178225b4f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:14:24.626597 17398 raft_consensus.cc:686] T 00000000000000000000000000000000 P 00f040d58f464b5680d877178225b4f0 [term 1 LEADER]: Becoming Leader. State: Replica: 00f040d58f464b5680d877178225b4f0, State: Running, Role: LEADER
I20260923 17:14:24.626909 17398 consensus_queue.cc:237] T 00000000000000000000000000000000 P 00f040d58f464b5680d877178225b4f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00f040d58f464b5680d877178225b4f0" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 39549 } }
I20260923 17:14:24.627413 17393 sys_catalog.cc:564] T 00000000000000000000000000000000 P 00f040d58f464b5680d877178225b4f0 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:14:24.628510 17399 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00f040d58f464b5680d877178225b4f0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "00f040d58f464b5680d877178225b4f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00f040d58f464b5680d877178225b4f0" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 39549 } } }
I20260923 17:14:24.628654 17399 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00f040d58f464b5680d877178225b4f0 [sys.catalog]: This master's current role is: LEADER
I20260923 17:14:24.629002 17400 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00f040d58f464b5680d877178225b4f0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 00f040d58f464b5680d877178225b4f0. Latest consensus state: current_term: 1 leader_uuid: "00f040d58f464b5680d877178225b4f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00f040d58f464b5680d877178225b4f0" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 39549 } } }
I20260923 17:14:24.629086 17407 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:14:24.629105 17400 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00f040d58f464b5680d877178225b4f0 [sys.catalog]: This master's current role is: LEADER
I20260923 17:14:24.632561 17407 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:14:24.637864 17407 catalog_manager.cc:1347] Generated new cluster ID: 1207d7b0ba7842008723fb87ca82da30
I20260923 17:14:24.637943 17407 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:14:24.660403 17407 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:14:24.661548 17407 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:14:24.670841 17407 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 00f040d58f464b5680d877178225b4f0: Generated new TSK 0
I20260923 17:14:24.671550 17407 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260923 17:14:24.698644 17423 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260923 17:14:24.698770 17423 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260923 17:14:24.699390 17396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:24.681216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51896 (local address 127.11.229.190:39549)
0923 17:14:24.681357 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:24.681362 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:24.681720 (+ 358us) server_negotiation.cc:407] Connection header received
0923 17:14:24.681943 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:24.681948 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:24.682041 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:24.682189 (+ 148us) server_negotiation.cc:226] Negotiated authn=JWT
0923 17:14:24.682626 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:24.683520 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:24.684798 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:24.685015 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:24.685120 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:24.685491 (+ 371us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0923 17:14:24.698954 (+ 13463us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40701/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0923 17:14:24.699278 (+ 324us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:51896: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40701/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":55}
W20260923 17:14:24.699476 17396 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:51896: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40701/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260923 17:14:24.700878 17422 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:24.681145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:39549 (local address 127.0.0.1:51896)
0923 17:14:24.681486 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:24.681502 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:24.681648 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:24.682272 (+ 624us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:24.682275 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:24.682289 (+ 14us) client_negotiation.cc:189] Negotiated authn=JWT
0923 17:14:24.682446 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:24.682453 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:24.683660 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:24.683664 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:24.684660 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:24.684670 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:24.685146 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:24.685150 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:24.685253 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:24.685306 (+ 53us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0923 17:14:24.699321 (+ 14015us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40701/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0923 17:14:24.699583 (+ 262us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.229.190:39549: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40701/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":112,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.11.229.190:39549: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40701/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260923 17:14:24.702037 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 17321
2026-09-23T17:14:24Z chronyd exiting
I20260923 17:14:24.739809 12182 test_util.cc:175] -----------------------------------------------
I20260923 17:14:24.739897 12182 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790183633736342-12182-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (335 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260923 17:14:24.740854 12182 mini_oidc.cc:152] Starting JWKS server
I20260923 17:14:24.741667 12182 webserver.cc:460] Webserver started at https://127.0.0.1:45679/ using document root <none> and password file <none>
I20260923 17:14:24.741750 12182 mini_oidc.cc:189] Starting OIDC Discovery server
I20260923 17:14:24.741997 12182 webserver.cc:460] Webserver started at http://127.0.0.1:46593/ using document root <none> and password file <none>
2026-09-23T17:14:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:14:24Z Disabled control of system clock
I20260923 17:14:24.751766 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:38897
--webserver_interface=127.11.229.190
--webserver_port=0
--builtin_ntp_servers=127.11.229.148:41447
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:38897
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45679/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790183633736342-12182-0/testchainca.cert with env {}
W20260923 17:14:24.861910 17429 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:24.862229 17429 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:24.862334 17429 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:24.866549 17429 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:14:24.866638 17429 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:24.866663 17429 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:24.866719 17429 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:14:24.866775 17429 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260923 17:14:24.866811 17429 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260923 17:14:24.866842 17429 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:45679/jwks.json
I20260923 17:14:24.872429 17429 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:41447
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:38897
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:38897
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45679/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.229.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790183633736342-12182-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17429
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:24.873574 17429 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:24.874643 17429 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:24.883764 17434 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:24.883765 17435 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:24.883934 17437 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:24.884529 17429 server_base.cc:1034] running on GCE node
I20260923 17:14:24.885181 17429 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:24.886435 17429 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:24.887627 17429 hybrid_clock.cc:648] HybridClock initialized: now 1790183664887601 us; error 33 us; skew 500 ppm
I20260923 17:14:24.889567 17429 webserver.cc:460] Webserver started at http://127.11.229.190:37049/ using document root <none> and password file <none>
I20260923 17:14:24.890170 17429 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:24.890288 17429 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:24.890537 17429 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:24.892591 17429 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "84ec61f47f744ce78b9c1fc5c29f6287"
format_stamp: "Formatted at 2026-09-23 17:14:24 on dist-test-slave-1x1f"
server_key: "7ace255bda0506b09985faee319cf368"
server_key_iv: "ab99acd5c67b9cdef86fd6306d7c11aa"
server_key_version: "encryptionkey@0"
I20260923 17:14:24.893167 17429 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "84ec61f47f744ce78b9c1fc5c29f6287"
format_stamp: "Formatted at 2026-09-23 17:14:24 on dist-test-slave-1x1f"
server_key: "7ace255bda0506b09985faee319cf368"
server_key_iv: "ab99acd5c67b9cdef86fd6306d7c11aa"
server_key_version: "encryptionkey@0"
I20260923 17:14:24.896926 17429 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260923 17:14:24.899376 17443 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:24.900667 17429 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260923 17:14:24.900811 17429 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "84ec61f47f744ce78b9c1fc5c29f6287"
format_stamp: "Formatted at 2026-09-23 17:14:24 on dist-test-slave-1x1f"
server_key: "7ace255bda0506b09985faee319cf368"
server_key_iv: "ab99acd5c67b9cdef86fd6306d7c11aa"
server_key_version: "encryptionkey@0"
I20260923 17:14:24.900926 17429 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:24.922087 17429 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:24.922892 17429 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:24.923106 17429 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:24.930210 17429 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.190:38897
I20260923 17:14:24.930284 17495 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.190:38897 every 8 connection(s)
I20260923 17:14:24.931278 17429 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:14:24.934666 17496 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:24.938282 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 17429
I20260923 17:14:24.938429 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:14:24.938723 12182 external_mini_cluster.cc:1428] Setting key 50e40f71f02f2c9ab3afd0c41bb6d942
I20260923 17:14:24.940831 17496 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84ec61f47f744ce78b9c1fc5c29f6287: Bootstrap starting.
I20260923 17:14:24.943624 17496 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 84ec61f47f744ce78b9c1fc5c29f6287: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:24.944489 17496 log.cc:824] T 00000000000000000000000000000000 P 84ec61f47f744ce78b9c1fc5c29f6287: Log is configured to *not* fsync() on all Append() calls
I20260923 17:14:24.946938 17496 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84ec61f47f744ce78b9c1fc5c29f6287: No bootstrap required, opened a new log
I20260923 17:14:24.949800 17499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:24.940006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49604 (local address 127.11.229.190:38897)
0923 17:14:24.940702 (+ 696us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:24.940723 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:24.940765 (+ 42us) server_negotiation.cc:407] Connection header received
0923 17:14:24.941609 (+ 844us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:24.941630 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:24.942170 (+ 540us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:24.942551 (+ 381us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:24.943001 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:24.944464 (+ 1463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:24.945656 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:24.946347 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:24.946504 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:24.947615 (+ 1111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:24.947622 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:24.947639 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:14:24.948145 (+ 506us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:24.948222 (+ 77us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:14:24.948247 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:24.948358 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:24.948558 (+ 200us) server_negotiation.cc:299] Negotiation successful
0923 17:14:24.948845 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":129,"threads_started":1}
I20260923 17:14:24.951601 17496 raft_consensus.cc:348] T 00000000000000000000000000000000 P 84ec61f47f744ce78b9c1fc5c29f6287 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84ec61f47f744ce78b9c1fc5c29f6287" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 38897 } }
I20260923 17:14:24.951905 17496 raft_consensus.cc:374] T 00000000000000000000000000000000 P 84ec61f47f744ce78b9c1fc5c29f6287 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:24.951960 17496 raft_consensus.cc:729] T 00000000000000000000000000000000 P 84ec61f47f744ce78b9c1fc5c29f6287 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84ec61f47f744ce78b9c1fc5c29f6287, State: Initialized, Role: FOLLOWER
I20260923 17:14:24.952455 17496 consensus_queue.cc:260] T 00000000000000000000000000000000 P 84ec61f47f744ce78b9c1fc5c29f6287 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84ec61f47f744ce78b9c1fc5c29f6287" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 38897 } }
I20260923 17:14:24.952613 17496 raft_consensus.cc:388] T 00000000000000000000000000000000 P 84ec61f47f744ce78b9c1fc5c29f6287 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:14:24.952678 17496 raft_consensus.cc:482] T 00000000000000000000000000000000 P 84ec61f47f744ce78b9c1fc5c29f6287 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:14:24.952782 17496 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 84ec61f47f744ce78b9c1fc5c29f6287 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:24.952962 12182 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 17:14:24.953969 17496 raft_consensus.cc:504] T 00000000000000000000000000000000 P 84ec61f47f744ce78b9c1fc5c29f6287 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84ec61f47f744ce78b9c1fc5c29f6287" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 38897 } }
I20260923 17:14:24.954377 17496 leader_election.cc:302] T 00000000000000000000000000000000 P 84ec61f47f744ce78b9c1fc5c29f6287 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 84ec61f47f744ce78b9c1fc5c29f6287; no voters:
I20260923 17:14:24.954695 17496 leader_election.cc:288] T 00000000000000000000000000000000 P 84ec61f47f744ce78b9c1fc5c29f6287 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 17:14:24.954795 17501 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 84ec61f47f744ce78b9c1fc5c29f6287 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:14:24.955034 17501 raft_consensus.cc:686] T 00000000000000000000000000000000 P 84ec61f47f744ce78b9c1fc5c29f6287 [term 1 LEADER]: Becoming Leader. State: Replica: 84ec61f47f744ce78b9c1fc5c29f6287, State: Running, Role: LEADER
I20260923 17:14:24.955374 17501 consensus_queue.cc:237] T 00000000000000000000000000000000 P 84ec61f47f744ce78b9c1fc5c29f6287 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84ec61f47f744ce78b9c1fc5c29f6287" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 38897 } }
I20260923 17:14:24.956033 17496 sys_catalog.cc:564] T 00000000000000000000000000000000 P 84ec61f47f744ce78b9c1fc5c29f6287 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:14:24.957106 17503 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84ec61f47f744ce78b9c1fc5c29f6287 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 84ec61f47f744ce78b9c1fc5c29f6287. Latest consensus state: current_term: 1 leader_uuid: "84ec61f47f744ce78b9c1fc5c29f6287" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84ec61f47f744ce78b9c1fc5c29f6287" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 38897 } } }
I20260923 17:14:24.957106 17502 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84ec61f47f744ce78b9c1fc5c29f6287 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "84ec61f47f744ce78b9c1fc5c29f6287" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "84ec61f47f744ce78b9c1fc5c29f6287" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 38897 } } }
I20260923 17:14:24.957286 17503 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84ec61f47f744ce78b9c1fc5c29f6287 [sys.catalog]: This master's current role is: LEADER
I20260923 17:14:24.957343 17502 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84ec61f47f744ce78b9c1fc5c29f6287 [sys.catalog]: This master's current role is: LEADER
I20260923 17:14:24.957698 17510 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:14:24.961268 17510 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:14:24.968037 17510 catalog_manager.cc:1347] Generated new cluster ID: 764a8ccbdd494875a116ee8d86d830ea
I20260923 17:14:24.968128 17510 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:14:24.979740 17510 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:14:24.981681 17510 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:14:24.990113 17510 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 84ec61f47f744ce78b9c1fc5c29f6287: Generated new TSK 0
I20260923 17:14:24.991096 17510 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260923 17:14:25.023775 17526 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260923 17:14:25.023895 17526 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260923 17:14:25.024627 17499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:25.007178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49610 (local address 127.11.229.190:38897)
0923 17:14:25.007307 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:25.007311 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:25.007441 (+ 130us) server_negotiation.cc:407] Connection header received
0923 17:14:25.007578 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:25.007582 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:25.007649 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:25.007783 (+ 134us) server_negotiation.cc:226] Negotiated authn=JWT
0923 17:14:25.007991 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:25.008860 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:25.009901 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:25.010281 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:25.010392 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:25.010706 (+ 314us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0923 17:14:25.024184 (+ 13478us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45679/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0923 17:14:25.024481 (+ 297us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:49610: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45679/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":38}
W20260923 17:14:25.024694 17499 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:49610: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45679/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260923 17:14:25.024777 17525 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:25.007076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:38897 (local address 127.0.0.1:49610)
0923 17:14:25.007345 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:25.007358 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:25.007456 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:25.007782 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:25.007784 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:25.007790 (+ 6us) client_negotiation.cc:189] Negotiated authn=JWT
0923 17:14:25.007882 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:25.007886 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:25.009023 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:25.009026 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:25.009747 (+ 721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:25.009765 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:25.010411 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:25.010415 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:25.010485 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:25.010511 (+ 26us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0923 17:14:25.024409 (+ 13898us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45679/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0923 17:14:25.024563 (+ 154us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.229.190:38897: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45679/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":103,"threads_started":1}
I20260923 17:14:25.025383 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 17429
2026-09-23T17:14:25Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (324 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260923 17:14:25.065424 12182 mini_oidc.cc:152] Starting JWKS server
I20260923 17:14:25.066475 12182 webserver.cc:460] Webserver started at https://127.0.0.1:34237/ using document root <none> and password file <none>
I20260923 17:14:25.066599 12182 mini_oidc.cc:189] Starting OIDC Discovery server
I20260923 17:14:25.066911 12182 webserver.cc:460] Webserver started at http://127.0.0.1:43163/ using document root <none> and password file <none>
2026-09-23T17:14:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:14:25Z Disabled control of system clock
I20260923 17:14:25.076885 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:33943
--webserver_interface=127.11.229.190
--webserver_port=0
--builtin_ntp_servers=127.11.229.148:38027
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:33943
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34237/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260923 17:14:25.195586 17532 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:25.195885 17532 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:25.195926 17532 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:25.199966 17532 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:14:25.200039 17532 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:25.200054 17532 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:25.200071 17532 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:14:25.200088 17532 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260923 17:14:25.200103 17532 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260923 17:14:25.200117 17532 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:34237/jwks.json
I20260923 17:14:25.205075 17532 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:38027
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:33943
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:33943
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:34237/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.229.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17532
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:25.206197 17532 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:25.207581 17532 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260923 17:14:25.216904 17532 server_base.cc:1034] running on GCE node
W20260923 17:14:25.216825 17537 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:25.216840 17540 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:25.216846 17538 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:25.217896 17532 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:25.219239 17532 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:25.220504 17532 hybrid_clock.cc:648] HybridClock initialized: now 1790183665220468 us; error 61 us; skew 500 ppm
I20260923 17:14:25.223464 17532 webserver.cc:460] Webserver started at http://127.11.229.190:43895/ using document root <none> and password file <none>
I20260923 17:14:25.224164 17532 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:25.224236 17532 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:25.224481 17532 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:25.226953 17532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "bbf1880a80f7460183a06c82c7f02e9f"
format_stamp: "Formatted at 2026-09-23 17:14:25 on dist-test-slave-1x1f"
server_key: "2c240875b17164bbc0a44c34a0d08bf6"
server_key_iv: "36615f10d22992aba0504d420de207fa"
server_key_version: "encryptionkey@0"
I20260923 17:14:25.227658 17532 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "bbf1880a80f7460183a06c82c7f02e9f"
format_stamp: "Formatted at 2026-09-23 17:14:25 on dist-test-slave-1x1f"
server_key: "2c240875b17164bbc0a44c34a0d08bf6"
server_key_iv: "36615f10d22992aba0504d420de207fa"
server_key_version: "encryptionkey@0"
I20260923 17:14:25.231874 17532 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260923 17:14:25.234752 17546 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:25.236277 17532 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 17:14:25.236438 17532 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "bbf1880a80f7460183a06c82c7f02e9f"
format_stamp: "Formatted at 2026-09-23 17:14:25 on dist-test-slave-1x1f"
server_key: "2c240875b17164bbc0a44c34a0d08bf6"
server_key_iv: "36615f10d22992aba0504d420de207fa"
server_key_version: "encryptionkey@0"
I20260923 17:14:25.236590 17532 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:25.258895 17532 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:25.259776 17532 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:25.259996 17532 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:25.266970 17598 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.190:33943 every 8 connection(s)
I20260923 17:14:25.267004 17532 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.190:33943
I20260923 17:14:25.268030 17532 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:14:25.271075 17599 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:25.273774 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 17532
I20260923 17:14:25.273911 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:14:25.274184 12182 external_mini_cluster.cc:1428] Setting key 060e225f9b5b4e91ea8e661e8afaa1dc
I20260923 17:14:25.277195 17599 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbf1880a80f7460183a06c82c7f02e9f: Bootstrap starting.
I20260923 17:14:25.279884 17599 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bbf1880a80f7460183a06c82c7f02e9f: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:25.280630 17599 log.cc:824] T 00000000000000000000000000000000 P bbf1880a80f7460183a06c82c7f02e9f: Log is configured to *not* fsync() on all Append() calls
I20260923 17:14:25.282683 17599 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bbf1880a80f7460183a06c82c7f02e9f: No bootstrap required, opened a new log
I20260923 17:14:25.284175 17602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:25.275573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35516 (local address 127.11.229.190:33943)
0923 17:14:25.276288 (+ 715us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:25.276308 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:25.276351 (+ 43us) server_negotiation.cc:407] Connection header received
0923 17:14:25.277156 (+ 805us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:25.277178 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:25.277668 (+ 490us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:25.278020 (+ 352us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:25.278522 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:25.279935 (+ 1413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:25.280862 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:25.281327 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:25.281511 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:25.282447 (+ 936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:25.282452 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:25.282464 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:14:25.282899 (+ 435us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:25.282957 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:14:25.282977 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:25.283078 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:25.283246 (+ 168us) server_negotiation.cc:299] Negotiation successful
0923 17:14:25.283495 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":290,"thread_start_us":108,"threads_started":1}
I20260923 17:14:25.286705 17599 raft_consensus.cc:348] T 00000000000000000000000000000000 P bbf1880a80f7460183a06c82c7f02e9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbf1880a80f7460183a06c82c7f02e9f" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33943 } }
I20260923 17:14:25.286981 17599 raft_consensus.cc:374] T 00000000000000000000000000000000 P bbf1880a80f7460183a06c82c7f02e9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:25.287062 17599 raft_consensus.cc:729] T 00000000000000000000000000000000 P bbf1880a80f7460183a06c82c7f02e9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbf1880a80f7460183a06c82c7f02e9f, State: Initialized, Role: FOLLOWER
I20260923 17:14:25.287236 12182 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 17:14:25.287528 17599 consensus_queue.cc:260] T 00000000000000000000000000000000 P bbf1880a80f7460183a06c82c7f02e9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbf1880a80f7460183a06c82c7f02e9f" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33943 } }
I20260923 17:14:25.287689 17599 raft_consensus.cc:388] T 00000000000000000000000000000000 P bbf1880a80f7460183a06c82c7f02e9f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:14:25.287755 17599 raft_consensus.cc:482] T 00000000000000000000000000000000 P bbf1880a80f7460183a06c82c7f02e9f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:14:25.287849 17599 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bbf1880a80f7460183a06c82c7f02e9f [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:25.289008 17599 raft_consensus.cc:504] T 00000000000000000000000000000000 P bbf1880a80f7460183a06c82c7f02e9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbf1880a80f7460183a06c82c7f02e9f" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33943 } }
I20260923 17:14:25.289369 17599 leader_election.cc:302] T 00000000000000000000000000000000 P bbf1880a80f7460183a06c82c7f02e9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bbf1880a80f7460183a06c82c7f02e9f; no voters:
I20260923 17:14:25.289713 17599 leader_election.cc:288] T 00000000000000000000000000000000 P bbf1880a80f7460183a06c82c7f02e9f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 17:14:25.289862 17604 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bbf1880a80f7460183a06c82c7f02e9f [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:14:25.290163 17604 raft_consensus.cc:686] T 00000000000000000000000000000000 P bbf1880a80f7460183a06c82c7f02e9f [term 1 LEADER]: Becoming Leader. State: Replica: bbf1880a80f7460183a06c82c7f02e9f, State: Running, Role: LEADER
I20260923 17:14:25.290477 17604 consensus_queue.cc:237] T 00000000000000000000000000000000 P bbf1880a80f7460183a06c82c7f02e9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbf1880a80f7460183a06c82c7f02e9f" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33943 } }
I20260923 17:14:25.291028 17599 sys_catalog.cc:564] T 00000000000000000000000000000000 P bbf1880a80f7460183a06c82c7f02e9f [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:14:25.292256 17605 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbf1880a80f7460183a06c82c7f02e9f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bbf1880a80f7460183a06c82c7f02e9f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbf1880a80f7460183a06c82c7f02e9f" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33943 } } }
I20260923 17:14:25.292258 17606 sys_catalog.cc:455] T 00000000000000000000000000000000 P bbf1880a80f7460183a06c82c7f02e9f [sys.catalog]: SysCatalogTable state changed. Reason: New leader bbf1880a80f7460183a06c82c7f02e9f. Latest consensus state: current_term: 1 leader_uuid: "bbf1880a80f7460183a06c82c7f02e9f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bbf1880a80f7460183a06c82c7f02e9f" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33943 } } }
I20260923 17:14:25.292419 17605 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbf1880a80f7460183a06c82c7f02e9f [sys.catalog]: This master's current role is: LEADER
I20260923 17:14:25.292419 17606 sys_catalog.cc:458] T 00000000000000000000000000000000 P bbf1880a80f7460183a06c82c7f02e9f [sys.catalog]: This master's current role is: LEADER
I20260923 17:14:25.292899 17613 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:14:25.296113 17613 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:14:25.301931 17613 catalog_manager.cc:1347] Generated new cluster ID: 0c50f9fc0a424044ad837ccfa63595da
I20260923 17:14:25.302016 17613 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:14:25.315440 17613 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:14:25.316694 17613 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:14:25.327037 17613 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bbf1880a80f7460183a06c82c7f02e9f: Generated new TSK 0
I20260923 17:14:25.327857 17613 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 17:14:25.347819 17602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:25.343042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35518 (local address 127.11.229.190:33943)
0923 17:14:25.343171 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:25.343177 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:25.343346 (+ 169us) server_negotiation.cc:407] Connection header received
0923 17:14:25.343546 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:25.343549 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:25.343596 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:25.343706 (+ 110us) server_negotiation.cc:226] Negotiated authn=JWT
0923 17:14:25.343948 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:25.344509 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:25.345382 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:25.345617 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:25.345727 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:25.346032 (+ 305us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0923 17:14:25.347450 (+ 1418us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34237/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0923 17:14:25.347683 (+ 233us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:35518: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34237/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":47}
W20260923 17:14:25.347886 17602 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:35518: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34237/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260923 17:14:25.349713 17628 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:25.342953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:33943 (local address 127.0.0.1:35518)
0923 17:14:25.343264 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:25.343275 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:25.343394 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:25.343716 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:25.343719 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:25.343727 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0923 17:14:25.343834 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:25.343842 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:25.344631 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:25.344636 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:25.345264 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:25.345271 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:25.345738 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:25.345742 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:25.345826 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:25.345858 (+ 32us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0923 17:14:25.347627 (+ 1769us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34237/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0923 17:14:25.349526 (+ 1899us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.229.190:33943: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:34237/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":228,"mutex_wait_us":1676,"thread_start_us":123,"threads_started":1}
I20260923 17:14:25.350383 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 17532
E20260923 17:14:25.358989 17629 webserver.cc:533] Webserver: sslize failed:
E20260923 17:14:25.359074 17629 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-09-23T17:14:25Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (324 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-09-23T17:14:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:14:25Z Disabled control of system clock
I20260923 17:14:25.398417 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:44297
--webserver_interface=127.11.229.190
--webserver_port=0
--builtin_ntp_servers=127.11.229.148:32873
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:44297
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790183633736342-12182-0/testchainca.cert with env {}
W20260923 17:14:25.512969 17633 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:25.513293 17633 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:25.513335 17633 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:25.517495 17633 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:14:25.517572 17633 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:25.517588 17633 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:25.517606 17633 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:14:25.517620 17633 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260923 17:14:25.517637 17633 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260923 17:14:25.517650 17633 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260923 17:14:25.523329 17633 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:32873
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:44297
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:44297
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.229.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790183633736342-12182-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17633
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:25.524394 17633 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:25.525379 17633 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:25.536646 17639 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:25.536918 17638 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:25.536959 17633 server_base.cc:1034] running on GCE node
W20260923 17:14:25.537168 17641 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:25.537747 17633 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:25.538923 17633 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:25.540159 17633 hybrid_clock.cc:648] HybridClock initialized: now 1790183665540139 us; error 33 us; skew 500 ppm
I20260923 17:14:25.542052 17633 webserver.cc:460] Webserver started at http://127.11.229.190:41069/ using document root <none> and password file <none>
I20260923 17:14:25.542685 17633 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:25.542748 17633 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:25.542954 17633 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:25.545154 17633 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "2a4e730554554786a2049b6671f15a0e"
format_stamp: "Formatted at 2026-09-23 17:14:25 on dist-test-slave-1x1f"
server_key: "6b4080cc3d72da8bb4de90011f779afb"
server_key_iv: "03e5eddbc212393c7b08e9459633ed38"
server_key_version: "encryptionkey@0"
I20260923 17:14:25.545709 17633 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "2a4e730554554786a2049b6671f15a0e"
format_stamp: "Formatted at 2026-09-23 17:14:25 on dist-test-slave-1x1f"
server_key: "6b4080cc3d72da8bb4de90011f779afb"
server_key_iv: "03e5eddbc212393c7b08e9459633ed38"
server_key_version: "encryptionkey@0"
I20260923 17:14:25.549407 17633 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260923 17:14:25.551918 17647 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:25.553232 17633 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260923 17:14:25.553383 17633 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "2a4e730554554786a2049b6671f15a0e"
format_stamp: "Formatted at 2026-09-23 17:14:25 on dist-test-slave-1x1f"
server_key: "6b4080cc3d72da8bb4de90011f779afb"
server_key_iv: "03e5eddbc212393c7b08e9459633ed38"
server_key_version: "encryptionkey@0"
I20260923 17:14:25.553505 17633 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:25.565191 17633 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:25.565864 17633 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:25.566018 17633 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:25.572992 17633 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.190:44297
I20260923 17:14:25.573026 17699 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.190:44297 every 8 connection(s)
I20260923 17:14:25.574083 17633 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:14:25.577241 17700 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:25.582885 17700 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a4e730554554786a2049b6671f15a0e: Bootstrap starting.
I20260923 17:14:25.584383 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 17633
I20260923 17:14:25.584481 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:14:25.584762 12182 external_mini_cluster.cc:1428] Setting key 416aaae61758f0a19ef4ba2b355db0d1
I20260923 17:14:25.585660 17700 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2a4e730554554786a2049b6671f15a0e: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:25.586486 17700 log.cc:824] T 00000000000000000000000000000000 P 2a4e730554554786a2049b6671f15a0e: Log is configured to *not* fsync() on all Append() calls
I20260923 17:14:25.588645 17700 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a4e730554554786a2049b6671f15a0e: No bootstrap required, opened a new log
I20260923 17:14:25.593080 17700 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2a4e730554554786a2049b6671f15a0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a4e730554554786a2049b6671f15a0e" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 44297 } }
I20260923 17:14:25.593400 17700 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2a4e730554554786a2049b6671f15a0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:25.593484 17700 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2a4e730554554786a2049b6671f15a0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a4e730554554786a2049b6671f15a0e, State: Initialized, Role: FOLLOWER
I20260923 17:14:25.593990 17700 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2a4e730554554786a2049b6671f15a0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a4e730554554786a2049b6671f15a0e" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 44297 } }
I20260923 17:14:25.594144 17700 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2a4e730554554786a2049b6671f15a0e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:14:25.594215 17700 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2a4e730554554786a2049b6671f15a0e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:14:25.594336 17700 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2a4e730554554786a2049b6671f15a0e [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:25.594554 17703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:25.585897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43174 (local address 127.11.229.190:44297)
0923 17:14:25.586578 (+ 681us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:25.586597 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:25.586661 (+ 64us) server_negotiation.cc:407] Connection header received
0923 17:14:25.587344 (+ 683us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:25.587362 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:25.587702 (+ 340us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:25.587989 (+ 287us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:25.588339 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:25.589380 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:25.590692 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:25.591214 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:25.591344 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:25.592306 (+ 962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:25.592311 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:25.592326 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:14:25.592738 (+ 412us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:25.592808 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:14:25.592827 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:25.592905 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:25.593085 (+ 180us) server_negotiation.cc:299] Negotiation successful
0923 17:14:25.593467 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":326,"thread_start_us":145,"threads_started":1}
I20260923 17:14:25.595537 17700 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2a4e730554554786a2049b6671f15a0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a4e730554554786a2049b6671f15a0e" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 44297 } }
I20260923 17:14:25.595887 17700 leader_election.cc:302] T 00000000000000000000000000000000 P 2a4e730554554786a2049b6671f15a0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2a4e730554554786a2049b6671f15a0e; no voters:
I20260923 17:14:25.596225 17700 leader_election.cc:288] T 00000000000000000000000000000000 P 2a4e730554554786a2049b6671f15a0e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 17:14:25.596315 17705 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2a4e730554554786a2049b6671f15a0e [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:14:25.596527 17705 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2a4e730554554786a2049b6671f15a0e [term 1 LEADER]: Becoming Leader. State: Replica: 2a4e730554554786a2049b6671f15a0e, State: Running, Role: LEADER
I20260923 17:14:25.596817 17705 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2a4e730554554786a2049b6671f15a0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a4e730554554786a2049b6671f15a0e" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 44297 } }
I20260923 17:14:25.597594 17700 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2a4e730554554786a2049b6671f15a0e [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:14:25.597967 12182 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 17:14:25.598526 17707 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a4e730554554786a2049b6671f15a0e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2a4e730554554786a2049b6671f15a0e. Latest consensus state: current_term: 1 leader_uuid: "2a4e730554554786a2049b6671f15a0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a4e730554554786a2049b6671f15a0e" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 44297 } } }
I20260923 17:14:25.598523 17706 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a4e730554554786a2049b6671f15a0e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2a4e730554554786a2049b6671f15a0e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a4e730554554786a2049b6671f15a0e" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 44297 } } }
I20260923 17:14:25.598675 17706 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a4e730554554786a2049b6671f15a0e [sys.catalog]: This master's current role is: LEADER
I20260923 17:14:25.598675 17707 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a4e730554554786a2049b6671f15a0e [sys.catalog]: This master's current role is: LEADER
I20260923 17:14:25.599045 17714 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:14:25.601738 17714 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:14:25.607606 17714 catalog_manager.cc:1347] Generated new cluster ID: 1382f24b792042f3b90c7537fb293cda
I20260923 17:14:25.607678 17714 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:14:25.625890 17714 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:14:25.627231 17714 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:14:25.637027 17714 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2a4e730554554786a2049b6671f15a0e: Generated new TSK 0
I20260923 17:14:25.637887 17714 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 17:14:25.707180 17703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:25.646593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43188 (local address 127.11.229.190:44297)
0923 17:14:25.646734 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:25.646739 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:25.646890 (+ 151us) server_negotiation.cc:407] Connection header received
0923 17:14:25.647074 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:25.647077 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:25.647124 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:25.647215 (+ 91us) server_negotiation.cc:226] Negotiated authn=JWT
0923 17:14:25.647456 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:25.647992 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:25.649226 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:25.649440 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:25.649520 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:25.649851 (+ 331us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0923 17:14:25.706766 (+ 56915us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0923 17:14:25.707058 (+ 292us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:43188: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":55}
W20260923 17:14:25.707286 17703 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:43188: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260923 17:14:25.707722 17729 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:25.646498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44297 (local address 127.0.0.1:43188)
0923 17:14:25.646793 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:25.646809 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:25.646929 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:25.647236 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:25.647239 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:25.647246 (+ 7us) client_negotiation.cc:189] Negotiated authn=JWT
0923 17:14:25.647356 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:25.647362 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:25.648119 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:25.648123 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:25.649107 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:25.649116 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:25.649565 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:25.649569 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:25.649663 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:25.649691 (+ 28us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0923 17:14:25.707037 (+ 57346us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0923 17:14:25.707265 (+ 228us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.229.190:44297: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":116,"threads_started":1}
I20260923 17:14:25.708350 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 17633
2026-09-23T17:14:25Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (338 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (129 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (129 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 17:14:26 dist-test-slave-1x1f krb5kdc[17741](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 17:14:26 dist-test-slave-1x1f krb5kdc[17741](info): set up 2 sockets
Sep 23 17:14:26 dist-test-slave-1x1f krb5kdc[17741](info): commencing operation
krb5kdc: starting...
W20260923 17:14:27.019068 12182 mini_kdc.cc:121] Time spent starting KDC: real 1.032s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Sep 23 17:14:27 dist-test-slave-1x1f krb5kdc[17741](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183667, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T17:14:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:14:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.229.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
I20260923 17:14:27.159375 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:43647
--webserver_interface=127.11.229.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:40543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:43647
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:14:27.276479 17754 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:27.276783 17754 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:27.276859 17754 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:27.280889 17754 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:14:27.280980 17754 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:27.281019 17754 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:27.281076 17754 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:14:27.281112 17754 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:14:27.286491 17754 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:40543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:43647
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:43647
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.229.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17754
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:27.287617 17754 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:27.288682 17754 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:27.297645 17759 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:27.297654 17762 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:27.297662 17754 server_base.cc:1034] running on GCE node
W20260923 17:14:27.298009 17760 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:27.298717 17754 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:27.299887 17754 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:27.301103 17754 hybrid_clock.cc:648] HybridClock initialized: now 1790183667301067 us; error 47 us; skew 500 ppm
Sep 23 17:14:27 dist-test-slave-1x1f krb5kdc[17741](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183667, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:27.312784 17754 init.cc:377] Logged in from keytab as kudu/127.11.229.190@KRBTEST.COM (short username kudu)
I20260923 17:14:27.313855 17754 webserver.cc:460] Webserver started at http://127.11.229.190:33615/ using document root <none> and password file <none>
I20260923 17:14:27.314528 17754 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:27.314604 17754 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:27.315205 17754 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:27.317489 17754 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "775197ea367c437e9aab259c25a362cb"
format_stamp: "Formatted at 2026-09-23 17:14:27 on dist-test-slave-1x1f"
server_key: "45d04b010c02287c421c58da547adb1e"
server_key_iv: "ae574cf2de9afe6eb159939bd2a2c07b"
server_key_version: "encryptionkey@0"
I20260923 17:14:27.318099 17754 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "775197ea367c437e9aab259c25a362cb"
format_stamp: "Formatted at 2026-09-23 17:14:27 on dist-test-slave-1x1f"
server_key: "45d04b010c02287c421c58da547adb1e"
server_key_iv: "ae574cf2de9afe6eb159939bd2a2c07b"
server_key_version: "encryptionkey@0"
I20260923 17:14:27.322644 17754 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260923 17:14:27.325443 17769 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:27.326957 17754 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 17:14:27.327132 17754 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "775197ea367c437e9aab259c25a362cb"
format_stamp: "Formatted at 2026-09-23 17:14:27 on dist-test-slave-1x1f"
server_key: "45d04b010c02287c421c58da547adb1e"
server_key_iv: "ae574cf2de9afe6eb159939bd2a2c07b"
server_key_version: "encryptionkey@0"
I20260923 17:14:27.327258 17754 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:27.341301 17754 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:27.344543 17754 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:27.344754 17754 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:27.352288 17754 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.190:43647
I20260923 17:14:27.352349 17821 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.190:43647 every 8 connection(s)
I20260923 17:14:27.353353 17754 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:14:27.356130 17822 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:27.356884 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 17754
I20260923 17:14:27.357038 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:14:27.357334 12182 external_mini_cluster.cc:1428] Setting key 6ffa612b26280256683672f07e50f134
I20260923 17:14:27.362466 17822 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 775197ea367c437e9aab259c25a362cb: Bootstrap starting.
I20260923 17:14:27.365124 17822 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 775197ea367c437e9aab259c25a362cb: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:27.366010 17822 log.cc:824] T 00000000000000000000000000000000 P 775197ea367c437e9aab259c25a362cb: Log is configured to *not* fsync() on all Append() calls
Sep 23 17:14:27 dist-test-slave-1x1f krb5kdc[17741](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183667, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:14:27.368013 17822 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 775197ea367c437e9aab259c25a362cb: No bootstrap required, opened a new log
I20260923 17:14:27.371522 17825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:27.358651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49980 (local address 127.11.229.190:43647)
0923 17:14:27.359056 (+ 405us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:27.359071 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:27.359105 (+ 34us) server_negotiation.cc:407] Connection header received
0923 17:14:27.359726 (+ 621us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:27.359749 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:27.360067 (+ 318us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:27.360346 (+ 279us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:27.361280 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:27.362296 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:27.363402 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:27.363877 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:27.364000 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:27.366896 (+ 2896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:27.366901 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:27.366915 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:27.366942 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:27.368709 (+ 1767us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:27.369154 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:27.369160 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:27.369165 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:27.369273 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:27.369570 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:27.369574 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:27.369576 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:27.369989 (+ 413us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:27.370198 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:27.370478 (+ 280us) server_negotiation.cc:299] Negotiation successful
0923 17:14:27.370774 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":264,"thread_start_us":126,"threads_started":1}
I20260923 17:14:27.371663 17822 raft_consensus.cc:348] T 00000000000000000000000000000000 P 775197ea367c437e9aab259c25a362cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "775197ea367c437e9aab259c25a362cb" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43647 } }
I20260923 17:14:27.371956 17822 raft_consensus.cc:374] T 00000000000000000000000000000000 P 775197ea367c437e9aab259c25a362cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:27.372040 17822 raft_consensus.cc:729] T 00000000000000000000000000000000 P 775197ea367c437e9aab259c25a362cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 775197ea367c437e9aab259c25a362cb, State: Initialized, Role: FOLLOWER
I20260923 17:14:27.372534 17822 consensus_queue.cc:260] T 00000000000000000000000000000000 P 775197ea367c437e9aab259c25a362cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "775197ea367c437e9aab259c25a362cb" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43647 } }
I20260923 17:14:27.372712 17822 raft_consensus.cc:388] T 00000000000000000000000000000000 P 775197ea367c437e9aab259c25a362cb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:14:27.372778 17822 raft_consensus.cc:482] T 00000000000000000000000000000000 P 775197ea367c437e9aab259c25a362cb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:14:27.372869 17822 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 775197ea367c437e9aab259c25a362cb [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:27.374073 17822 raft_consensus.cc:504] T 00000000000000000000000000000000 P 775197ea367c437e9aab259c25a362cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "775197ea367c437e9aab259c25a362cb" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43647 } }
I20260923 17:14:27.374451 17822 leader_election.cc:302] T 00000000000000000000000000000000 P 775197ea367c437e9aab259c25a362cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 775197ea367c437e9aab259c25a362cb; no voters:
I20260923 17:14:27.374724 17822 leader_election.cc:288] T 00000000000000000000000000000000 P 775197ea367c437e9aab259c25a362cb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 17:14:27.374858 17827 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 775197ea367c437e9aab259c25a362cb [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:14:27.375135 17827 raft_consensus.cc:686] T 00000000000000000000000000000000 P 775197ea367c437e9aab259c25a362cb [term 1 LEADER]: Becoming Leader. State: Replica: 775197ea367c437e9aab259c25a362cb, State: Running, Role: LEADER
I20260923 17:14:27.375439 17827 consensus_queue.cc:237] T 00000000000000000000000000000000 P 775197ea367c437e9aab259c25a362cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "775197ea367c437e9aab259c25a362cb" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43647 } }
I20260923 17:14:27.375928 17822 sys_catalog.cc:564] T 00000000000000000000000000000000 P 775197ea367c437e9aab259c25a362cb [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:14:27.377135 17828 sys_catalog.cc:455] T 00000000000000000000000000000000 P 775197ea367c437e9aab259c25a362cb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "775197ea367c437e9aab259c25a362cb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "775197ea367c437e9aab259c25a362cb" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43647 } } }
I20260923 17:14:27.377139 17829 sys_catalog.cc:455] T 00000000000000000000000000000000 P 775197ea367c437e9aab259c25a362cb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 775197ea367c437e9aab259c25a362cb. Latest consensus state: current_term: 1 leader_uuid: "775197ea367c437e9aab259c25a362cb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "775197ea367c437e9aab259c25a362cb" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43647 } } }
I20260923 17:14:27.377332 17829 sys_catalog.cc:458] T 00000000000000000000000000000000 P 775197ea367c437e9aab259c25a362cb [sys.catalog]: This master's current role is: LEADER
I20260923 17:14:27.377344 17828 sys_catalog.cc:458] T 00000000000000000000000000000000 P 775197ea367c437e9aab259c25a362cb [sys.catalog]: This master's current role is: LEADER
I20260923 17:14:27.377701 17836 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:14:27.380533 17836 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:14:27.386512 17836 catalog_manager.cc:1347] Generated new cluster ID: 627848486bac4e0badba9276a197cf33
I20260923 17:14:27.386595 17836 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:14:27.398406 17836 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:14:27.399688 17836 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:14:27.407619 17836 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 775197ea367c437e9aab259c25a362cb: Generated new TSK 0
I20260923 17:14:27.408443 17836 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.229.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab.
Entry for principal kudu/127.11.229.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab.
I20260923 17:14:27.447089 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.129:0
--local_ip_for_outbound_sockets=127.11.229.129
--webserver_interface=127.11.229.129
--webserver_port=0
--tserver_master_addrs=127.11.229.190:43647
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab
--principal=kudu/127.11.229.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:40543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:14:27.563618 17848 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:27.563917 17848 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:27.563990 17848 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:27.568378 17848 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:27.568476 17848 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:27.568568 17848 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.129
I20260923 17:14:27.574059 17848 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:40543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab
--principal=kudu/127.11.229.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.229.129
--webserver_port=0
--tserver_master_addrs=127.11.229.190:43647
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17848
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.129
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:27.575228 17848 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:27.576330 17848 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:27.586678 17856 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:27.586669 17854 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:27.586669 17853 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:27.586961 17848 server_base.cc:1034] running on GCE node
I20260923 17:14:27.587756 17848 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:27.588539 17848 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:27.589769 17848 hybrid_clock.cc:648] HybridClock initialized: now 1790183667589750 us; error 30 us; skew 500 ppm
Sep 23 17:14:27 dist-test-slave-1x1f krb5kdc[17741](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183667, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:27.592990 17848 init.cc:377] Logged in from keytab as kudu/127.11.229.129@KRBTEST.COM (short username kudu)
I20260923 17:14:27.593928 17848 webserver.cc:460] Webserver started at http://127.11.229.129:35549/ using document root <none> and password file <none>
I20260923 17:14:27.594578 17848 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:27.594669 17848 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:27.594905 17848 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:27.597016 17848 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/ts-0/data/instance:
uuid: "bf4ca831a92d49009b2dca35e2189b93"
format_stamp: "Formatted at 2026-09-23 17:14:27 on dist-test-slave-1x1f"
server_key: "748512685843f96556d1381dca6b516f"
server_key_iv: "91354e2278d78ed14acb481c37ddfb53"
server_key_version: "encryptionkey@0"
I20260923 17:14:27.597579 17848 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance:
uuid: "bf4ca831a92d49009b2dca35e2189b93"
format_stamp: "Formatted at 2026-09-23 17:14:27 on dist-test-slave-1x1f"
server_key: "748512685843f96556d1381dca6b516f"
server_key_iv: "91354e2278d78ed14acb481c37ddfb53"
server_key_version: "encryptionkey@0"
I20260923 17:14:27.601413 17848 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260923 17:14:27.603965 17863 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:27.605382 17848 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260923 17:14:27.605531 17848 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/ts-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/ts-0/wal
uuid: "bf4ca831a92d49009b2dca35e2189b93"
format_stamp: "Formatted at 2026-09-23 17:14:27 on dist-test-slave-1x1f"
server_key: "748512685843f96556d1381dca6b516f"
server_key_iv: "91354e2278d78ed14acb481c37ddfb53"
server_key_version: "encryptionkey@0"
I20260923 17:14:27.605646 17848 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:27.625337 17848 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:27.630038 17848 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:27.630367 17848 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:27.630998 17848 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:14:27.631970 17848 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:14:27.632021 17848 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:27.632061 17848 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:14:27.632077 17848 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:27.642107 17848 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.129:45263
I20260923 17:14:27.642125 17976 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.129:45263 every 8 connection(s)
I20260923 17:14:27.643113 17848 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
I20260923 17:14:27.644220 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 17848
I20260923 17:14:27.644369 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance
I20260923 17:14:27.644760 12182 external_mini_cluster.cc:1428] Setting key 5eaf38427269d34f7cfb1237e0417b45
WARNING: no policy specified for kudu/127.11.229.130@KRBTEST.COM; defaulting to no policy
Sep 23 17:14:27 dist-test-slave-1x1f krb5kdc[17741](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183667, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.129@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.130@KRBTEST.COM" created.
I20260923 17:14:27.659235 17825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:27.645219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:42927 (local address 127.11.229.190:43647)
0923 17:14:27.645394 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:27.645399 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:27.646387 (+ 988us) server_negotiation.cc:407] Connection header received
0923 17:14:27.647859 (+ 1472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:27.647864 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:27.647925 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:27.648023 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:27.649266 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:27.650188 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:27.651668 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:27.652074 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:27.652188 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:27.654916 (+ 2728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:27.654919 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:27.654922 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:27.654947 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:27.656569 (+ 1622us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:27.657191 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:27.657198 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:27.657204 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:27.657307 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:27.657730 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:27.657733 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:27.657734 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:27.657933 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:27.658020 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:27.658776 (+ 756us) server_negotiation.cc:299] Negotiation successful
0923 17:14:27.658993 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260923 17:14:27.659971 17979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:27.645694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:43647 (local address 127.11.229.129:42927)
0923 17:14:27.646181 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:27.646270 (+ 89us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:27.647649 (+ 1379us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:27.648189 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:27.648196 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:27.648568 (+ 372us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:27.649100 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:27.649114 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:27.650363 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:27.650367 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:27.651519 (+ 1152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:27.651530 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:27.652241 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:27.652245 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:27.652405 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:27.653058 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:27.653074 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:27.654712 (+ 1638us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:27.656680 (+ 1968us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:27.656685 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:27.656696 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:27.657063 (+ 367us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:27.657412 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:27.657414 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:27.657416 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:27.657604 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:27.658054 (+ 450us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:27.658063 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:27.658467 (+ 404us) client_negotiation.cc:769] Sending connection context
0923 17:14:27.658693 (+ 226us) client_negotiation.cc:240] Negotiation successful
0923 17:14:27.659074 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":136,"threads_started":1}
I20260923 17:14:27.661253 17977 heartbeater.cc:347] Connected to a master server at 127.11.229.190:43647
I20260923 17:14:27.661547 17977 heartbeater.cc:464] Registering TS with master...
I20260923 17:14:27.662214 17977 heartbeater.cc:511] Master 127.11.229.190:43647 requested a full tablet report, sending...
I20260923 17:14:27.664132 17786 ts_manager.cc:194] Registered new tserver with Master: bf4ca831a92d49009b2dca35e2189b93 (127.11.229.129:45263)
I20260923 17:14:27.665282 17786 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.129@KRBTEST.COM'} at 127.11.229.129:42927
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab.
Entry for principal kudu/127.11.229.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab.
I20260923 17:14:27.674325 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.130:0
--local_ip_for_outbound_sockets=127.11.229.130
--webserver_interface=127.11.229.130
--webserver_port=0
--tserver_master_addrs=127.11.229.190:43647
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab
--principal=kudu/127.11.229.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:40543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:14:27.785233 17982 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:27.785506 17982 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:27.785586 17982 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:27.789664 17982 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:27.789754 17982 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:27.789865 17982 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.130
I20260923 17:14:27.795185 17982 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:40543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab
--principal=kudu/127.11.229.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.229.130
--webserver_port=0
--tserver_master_addrs=127.11.229.190:43647
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17982
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.130
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:27.796284 17982 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:27.797309 17982 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:27.806937 17990 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:27.807076 17987 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:27.806941 17988 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:27.807224 17982 server_base.cc:1034] running on GCE node
I20260923 17:14:27.807626 17982 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:27.808225 17982 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:27.809417 17982 hybrid_clock.cc:648] HybridClock initialized: now 1790183667809377 us; error 57 us; skew 500 ppm
Sep 23 17:14:27 dist-test-slave-1x1f krb5kdc[17741](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183667, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:27.812418 17982 init.cc:377] Logged in from keytab as kudu/127.11.229.130@KRBTEST.COM (short username kudu)
I20260923 17:14:27.813351 17982 webserver.cc:460] Webserver started at http://127.11.229.130:41575/ using document root <none> and password file <none>
I20260923 17:14:27.813975 17982 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:27.814074 17982 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:27.814383 17982 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:27.816596 17982 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/ts-1/data/instance:
uuid: "bde548d42c0b4aeaa77a383c2117f72a"
format_stamp: "Formatted at 2026-09-23 17:14:27 on dist-test-slave-1x1f"
server_key: "b73298321407444ba8875f643f4971f5"
server_key_iv: "c6cefb0e8f2679e168dc37a95737e30d"
server_key_version: "encryptionkey@0"
I20260923 17:14:27.817236 17982 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance:
uuid: "bde548d42c0b4aeaa77a383c2117f72a"
format_stamp: "Formatted at 2026-09-23 17:14:27 on dist-test-slave-1x1f"
server_key: "b73298321407444ba8875f643f4971f5"
server_key_iv: "c6cefb0e8f2679e168dc37a95737e30d"
server_key_version: "encryptionkey@0"
I20260923 17:14:27.821463 17982 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260923 17:14:27.824143 17997 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:27.825404 17982 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 17:14:27.825549 17982 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/ts-1/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/ts-1/wal
uuid: "bde548d42c0b4aeaa77a383c2117f72a"
format_stamp: "Formatted at 2026-09-23 17:14:27 on dist-test-slave-1x1f"
server_key: "b73298321407444ba8875f643f4971f5"
server_key_iv: "c6cefb0e8f2679e168dc37a95737e30d"
server_key_version: "encryptionkey@0"
I20260923 17:14:27.825671 17982 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:27.854741 17982 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:27.858107 17982 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:27.858366 17982 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:27.859021 17982 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:14:27.859928 17982 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:14:27.860003 17982 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:27.860077 17982 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:14:27.860128 17982 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:27.871171 17982 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.130:46739
I20260923 17:14:27.871304 18110 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.130:46739 every 8 connection(s)
I20260923 17:14:27.872192 17982 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
I20260923 17:14:27.881573 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 17982
I20260923 17:14:27.881723 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance
I20260923 17:14:27.882064 12182 external_mini_cluster.cc:1428] Setting key 9d18b2183e2d6e6182ad754e15635bdf
Sep 23 17:14:27 dist-test-slave-1x1f krb5kdc[17741](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183667, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.130@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:14:27.888458 17825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:27.874206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:48929 (local address 127.11.229.190:43647)
0923 17:14:27.874397 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:27.874401 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:27.875232 (+ 831us) server_negotiation.cc:407] Connection header received
0923 17:14:27.876880 (+ 1648us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:27.876884 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:27.876948 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:27.877036 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:27.878435 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:27.879025 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:27.880295 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:27.880552 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:27.880678 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:27.884102 (+ 3424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:27.884106 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:27.884109 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:27.884136 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:27.885961 (+ 1825us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:27.886748 (+ 787us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:27.886756 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:27.886757 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:27.886877 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:27.887302 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:27.887305 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:27.887307 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:27.887504 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:27.887614 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:27.888168 (+ 554us) server_negotiation.cc:299] Negotiation successful
0923 17:14:27.888293 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260923 17:14:27.889366 18113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:27.874616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:43647 (local address 127.11.229.130:48929)
0923 17:14:27.875075 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:27.875118 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:27.876602 (+ 1484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:27.877215 (+ 613us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:27.877223 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:27.877679 (+ 456us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:27.878203 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:27.878219 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:27.879178 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:27.879189 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:27.880159 (+ 970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:27.880169 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:27.880735 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:27.880739 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:27.880956 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:27.881661 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:27.881701 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:27.883903 (+ 2202us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:27.886088 (+ 2185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:27.886095 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:27.886114 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:27.886616 (+ 502us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:27.887017 (+ 401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:27.887021 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:27.887023 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:27.887188 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:27.887613 (+ 425us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:27.887631 (+ 18us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:27.887905 (+ 274us) client_negotiation.cc:769] Sending connection context
0923 17:14:27.888104 (+ 199us) client_negotiation.cc:240] Negotiation successful
0923 17:14:27.888455 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":111,"threads_started":1}
I20260923 17:14:27.890731 18111 heartbeater.cc:347] Connected to a master server at 127.11.229.190:43647
I20260923 17:14:27.890991 18111 heartbeater.cc:464] Registering TS with master...
I20260923 17:14:27.891505 18111 heartbeater.cc:511] Master 127.11.229.190:43647 requested a full tablet report, sending...
I20260923 17:14:27.892624 17786 ts_manager.cc:194] Registered new tserver with Master: bde548d42c0b4aeaa77a383c2117f72a (127.11.229.130:46739)
WARNING: no policy specified for kudu/127.11.229.131@KRBTEST.COM; defaulting to no policy
I20260923 17:14:27.893455 17786 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.130@KRBTEST.COM'} at 127.11.229.130:48929
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab.
Entry for principal kudu/127.11.229.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab.
I20260923 17:14:27.914490 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.131:0
--local_ip_for_outbound_sockets=127.11.229.131
--webserver_interface=127.11.229.131
--webserver_port=0
--tserver_master_addrs=127.11.229.190:43647
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab
--principal=kudu/127.11.229.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:40543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:14:28.032204 18116 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:28.032549 18116 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:28.032634 18116 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:28.037021 18116 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:28.037137 18116 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:28.037235 18116 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.131
I20260923 17:14:28.042897 18116 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:40543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab
--principal=kudu/127.11.229.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.229.131
--webserver_port=0
--tserver_master_addrs=127.11.229.190:43647
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18116
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.131
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:28.044062 18116 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:28.045130 18116 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:28.056130 18121 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:28.056262 18122 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:28.056548 18116 server_base.cc:1034] running on GCE node
W20260923 17:14:28.056262 18124 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:28.057145 18116 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:28.058286 18116 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:28.059693 18116 hybrid_clock.cc:648] HybridClock initialized: now 1790183668059648 us; error 73 us; skew 500 ppm
Sep 23 17:14:28 dist-test-slave-1x1f krb5kdc[17741](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183668, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:28.062973 18116 init.cc:377] Logged in from keytab as kudu/127.11.229.131@KRBTEST.COM (short username kudu)
I20260923 17:14:28.063968 18116 webserver.cc:460] Webserver started at http://127.11.229.131:44187/ using document root <none> and password file <none>
I20260923 17:14:28.064610 18116 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:28.064713 18116 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:28.064954 18116 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:28.067260 18116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/ts-2/data/instance:
uuid: "18b624fc7b3448ceb041b9f13f652d99"
format_stamp: "Formatted at 2026-09-23 17:14:28 on dist-test-slave-1x1f"
server_key: "6920029ff744c32718702e24aba3dccd"
server_key_iv: "ea06ffaa3639ba1a0519c8264006850a"
server_key_version: "encryptionkey@0"
I20260923 17:14:28.067847 18116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance:
uuid: "18b624fc7b3448ceb041b9f13f652d99"
format_stamp: "Formatted at 2026-09-23 17:14:28 on dist-test-slave-1x1f"
server_key: "6920029ff744c32718702e24aba3dccd"
server_key_iv: "ea06ffaa3639ba1a0519c8264006850a"
server_key_version: "encryptionkey@0"
I20260923 17:14:28.071768 18116 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260923 17:14:28.074875 18131 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:28.076349 18116 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260923 17:14:28.076496 18116 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/ts-2/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/ts-2/wal
uuid: "18b624fc7b3448ceb041b9f13f652d99"
format_stamp: "Formatted at 2026-09-23 17:14:28 on dist-test-slave-1x1f"
server_key: "6920029ff744c32718702e24aba3dccd"
server_key_iv: "ea06ffaa3639ba1a0519c8264006850a"
server_key_version: "encryptionkey@0"
I20260923 17:14:28.076627 18116 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:28.109579 18116 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:28.112758 18116 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:28.112977 18116 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:28.113602 18116 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:14:28.114675 18116 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:14:28.114751 18116 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:28.114825 18116 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:14:28.114876 18116 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:28.125010 18116 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.131:44119
I20260923 17:14:28.125038 18244 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.131:44119 every 8 connection(s)
I20260923 17:14:28.126045 18116 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
I20260923 17:14:28.132251 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 18116
I20260923 17:14:28.132350 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance
I20260923 17:14:28.132674 12182 external_mini_cluster.cc:1428] Setting key 430a28b5dd6ee90d325a040e8189f6e7
Sep 23 17:14:28 dist-test-slave-1x1f krb5kdc[17741](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183668, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.131@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:14:28.140863 17825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:28.127924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:54351 (local address 127.11.229.190:43647)
0923 17:14:28.128077 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:28.128081 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:28.129113 (+ 1032us) server_negotiation.cc:407] Connection header received
0923 17:14:28.130775 (+ 1662us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:28.130779 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:28.130837 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:28.130938 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:28.132172 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:28.132861 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:28.134301 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:28.134531 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:28.134643 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:28.137132 (+ 2489us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:28.137135 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:28.137137 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:28.137164 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:28.138733 (+ 1569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:28.139282 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:28.139285 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:28.139287 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:28.139362 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:28.139725 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:28.139728 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:28.139729 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:28.139946 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:28.140045 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:28.140609 (+ 564us) server_negotiation.cc:299] Negotiation successful
0923 17:14:28.140726 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260923 17:14:28.141717 18247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:28.128359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:43647 (local address 127.11.229.131:54351)
0923 17:14:28.128939 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:28.128982 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:28.130562 (+ 1580us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:28.131118 (+ 556us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:28.131127 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:28.131529 (+ 402us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:28.132026 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:28.132037 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:28.132979 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:28.132982 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:28.134153 (+ 1171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:28.134161 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:28.134677 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:28.134682 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:28.134863 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:28.135478 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:28.135494 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:28.136978 (+ 1484us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:28.138868 (+ 1890us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:28.138873 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:28.138886 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:28.139186 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:28.139465 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:28.139468 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:28.139470 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:28.139614 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:28.140095 (+ 481us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:28.140101 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:28.140376 (+ 275us) client_negotiation.cc:769] Sending connection context
0923 17:14:28.140539 (+ 163us) client_negotiation.cc:240] Negotiation successful
0923 17:14:28.140794 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":114,"threads_started":1}
I20260923 17:14:28.142925 18245 heartbeater.cc:347] Connected to a master server at 127.11.229.190:43647
I20260923 17:14:28.143185 18245 heartbeater.cc:464] Registering TS with master...
I20260923 17:14:28.143682 18245 heartbeater.cc:511] Master 127.11.229.190:43647 requested a full tablet report, sending...
I20260923 17:14:28.144879 17786 ts_manager.cc:194] Registered new tserver with Master: 18b624fc7b3448ceb041b9f13f652d99 (127.11.229.131:44119)
I20260923 17:14:28.145720 17786 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.131@KRBTEST.COM'} at 127.11.229.131:54351
I20260923 17:14:28.147132 12182 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/krb5kdc/test-admin.keytab.
Sep 23 17:14:28 dist-test-slave-1x1f krb5kdc[17741](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183668, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:28.163895 12182 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260923 17:14:28.166849 18252 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:28.165406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38788 (local address 127.11.229.129:45263)
0923 17:14:28.165681 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:28.165690 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:28.165726 (+ 36us) server_negotiation.cc:407] Connection header received
0923 17:14:28.165781 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:28.165786 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:28.166001 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:28.166137 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:28.166672 (+ 535us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38788: BlockingRecv error: recv got EOF from 127.0.0.1:38788 (error 108)
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":106,"threads_started":1}
W20260923 17:14:28.166988 12182 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/krb5kdc/krb5cc' of type FILE
Sep 23 17:14:28 dist-test-slave-1x1f krb5kdc[17741](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183668, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:28.168084 12182 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Sep 23 17:14:28 dist-test-slave-1x1f krb5kdc[17741](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183668, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:28.169157 12182 init.cc:295] Successfully reacquired a new kerberos TGT
Sep 23 17:14:28 dist-test-slave-1x1f krb5kdc[17741](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183668, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.229.129@KRBTEST.COM
I20260923 17:14:28.181332 18252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:28.170118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38798 (local address 127.11.229.129:45263)
0923 17:14:28.170271 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:28.170275 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:28.170452 (+ 177us) server_negotiation.cc:407] Connection header received
0923 17:14:28.170624 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:28.170632 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:28.170675 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:28.170787 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:28.171342 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:28.172103 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:28.172934 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:28.173319 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:28.173438 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:28.176437 (+ 2999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:28.176446 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:28.176460 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:28.176485 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:28.178707 (+ 2222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:28.179425 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:28.179434 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:28.179436 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:28.179631 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:28.180133 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:28.180137 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:28.180139 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:28.180599 (+ 460us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:28.180874 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:28.181053 (+ 179us) server_negotiation.cc:299] Negotiation successful
0923 17:14:28.181187 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
W20260923 17:14:28.185788 18252 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:28.184749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38802 (local address 127.11.229.129:45263)
0923 17:14:28.184897 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:28.184901 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:28.184916 (+ 15us) server_negotiation.cc:407] Connection header received
0923 17:14:28.185034 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:28.185037 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:28.185073 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:28.185142 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:28.185676 (+ 534us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38802: BlockingRecv error: recv got EOF from 127.0.0.1:38802 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
W20260923 17:14:28.185814 12182 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/krb5kdc/krb5cc' of type FILE
Sep 23 17:14:28 dist-test-slave-1x1f krb5kdc[17741](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183668, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:28.186932 12182 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Sep 23 17:14:28 dist-test-slave-1x1f krb5kdc[17741](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183668, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:28.187990 12182 init.cc:295] Successfully reacquired a new kerberos TGT
Sep 23 17:14:28 dist-test-slave-1x1f krb5kdc[17741](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183668, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.229.129@KRBTEST.COM
I20260923 17:14:28.198000 18252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:28.189042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38808 (local address 127.11.229.129:45263)
0923 17:14:28.189256 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:28.189262 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:28.189470 (+ 208us) server_negotiation.cc:407] Connection header received
0923 17:14:28.189515 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:28.189517 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:28.189574 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:28.189645 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:28.190130 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:28.190816 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:28.191610 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:28.191828 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:28.191918 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:28.194481 (+ 2563us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:28.194484 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:28.194486 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:28.194514 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:28.196221 (+ 1707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:28.196657 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:28.196660 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:28.196661 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:28.196764 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:28.197047 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:28.197050 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:28.197051 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:28.197282 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:28.197406 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:28.197647 (+ 241us) server_negotiation.cc:299] Negotiation successful
0923 17:14:28.197808 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
W20260923 17:14:28.201710 18252 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:28.200512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38824 (local address 127.11.229.129:45263)
0923 17:14:28.200673 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:28.200680 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:28.200796 (+ 116us) server_negotiation.cc:407] Connection header received
0923 17:14:28.200955 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:28.200959 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:28.201009 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:28.201099 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:28.201572 (+ 473us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:38824: BlockingRecv error: recv got EOF from 127.0.0.1:38824 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
W20260923 17:14:28.202075 12182 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790183633736342-12182-0/krb5kdc/krb5cc' of type FILE
Sep 23 17:14:28 dist-test-slave-1x1f krb5kdc[17741](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183668, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:28.203567 12182 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Sep 23 17:14:28 dist-test-slave-1x1f krb5kdc[17741](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183668, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:28.204954 12182 init.cc:295] Successfully reacquired a new kerberos TGT
Sep 23 17:14:28 dist-test-slave-1x1f krb5kdc[17741](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183668, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.229.129@KRBTEST.COM
I20260923 17:14:28.215905 18252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:28.205938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38826 (local address 127.11.229.129:45263)
0923 17:14:28.206183 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:28.206189 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:28.206374 (+ 185us) server_negotiation.cc:407] Connection header received
0923 17:14:28.206699 (+ 325us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:28.206704 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:28.206774 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:28.206915 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:28.207665 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:28.208392 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:28.209369 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:28.209612 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:28.209731 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:28.212616 (+ 2885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:28.212620 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:28.212622 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:28.212650 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:28.214081 (+ 1431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:28.214599 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:28.214605 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:28.214607 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:28.214690 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:28.214995 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:28.214998 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:28.215000 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:28.215188 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:28.215367 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:28.215615 (+ 248us) server_negotiation.cc:299] Negotiation successful
0923 17:14:28.215731 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102}
I20260923 17:14:28.217247 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 17848
I20260923 17:14:28.223167 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 17982
I20260923 17:14:28.228538 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 18116
I20260923 17:14:28.234853 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 17754
2026-09-23T17:14:28Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2270 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 17:14:28 dist-test-slave-1x1f krb5kdc[18265](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 17:14:28 dist-test-slave-1x1f krb5kdc[18265](info): set up 2 sockets
Sep 23 17:14:28 dist-test-slave-1x1f krb5kdc[18265](info): commencing operation
krb5kdc: starting...
W20260923 17:14:29.340312 12182 mini_kdc.cc:121] Time spent starting KDC: real 1.083s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Sep 23 17:14:29 dist-test-slave-1x1f krb5kdc[18265](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183669, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T17:14:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:14:29Z Disabled control of system clock
WARNING: no policy specified for oryx/127.11.229.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.229.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.229.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.190.keytab.
Entry for principal oryx/127.11.229.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.190.keytab.
I20260923 17:14:29.474210 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:33923
--webserver_interface=127.11.229.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.190.keytab
--principal=oryx/127.11.229.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:46513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:33923
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:14:29.589490 18278 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:29.589850 18278 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:29.589927 18278 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:29.594085 18278 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:14:29.594252 18278 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:29.594314 18278 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:29.594377 18278 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:14:29.594415 18278 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:14:29.599905 18278 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:46513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:33923
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.190.keytab
--principal=oryx/127.11.229.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:33923
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.229.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18278
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:29.601097 18278 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:29.602185 18278 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:29.611641 18284 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:29.611624 18286 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:29.611618 18283 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:29.612069 18278 server_base.cc:1034] running on GCE node
I20260923 17:14:29.612792 18278 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:29.614010 18278 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:29.615200 18278 hybrid_clock.cc:648] HybridClock initialized: now 1790183669615184 us; error 35 us; skew 500 ppm
Sep 23 17:14:29 dist-test-slave-1x1f krb5kdc[18265](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183669, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.229.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:29.618317 18278 init.cc:377] Logged in from keytab as oryx/127.11.229.190@KRBTEST.COM (short username oryx)
I20260923 17:14:29.619330 18278 webserver.cc:460] Webserver started at http://127.11.229.190:43797/ using document root <none> and password file <none>
I20260923 17:14:29.619864 18278 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:29.619922 18278 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:29.620101 18278 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:29.622273 18278 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "82445899ad234187be57c8b10c01f25a"
format_stamp: "Formatted at 2026-09-23 17:14:29 on dist-test-slave-1x1f"
server_key: "e48a397fdc15e64082a3c7bf7c072519"
server_key_iv: "cbfa8f835ac04bf292880ad0613ad587"
server_key_version: "encryptionkey@0"
I20260923 17:14:29.622884 18278 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "82445899ad234187be57c8b10c01f25a"
format_stamp: "Formatted at 2026-09-23 17:14:29 on dist-test-slave-1x1f"
server_key: "e48a397fdc15e64082a3c7bf7c072519"
server_key_iv: "cbfa8f835ac04bf292880ad0613ad587"
server_key_version: "encryptionkey@0"
I20260923 17:14:29.626772 18278 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260923 17:14:29.629647 18293 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:29.631471 18278 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 17:14:29.631668 18278 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "82445899ad234187be57c8b10c01f25a"
format_stamp: "Formatted at 2026-09-23 17:14:29 on dist-test-slave-1x1f"
server_key: "e48a397fdc15e64082a3c7bf7c072519"
server_key_iv: "cbfa8f835ac04bf292880ad0613ad587"
server_key_version: "encryptionkey@0"
I20260923 17:14:29.631817 18278 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:29.657436 18278 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:29.660737 18278 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:29.660951 18278 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:29.668259 18278 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.190:33923
I20260923 17:14:29.668567 18345 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.190:33923 every 8 connection(s)
I20260923 17:14:29.669306 18278 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:14:29.671495 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 18278
I20260923 17:14:29.671628 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:14:29.671936 12182 external_mini_cluster.cc:1428] Setting key cea01355f63fcc6aa889ed95562d0f33
I20260923 17:14:29.672803 18346 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:29.679625 18346 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a: Bootstrap starting.
Sep 23 17:14:29 dist-test-slave-1x1f krb5kdc[18265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183669, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM
I20260923 17:14:29.682057 18346 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:29.683030 18346 log.cc:824] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a: Log is configured to *not* fsync() on all Append() calls
I20260923 17:14:29.685316 18346 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a: No bootstrap required, opened a new log
I20260923 17:14:29.687306 18349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:29.673423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43370 (local address 127.11.229.190:33923)
0923 17:14:29.673850 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:29.673870 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:29.673910 (+ 40us) server_negotiation.cc:407] Connection header received
0923 17:14:29.674815 (+ 905us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:29.674838 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:29.675269 (+ 431us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:29.675639 (+ 370us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:29.676374 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:29.677827 (+ 1453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:29.678815 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:29.679490 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:29.679667 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:29.682190 (+ 2523us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:29.682196 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:29.682221 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:29.682272 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:29.684222 (+ 1950us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:29.684699 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:29.684705 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:29.684711 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:29.684838 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:29.685109 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:29.685112 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:29.685114 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:29.685597 (+ 483us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:29.685784 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:29.686041 (+ 257us) server_negotiation.cc:299] Negotiation successful
0923 17:14:29.686374 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":287,"thread_start_us":127,"threads_started":1}
I20260923 17:14:29.689761 18346 raft_consensus.cc:348] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } }
I20260923 17:14:29.689992 18346 raft_consensus.cc:374] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:29.690035 18346 raft_consensus.cc:729] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82445899ad234187be57c8b10c01f25a, State: Initialized, Role: FOLLOWER
I20260923 17:14:29.690471 18346 consensus_queue.cc:260] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } }
I20260923 17:14:29.690600 18346 raft_consensus.cc:388] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:14:29.690642 18346 raft_consensus.cc:482] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:14:29.690706 18346 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:29.691613 18346 raft_consensus.cc:504] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } }
I20260923 17:14:29.691900 18346 leader_election.cc:302] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 82445899ad234187be57c8b10c01f25a; no voters:
I20260923 17:14:29.692160 18346 leader_election.cc:288] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 17:14:29.692301 18351 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:14:29.692559 18351 raft_consensus.cc:686] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a [term 1 LEADER]: Becoming Leader. State: Replica: 82445899ad234187be57c8b10c01f25a, State: Running, Role: LEADER
I20260923 17:14:29.692925 18351 consensus_queue.cc:237] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } }
I20260923 17:14:29.693368 18346 sys_catalog.cc:564] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:14:29.694646 18353 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 82445899ad234187be57c8b10c01f25a. Latest consensus state: current_term: 1 leader_uuid: "82445899ad234187be57c8b10c01f25a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } } }
I20260923 17:14:29.694775 18353 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a [sys.catalog]: This master's current role is: LEADER
I20260923 17:14:29.694995 18352 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "82445899ad234187be57c8b10c01f25a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } } }
I20260923 17:14:29.695142 18352 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a [sys.catalog]: This master's current role is: LEADER
I20260923 17:14:29.695259 18360 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:14:29.698122 18360 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:14:29.704011 18360 catalog_manager.cc:1347] Generated new cluster ID: 2af4a61483ae46e0bded270bd7f86176
I20260923 17:14:29.704128 18360 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:14:29.711437 18360 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:14:29.712451 18360 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:14:29.718261 18360 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a: Generated new TSK 0
I20260923 17:14:29.719005 18360 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.11.229.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.229.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.229.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.129.keytab.
Entry for principal oryx/127.11.229.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.129.keytab.
I20260923 17:14:29.755080 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.129:0
--local_ip_for_outbound_sockets=127.11.229.129
--webserver_interface=127.11.229.129
--webserver_port=0
--tserver_master_addrs=127.11.229.190:33923
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.129.keytab
--principal=oryx/127.11.229.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:46513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:14:29.873081 18372 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:29.873364 18372 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:29.873410 18372 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:29.877596 18372 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:29.877671 18372 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:29.877731 18372 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.129
I20260923 17:14:29.883345 18372 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:46513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.129.keytab
--principal=oryx/127.11.229.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.229.129
--webserver_port=0
--tserver_master_addrs=127.11.229.190:33923
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18372
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.129
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:29.884500 18372 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:29.885555 18372 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:29.895538 18380 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:29.895553 18378 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:29.895543 18377 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:29.895984 18372 server_base.cc:1034] running on GCE node
I20260923 17:14:29.896425 18372 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:29.897071 18372 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:29.898308 18372 hybrid_clock.cc:648] HybridClock initialized: now 1790183669898288 us; error 28 us; skew 500 ppm
Sep 23 17:14:29 dist-test-slave-1x1f krb5kdc[18265](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183669, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.229.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:29.901297 18372 init.cc:377] Logged in from keytab as oryx/127.11.229.129@KRBTEST.COM (short username oryx)
I20260923 17:14:29.902374 18372 webserver.cc:460] Webserver started at http://127.11.229.129:46323/ using document root <none> and password file <none>
I20260923 17:14:29.902984 18372 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:29.903081 18372 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:29.903321 18372 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:29.905562 18372 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-0/data/instance:
uuid: "d930318e4a9443309ed6c0a9490175c2"
format_stamp: "Formatted at 2026-09-23 17:14:29 on dist-test-slave-1x1f"
server_key: "61a12f18eefe93e3cc6b204fc3c388be"
server_key_iv: "141f0db760cc3d6e0b37ab661a966c90"
server_key_version: "encryptionkey@0"
I20260923 17:14:29.906211 18372 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance:
uuid: "d930318e4a9443309ed6c0a9490175c2"
format_stamp: "Formatted at 2026-09-23 17:14:29 on dist-test-slave-1x1f"
server_key: "61a12f18eefe93e3cc6b204fc3c388be"
server_key_iv: "141f0db760cc3d6e0b37ab661a966c90"
server_key_version: "encryptionkey@0"
I20260923 17:14:29.912681 18372 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.003s
I20260923 17:14:29.915680 18387 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:29.917135 18372 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260923 17:14:29.917361 18372 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-0/wal
uuid: "d930318e4a9443309ed6c0a9490175c2"
format_stamp: "Formatted at 2026-09-23 17:14:29 on dist-test-slave-1x1f"
server_key: "61a12f18eefe93e3cc6b204fc3c388be"
server_key_iv: "141f0db760cc3d6e0b37ab661a966c90"
server_key_version: "encryptionkey@0"
I20260923 17:14:29.917511 18372 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:29.934898 18372 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:29.938608 18372 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:29.938862 18372 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:29.939517 18372 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:14:29.940438 18372 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:14:29.940513 18372 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:29.940621 18372 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:14:29.940678 18372 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:29.951113 18372 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.129:38289
I20260923 17:14:29.951130 18500 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.129:38289 every 8 connection(s)
I20260923 17:14:29.952134 18372 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
I20260923 17:14:29.952924 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 18372
I20260923 17:14:29.953068 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance
I20260923 17:14:29.953399 12182 external_mini_cluster.cc:1428] Setting key 4b8b0532c4d4b9c9e6410a65e9e9a294
WARNING: no policy specified for oryx/127.11.229.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.229.130@KRBTEST.COM" created.
Sep 23 17:14:29 dist-test-slave-1x1f krb5kdc[18265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183669, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.229.129@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM
I20260923 17:14:29.975597 18349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:29.954428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:41861 (local address 127.11.229.190:33923)
0923 17:14:29.954637 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:29.954643 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:29.956064 (+ 1421us) server_negotiation.cc:407] Connection header received
0923 17:14:29.958671 (+ 2607us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:29.958678 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:29.958760 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:29.958882 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:29.960465 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:29.961402 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:29.962898 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:29.963306 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:29.963428 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:29.970511 (+ 7083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:29.970516 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:29.970518 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:29.970560 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:29.972895 (+ 2335us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:29.973703 (+ 808us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:29.973707 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:29.973709 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:29.973814 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:29.974255 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:29.974261 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:29.974266 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:29.974499 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:29.974623 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:29.975218 (+ 595us) server_negotiation.cc:299] Negotiation successful
0923 17:14:29.975381 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260923 17:14:29.976540 18503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:29.954944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:33923 (local address 127.11.229.129:41861)
0923 17:14:29.955813 (+ 869us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:29.955912 (+ 99us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:29.958203 (+ 2291us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:29.959142 (+ 939us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:29.959196 (+ 54us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:29.959646 (+ 450us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:29.960272 (+ 626us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:29.960289 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:29.961580 (+ 1291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:29.961584 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:29.962755 (+ 1171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:29.962767 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:29.963492 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:29.963495 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:29.963664 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:29.964451 (+ 787us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:29.964470 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:29.970113 (+ 5643us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:29.973120 (+ 3007us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:29.973129 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:29.973160 (+ 31us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:29.973554 (+ 394us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:29.973923 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:29.973927 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:29.973930 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:29.974104 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:29.974620 (+ 516us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:29.974628 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:29.974941 (+ 313us) client_negotiation.cc:769] Sending connection context
0923 17:14:29.975159 (+ 218us) client_negotiation.cc:240] Negotiation successful
0923 17:14:29.975555 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":513,"thread_start_us":189,"threads_started":1}
I20260923 17:14:29.977985 18501 heartbeater.cc:347] Connected to a master server at 127.11.229.190:33923
I20260923 17:14:29.978633 18501 heartbeater.cc:464] Registering TS with master...
I20260923 17:14:29.979588 18501 heartbeater.cc:511] Master 127.11.229.190:33923 requested a full tablet report, sending...
I20260923 17:14:29.981889 18306 ts_manager.cc:194] Registered new tserver with Master: d930318e4a9443309ed6c0a9490175c2 (127.11.229.129:38289)
I20260923 17:14:29.983449 18306 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.229.129@KRBTEST.COM'} at 127.11.229.129:41861
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.229.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.130.keytab.
Entry for principal oryx/127.11.229.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.130.keytab.
I20260923 17:14:29.989254 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.130:0
--local_ip_for_outbound_sockets=127.11.229.130
--webserver_interface=127.11.229.130
--webserver_port=0
--tserver_master_addrs=127.11.229.190:33923
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.130.keytab
--principal=oryx/127.11.229.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:46513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:14:30.106712 18506 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:30.107018 18506 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:30.107065 18506 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:30.111277 18506 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:30.111361 18506 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:30.111424 18506 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.130
I20260923 17:14:30.118909 18506 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:46513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.130.keytab
--principal=oryx/127.11.229.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.229.130
--webserver_port=0
--tserver_master_addrs=127.11.229.190:33923
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18506
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.130
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:30.120112 18506 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:30.121300 18506 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:30.132447 18511 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:30.132447 18514 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:30.132504 18506 server_base.cc:1034] running on GCE node
W20260923 17:14:30.132473 18512 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:30.133221 18506 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:30.133976 18506 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:30.135171 18506 hybrid_clock.cc:648] HybridClock initialized: now 1790183670135154 us; error 32 us; skew 500 ppm
Sep 23 17:14:30 dist-test-slave-1x1f krb5kdc[18265](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183670, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.229.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:30.138476 18506 init.cc:377] Logged in from keytab as oryx/127.11.229.130@KRBTEST.COM (short username oryx)
I20260923 17:14:30.139412 18506 webserver.cc:460] Webserver started at http://127.11.229.130:35897/ using document root <none> and password file <none>
I20260923 17:14:30.140003 18506 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:30.140093 18506 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:30.140303 18506 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:30.142529 18506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-1/data/instance:
uuid: "d093525f85d24b5c8553b86206c34471"
format_stamp: "Formatted at 2026-09-23 17:14:30 on dist-test-slave-1x1f"
server_key: "b84f52253504d0de22c30b823e52a38e"
server_key_iv: "dc98b174bbbabac46c84639032209f85"
server_key_version: "encryptionkey@0"
I20260923 17:14:30.143100 18506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance:
uuid: "d093525f85d24b5c8553b86206c34471"
format_stamp: "Formatted at 2026-09-23 17:14:30 on dist-test-slave-1x1f"
server_key: "b84f52253504d0de22c30b823e52a38e"
server_key_iv: "dc98b174bbbabac46c84639032209f85"
server_key_version: "encryptionkey@0"
I20260923 17:14:30.147342 18506 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260923 17:14:30.149953 18521 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:30.151456 18506 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 17:14:30.151598 18506 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-1/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-1/wal
uuid: "d093525f85d24b5c8553b86206c34471"
format_stamp: "Formatted at 2026-09-23 17:14:30 on dist-test-slave-1x1f"
server_key: "b84f52253504d0de22c30b823e52a38e"
server_key_iv: "dc98b174bbbabac46c84639032209f85"
server_key_version: "encryptionkey@0"
I20260923 17:14:30.151729 18506 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:30.164625 18506 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:30.168452 18506 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:30.168696 18506 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:30.169322 18506 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:14:30.170184 18506 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:14:30.170315 18506 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:30.170393 18506 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:14:30.170444 18506 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:30.179793 18506 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.130:41891
I20260923 17:14:30.179816 18634 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.130:41891 every 8 connection(s)
I20260923 17:14:30.180692 18506 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
I20260923 17:14:30.186705 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 18506
I20260923 17:14:30.186828 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance
I20260923 17:14:30.187145 12182 external_mini_cluster.cc:1428] Setting key 9265780f1f2efaf408e921a8147889a4
Sep 23 17:14:30 dist-test-slave-1x1f krb5kdc[18265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183670, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.229.130@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM
I20260923 17:14:30.197417 18349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:30.182627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:39505 (local address 127.11.229.190:33923)
0923 17:14:30.182774 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:30.182777 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:30.183665 (+ 888us) server_negotiation.cc:407] Connection header received
0923 17:14:30.185238 (+ 1573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:30.185241 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:30.185304 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:30.185418 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:30.186881 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:30.187635 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:30.188957 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:30.189171 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:30.189305 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:30.192136 (+ 2831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:30.192143 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:30.192149 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:30.192185 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:30.194727 (+ 2542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:30.195415 (+ 688us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:30.195419 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:30.195421 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:30.195522 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:30.196054 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:30.196060 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:30.196061 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:30.196336 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:30.196450 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:30.197064 (+ 614us) server_negotiation.cc:299] Negotiation successful
0923 17:14:30.197214 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
WARNING: no policy specified for oryx/127.11.229.131@KRBTEST.COM; defaulting to no policy
I20260923 17:14:30.198489 18637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:30.182949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:33923 (local address 127.11.229.130:39505)
0923 17:14:30.183495 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:30.183541 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:30.184984 (+ 1443us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:30.185621 (+ 637us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:30.185629 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:30.186035 (+ 406us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:30.186684 (+ 649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:30.186699 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:30.187776 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:30.187780 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:30.188809 (+ 1029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:30.188819 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:30.189340 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:30.189347 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:30.189609 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:30.190277 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:30.190304 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:30.191933 (+ 1629us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:30.194908 (+ 2975us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:30.194915 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:30.194933 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:30.195304 (+ 371us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:30.195679 (+ 375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:30.195683 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:30.195685 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:30.195938 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:30.196475 (+ 537us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:30.196482 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:30.196768 (+ 286us) client_negotiation.cc:769] Sending connection context
0923 17:14:30.196955 (+ 187us) client_negotiation.cc:240] Negotiation successful
0923 17:14:30.197313 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":115,"threads_started":1}
I20260923 17:14:30.199848 18635 heartbeater.cc:347] Connected to a master server at 127.11.229.190:33923
I20260923 17:14:30.200103 18635 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.229.131@KRBTEST.COM" created.
I20260923 17:14:30.200788 18635 heartbeater.cc:511] Master 127.11.229.190:33923 requested a full tablet report, sending...
I20260923 17:14:30.202059 18306 ts_manager.cc:194] Registered new tserver with Master: d093525f85d24b5c8553b86206c34471 (127.11.229.130:41891)
I20260923 17:14:30.202786 18306 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.229.130@KRBTEST.COM'} at 127.11.229.130:39505
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.229.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.131.keytab.
Entry for principal oryx/127.11.229.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.131.keytab.
I20260923 17:14:30.218775 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.131:0
--local_ip_for_outbound_sockets=127.11.229.131
--webserver_interface=127.11.229.131
--webserver_port=0
--tserver_master_addrs=127.11.229.190:33923
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.131.keytab
--principal=oryx/127.11.229.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:46513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:14:30.331210 18640 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:30.331507 18640 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:30.331615 18640 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:30.335768 18640 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:30.335851 18640 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:30.335937 18640 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.131
I20260923 17:14:30.341346 18640 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:46513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.131.keytab
--principal=oryx/127.11.229.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.229.131
--webserver_port=0
--tserver_master_addrs=127.11.229.190:33923
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18640
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.131
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:30.342555 18640 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:30.343575 18640 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:30.353276 18646 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:30.353245 18645 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:30.353245 18648 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:30.353296 18640 server_base.cc:1034] running on GCE node
I20260923 17:14:30.353861 18640 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:30.354568 18640 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:30.355773 18640 hybrid_clock.cc:648] HybridClock initialized: now 1790183670355739 us; error 55 us; skew 500 ppm
Sep 23 17:14:30 dist-test-slave-1x1f krb5kdc[18265](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183670, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.229.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:30.358631 18640 init.cc:377] Logged in from keytab as oryx/127.11.229.131@KRBTEST.COM (short username oryx)
I20260923 17:14:30.359508 18640 webserver.cc:460] Webserver started at http://127.11.229.131:38881/ using document root <none> and password file <none>
I20260923 17:14:30.360080 18640 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:30.360172 18640 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:30.360582 18640 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:30.362982 18640 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-2/data/instance:
uuid: "2a945117689c4bd4893b29d15d7acb56"
format_stamp: "Formatted at 2026-09-23 17:14:30 on dist-test-slave-1x1f"
server_key: "475ff1aef368c3fdb305d94911ffdd5c"
server_key_iv: "e023422b7e287da12397ec2d05a836fd"
server_key_version: "encryptionkey@0"
I20260923 17:14:30.363647 18640 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance:
uuid: "2a945117689c4bd4893b29d15d7acb56"
format_stamp: "Formatted at 2026-09-23 17:14:30 on dist-test-slave-1x1f"
server_key: "475ff1aef368c3fdb305d94911ffdd5c"
server_key_iv: "e023422b7e287da12397ec2d05a836fd"
server_key_version: "encryptionkey@0"
I20260923 17:14:30.368430 18640 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260923 17:14:30.371440 18655 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:30.373003 18640 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 17:14:30.373155 18640 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-2/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-2/wal
uuid: "2a945117689c4bd4893b29d15d7acb56"
format_stamp: "Formatted at 2026-09-23 17:14:30 on dist-test-slave-1x1f"
server_key: "475ff1aef368c3fdb305d94911ffdd5c"
server_key_iv: "e023422b7e287da12397ec2d05a836fd"
server_key_version: "encryptionkey@0"
I20260923 17:14:30.373291 18640 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:30.383170 18640 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:30.386662 18640 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:30.386890 18640 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:30.387508 18640 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:14:30.388360 18640 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:14:30.388430 18640 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:30.388500 18640 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:14:30.388549 18640 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:30.397966 18640 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.131:42203
I20260923 17:14:30.397989 18768 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.131:42203 every 8 connection(s)
I20260923 17:14:30.398964 18640 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
I20260923 17:14:30.406602 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 18640
I20260923 17:14:30.406739 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance
I20260923 17:14:30.407040 12182 external_mini_cluster.cc:1428] Setting key 6d75db84d942e9d7992ff3633bd5f776
Sep 23 17:14:30 dist-test-slave-1x1f krb5kdc[18265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183670, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.229.131@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM
I20260923 17:14:30.414453 18349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:30.400808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:52297 (local address 127.11.229.190:33923)
0923 17:14:30.400939 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:30.400943 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:30.401738 (+ 795us) server_negotiation.cc:407] Connection header received
0923 17:14:30.403058 (+ 1320us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:30.403061 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:30.403106 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:30.403184 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:30.404289 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:30.404819 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:30.406835 (+ 2016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:30.407142 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:30.407230 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:30.410269 (+ 3039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:30.410272 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:30.410274 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:30.410298 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:30.411785 (+ 1487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:30.412680 (+ 895us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:30.412683 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:30.412684 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:30.412763 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:30.413233 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:30.413240 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:30.413242 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:30.413450 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:30.413540 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:30.414146 (+ 606us) server_negotiation.cc:299] Negotiation successful
0923 17:14:30.414295 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260923 17:14:30.415419 18771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:30.401107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:33923 (local address 127.11.229.131:52297)
0923 17:14:30.401577 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:30.401619 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:30.402865 (+ 1246us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:30.403309 (+ 444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:30.403315 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:30.403662 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:30.404148 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:30.404160 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:30.405092 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:30.405103 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:30.406636 (+ 1533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:30.406653 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:30.407463 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:30.407468 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:30.407691 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:30.408399 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:30.408424 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:30.410080 (+ 1656us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:30.411985 (+ 1905us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:30.411995 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:30.412027 (+ 32us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:30.412518 (+ 491us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:30.412903 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:30.412906 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:30.412907 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:30.413096 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:30.413608 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:30.413614 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:30.413904 (+ 290us) client_negotiation.cc:769] Sending connection context
0923 17:14:30.414090 (+ 186us) client_negotiation.cc:240] Negotiation successful
0923 17:14:30.414522 (+ 432us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":120,"threads_started":1}
I20260923 17:14:30.416675 18769 heartbeater.cc:347] Connected to a master server at 127.11.229.190:33923
I20260923 17:14:30.416930 18769 heartbeater.cc:464] Registering TS with master...
I20260923 17:14:30.417418 18769 heartbeater.cc:511] Master 127.11.229.190:33923 requested a full tablet report, sending...
I20260923 17:14:30.418562 18306 ts_manager.cc:194] Registered new tserver with Master: 2a945117689c4bd4893b29d15d7acb56 (127.11.229.131:42203)
I20260923 17:14:30.419137 18306 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.229.131@KRBTEST.COM'} at 127.11.229.131:52297
I20260923 17:14:30.421238 12182 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.11.229.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.229.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.229.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.189.keytab.
Entry for principal oryx/127.11.229.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.189.keytab.
I20260923 17:14:30.450558 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.189:44707
--webserver_interface=127.11.229.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.189.keytab
--principal=oryx/127.11.229.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:46513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:33923,127.11.229.189:44707
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:14:30.564713 18774 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:30.564986 18774 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:30.565028 18774 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:30.569115 18774 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:14:30.569180 18774 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:30.569199 18774 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:30.569216 18774 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:14:30.569267 18774 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:14:30.574747 18774 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:46513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:33923,127.11.229.189:44707
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.189.keytab
--principal=oryx/127.11.229.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.189:44707
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.229.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18774
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
W20260923 17:14:30.575001 18774 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.11.229.190:33923,127.11.229.189:44707'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260923 17:14:30.575922 18774 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:30.577014 18774 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260923 17:14:30.585727 18774 server_base.cc:1034] running on GCE node
W20260923 17:14:30.585683 18782 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:30.585691 18780 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:30.585764 18779 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:30.586717 18774 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:30.587895 18774 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:30.589092 18774 hybrid_clock.cc:648] HybridClock initialized: now 1790183670589078 us; error 30 us; skew 500 ppm
Sep 23 17:14:30 dist-test-slave-1x1f krb5kdc[18265](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183670, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.229.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:30.591964 18774 init.cc:377] Logged in from keytab as oryx/127.11.229.189@KRBTEST.COM (short username oryx)
I20260923 17:14:30.592936 18774 webserver.cc:460] Webserver started at http://127.11.229.189:40089/ using document root <none> and password file <none>
I20260923 17:14:30.593523 18774 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:30.593617 18774 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:30.593876 18774 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:30.596212 18774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-1/data/instance:
uuid: "8f4f49faad444410bf28c38f8ae42d2d"
format_stamp: "Formatted at 2026-09-23 17:14:30 on dist-test-slave-1x1f"
server_key: "afd320118ae9c3ab73a2cf64a5bc2e34"
server_key_iv: "a9424c54e5060091182ef847b842b220"
server_key_version: "encryptionkey@0"
I20260923 17:14:30.596797 18774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-1/wal/instance:
uuid: "8f4f49faad444410bf28c38f8ae42d2d"
format_stamp: "Formatted at 2026-09-23 17:14:30 on dist-test-slave-1x1f"
server_key: "afd320118ae9c3ab73a2cf64a5bc2e34"
server_key_iv: "a9424c54e5060091182ef847b842b220"
server_key_version: "encryptionkey@0"
I20260923 17:14:30.601053 18774 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260923 17:14:30.603969 18789 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:30.605448 18774 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260923 17:14:30.605626 18774 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-1/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-1/wal
uuid: "8f4f49faad444410bf28c38f8ae42d2d"
format_stamp: "Formatted at 2026-09-23 17:14:30 on dist-test-slave-1x1f"
server_key: "afd320118ae9c3ab73a2cf64a5bc2e34"
server_key_iv: "a9424c54e5060091182ef847b842b220"
server_key_version: "encryptionkey@0"
I20260923 17:14:30.605767 18774 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:30.640849 18774 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:30.644186 18774 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:30.644450 18774 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:30.652371 18774 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.189:44707
I20260923 17:14:30.652707 18841 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.189:44707 every 8 connection(s)
I20260923 17:14:30.653489 18774 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-1/data/info.pb
I20260923 17:14:30.656834 18842 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:30.657574 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 18774
I20260923 17:14:30.661111 18842 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 17:14:30 dist-test-slave-1x1f krb5kdc[18265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183669, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.229.189@KRBTEST.COM
Sep 23 17:14:30 dist-test-slave-1x1f krb5kdc[18265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183670, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.229.189@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM
I20260923 17:14:30.673826 18349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:30.663037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43374 (local address 127.11.229.190:33923)
0923 17:14:30.663180 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:30.663185 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:30.663583 (+ 398us) server_negotiation.cc:407] Connection header received
0923 17:14:30.663716 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:30.663719 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:30.663762 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:30.663826 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:30.664748 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:30.665503 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:30.666985 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:30.667205 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:30.667285 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:30.670041 (+ 2756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:30.670047 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:30.670052 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:30.670083 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:30.671914 (+ 1831us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:30.672434 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:30.672437 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:30.672439 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:30.672526 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:30.672834 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:30.672837 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:30.672839 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:30.673080 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:30.673155 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:30.673553 (+ 398us) server_negotiation.cc:299] Negotiation successful
0923 17:14:30.673682 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260923 17:14:30.674834 18846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:30.662960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:33923 (local address 127.0.0.1:43374)
0923 17:14:30.663426 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:30.663483 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:30.663623 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:30.663914 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:30.663920 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:30.664432 (+ 512us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:30.664616 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:30.664624 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:30.665636 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:30.665643 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:30.666849 (+ 1206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:30.666865 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:30.667377 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:30.667384 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:30.667488 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:30.668015 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:30.668061 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:30.669830 (+ 1769us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:30.672026 (+ 2196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:30.672034 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:30.672040 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:30.672319 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:30.672637 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:30.672640 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:30.672642 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:30.672729 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:30.673233 (+ 504us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:30.673239 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:30.673348 (+ 109us) client_negotiation.cc:769] Sending connection context
0923 17:14:30.673977 (+ 629us) client_negotiation.cc:240] Negotiation successful
0923 17:14:30.674161 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":131,"threads_started":1}
I20260923 17:14:30.674831 18845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:30.659004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34298 (local address 127.11.229.189:44707)
0923 17:14:30.659452 (+ 448us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:30.659472 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:30.659704 (+ 232us) server_negotiation.cc:407] Connection header received
0923 17:14:30.660457 (+ 753us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:30.660473 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:30.660801 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:30.661134 (+ 333us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:30.661905 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:30.663298 (+ 1393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:30.664622 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:30.665326 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:30.665473 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:30.668626 (+ 3153us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:30.668634 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:30.668652 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:30.668686 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:30.670966 (+ 2280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:30.671574 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:30.671583 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:30.671591 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:30.671734 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:30.672084 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:30.672090 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:30.672099 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:30.672654 (+ 555us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:30.672903 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:30.673252 (+ 349us) server_negotiation.cc:299] Negotiation successful
0923 17:14:30.673705 (+ 453us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":185,"threads_started":1}
I20260923 17:14:30.676411 18842 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.229.189" port: 44707 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 17:14:30 dist-test-slave-1x1f krb5kdc[18265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183670, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.229.189@KRBTEST.COM for oryx/127.11.229.189@KRBTEST.COM
I20260923 17:14:30.686079 18845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:30.677084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34308 (local address 127.11.229.189:44707)
0923 17:14:30.677378 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:30.677383 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:30.677396 (+ 13us) server_negotiation.cc:407] Connection header received
0923 17:14:30.677432 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:30.677435 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:30.677480 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:30.677568 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:30.678452 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:30.679011 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:30.679824 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:30.680087 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:30.680207 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:30.682840 (+ 2633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:30.682844 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:30.682847 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:30.682880 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:30.684418 (+ 1538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:30.684870 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:30.684875 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:30.684877 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:30.684952 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:30.685233 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:30.685237 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:30.685239 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:30.685414 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:30.685515 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:30.685750 (+ 235us) server_negotiation.cc:299] Negotiation successful
0923 17:14:30.685895 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":7,"server-negotiator.queue_time_us":228}
I20260923 17:14:30.686084 18846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:30.676929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.189:44707 (local address 127.0.0.1:34308)
0923 17:14:30.677041 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:30.677054 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:30.677126 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:30.677609 (+ 483us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:30.677630 (+ 21us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:30.677807 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:30.678327 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:30.678339 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:30.679136 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:30.679140 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:30.679697 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:30.679704 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:30.680205 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:30.680208 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:30.680371 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:30.680904 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:30.680916 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:30.682669 (+ 1753us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:30.684569 (+ 1900us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:30.684573 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:30.684576 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:30.684770 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:30.685048 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:30.685050 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:30.685052 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:30.685126 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:30.685513 (+ 387us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:30.685516 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:30.685599 (+ 83us) client_negotiation.cc:769] Sending connection context
0923 17:14:30.685726 (+ 127us) client_negotiation.cc:240] Negotiation successful
0923 17:14:30.685966 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43,"mutex_wait_us":149}
I20260923 17:14:30.689234 18842 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d: Bootstrap starting.
I20260923 17:14:30.691565 18842 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:30.692257 18842 log.cc:824] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d: Log is configured to *not* fsync() on all Append() calls
I20260923 17:14:30.694585 18842 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d: No bootstrap required, opened a new log
I20260923 17:14:30.697651 18842 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } } peers { permanent_uuid: "8f4f49faad444410bf28c38f8ae42d2d" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 44707 } }
I20260923 17:14:30.697856 18842 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:30.697888 18842 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f4f49faad444410bf28c38f8ae42d2d, State: Initialized, Role: FOLLOWER
I20260923 17:14:30.698362 18842 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } } peers { permanent_uuid: "8f4f49faad444410bf28c38f8ae42d2d" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 44707 } }
I20260923 17:14:30.698824 18848 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } } peers { permanent_uuid: "8f4f49faad444410bf28c38f8ae42d2d" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 44707 } } }
I20260923 17:14:30.698937 18848 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [sys.catalog]: This master's current role is: FOLLOWER
I20260923 17:14:30.699527 18842 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [sys.catalog]: configured and running, proceeding with master startup.
W20260923 17:14:30.704854 18859 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 17:14:30.704970 18859 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 17:14:30.707065 18774 master_runner.cc:428] Detected that this master 8f4f49faad444410bf28c38f8ae42d2d is joining an existing cluster
I20260923 17:14:30.707154 18774 master_runner.cc:432] Initiating AddMaster RPC to add 127.11.229.189:44707
I20260923 17:14:30.717602 18349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:30.709287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43386 (local address 127.11.229.190:33923)
0923 17:14:30.709483 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:30.709489 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:30.709578 (+ 89us) server_negotiation.cc:407] Connection header received
0923 17:14:30.709690 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:30.709694 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:30.709761 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:30.709850 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:30.710459 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:30.711132 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:30.712284 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:30.712505 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:30.712625 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:30.714162 (+ 1537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:30.714166 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:30.714169 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:30.714196 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:30.715870 (+ 1674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:30.716392 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:30.716396 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:30.716398 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:30.716478 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:30.716765 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:30.716769 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:30.716771 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:30.717009 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:30.717094 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:30.717340 (+ 246us) server_negotiation.cc:299] Negotiation successful
0923 17:14:30.717455 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119}
I20260923 17:14:30.717629 18865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:30.709217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:33923 (local address 127.0.0.1:43386)
0923 17:14:30.709475 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:30.709491 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:30.709603 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:30.709865 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:30.709867 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:30.710090 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:30.710314 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:30.710323 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:30.711237 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:30.711242 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:30.712196 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:30.712207 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:30.712632 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:30.712635 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:30.712723 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:30.713654 (+ 931us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:30.713663 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:30.714021 (+ 358us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:30.715992 (+ 1971us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:30.715995 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:30.715997 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:30.716281 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:30.716582 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:30.716585 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:30.716587 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:30.716683 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:30.717082 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:30.717085 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:30.717172 (+ 87us) client_negotiation.cc:769] Sending connection context
0923 17:14:30.717288 (+ 116us) client_negotiation.cc:240] Negotiation successful
0923 17:14:30.717424 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":93,"threads_started":1}
I20260923 17:14:30.718091 18845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:30.709259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34316 (local address 127.11.229.189:44707)
0923 17:14:30.709378 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:30.709385 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:30.710474 (+ 1089us) server_negotiation.cc:407] Connection header received
0923 17:14:30.710665 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:30.710668 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:30.710713 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:30.710790 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:30.711295 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:30.712115 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:30.713252 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:30.713478 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:30.713555 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:30.715057 (+ 1502us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:30.715064 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:30.715070 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:30.715109 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:30.716553 (+ 1444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:30.717001 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:30.717004 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:30.717006 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:30.717080 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:30.717340 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:30.717343 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:30.717345 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:30.717514 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:30.717574 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:30.717850 (+ 276us) server_negotiation.cc:299] Negotiation successful
0923 17:14:30.717951 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":52,"server-negotiator.queue_time_us":43}
I20260923 17:14:30.718572 18866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:30.709259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.189:44707 (local address 127.0.0.1:34316)
0923 17:14:30.710397 (+ 1138us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:30.710411 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:30.710529 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:30.710825 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:30.710828 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:30.711049 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:30.711175 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:30.711183 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:30.712246 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:30.712249 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:30.713127 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:30.713137 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:30.713596 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:30.713602 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:30.713734 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:30.714541 (+ 807us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:30.714555 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:30.714939 (+ 384us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:30.716671 (+ 1732us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:30.716678 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:30.716680 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:30.716904 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:30.717177 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:30.717179 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:30.717181 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:30.717257 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:30.717640 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:30.717642 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:30.717710 (+ 68us) client_negotiation.cc:769] Sending connection context
0923 17:14:30.718280 (+ 570us) client_negotiation.cc:240] Negotiation successful
0923 17:14:30.718418 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1072,"thread_start_us":121,"threads_started":1}
Sep 23 17:14:30 dist-test-slave-1x1f krb5kdc[18265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183669, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.229.190@KRBTEST.COM for oryx/127.11.229.189@KRBTEST.COM
I20260923 17:14:30.732820 18845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:30.722717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34322 (local address 127.11.229.189:44707)
0923 17:14:30.722850 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:30.722853 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:30.723577 (+ 724us) server_negotiation.cc:407] Connection header received
0923 17:14:30.723799 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:30.723801 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:30.723848 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:30.723917 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:30.724717 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:30.725203 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:30.726435 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:30.726664 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:30.726746 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:30.729401 (+ 2655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:30.729407 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:30.729413 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:30.729447 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:30.731013 (+ 1566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:30.731524 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:30.731529 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:30.731531 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:30.731612 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:30.731904 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:30.731909 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:30.731911 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:30.732092 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:30.732207 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:30.732545 (+ 338us) server_negotiation.cc:299] Negotiation successful
0923 17:14:30.732658 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260923 17:14:30.732861 18867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:30.722647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.189:44707 (local address 127.0.0.1:34322)
0923 17:14:30.723431 (+ 784us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:30.723482 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:30.723625 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:30.723975 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:30.723981 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:30.724431 (+ 450us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:30.724586 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:30.724593 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:30.725306 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:30.725309 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:30.726323 (+ 1014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:30.726334 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:30.726778 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:30.726781 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:30.726900 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:30.727454 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:30.727470 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:30.729273 (+ 1803us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:30.731154 (+ 1881us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:30.731163 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:30.731169 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:30.731416 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:30.731717 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:30.731721 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:30.731723 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:30.731813 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:30.732207 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:30.732216 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:30.732344 (+ 128us) client_negotiation.cc:769] Sending connection context
0923 17:14:30.732494 (+ 150us) client_negotiation.cc:240] Negotiation successful
0923 17:14:30.732707 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":628,"thread_start_us":95,"threads_started":1}
I20260923 17:14:30.734572 18306 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.11.229.189:44707: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "8f4f49faad444410bf28c38f8ae42d2d"
member_type: NON_VOTER
last_known_addr {
host: "127.11.229.189"
port: 44707
}
attrs {
promote: true
}
}
dest_uuid: "82445899ad234187be57c8b10c01f25a"
cas_config_opid_index: -1
I20260923 17:14:30.735266 18306 consensus_queue.cc:237] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } } peers { permanent_uuid: "8f4f49faad444410bf28c38f8ae42d2d" member_type: NON_VOTER last_known_addr { host: "127.11.229.189" port: 44707 } attrs { promote: true } }
I20260923 17:14:30.737679 18870 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 8f4f49faad444410bf28c38f8ae42d2d (127.11.229.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } } peers { permanent_uuid: "8f4f49faad444410bf28c38f8ae42d2d" member_type: NON_VOTER last_known_addr { host: "127.11.229.189" port: 44707 } attrs { promote: true } } }
I20260923 17:14:30.739370 18816 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:30.739995 18870 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.11.229.189:44707
I20260923 17:14:30.740535 18774 master.cc:537] Master@127.11.229.189:44707 shutting down...
I20260923 17:14:30.740489 18871 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "82445899ad234187be57c8b10c01f25a" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } } peers { permanent_uuid: "8f4f49faad444410bf28c38f8ae42d2d" member_type: NON_VOTER last_known_addr { host: "127.11.229.189" port: 44707 } attrs { promote: true } } }
I20260923 17:14:30.740614 18871 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a [sys.catalog]: This master's current role is: LEADER
WARNING: no policy specified for oryx/127.11.229.188@KRBTEST.COM; defaulting to no policy
I20260923 17:14:30.741132 18816 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [term 1 FOLLOWER]: Refusing update from remote peer 82445899ad234187be57c8b10c01f25a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260923 17:14:30.741954 18871 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4f49faad444410bf28c38f8ae42d2d" member_type: NON_VOTER last_known_addr { host: "127.11.229.189" port: 44707 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260923 17:14:30.744061 18294 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260923 17:14:30.745129 18294 consensus_peers.cc:487] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a -> Peer 8f4f49faad444410bf28c38f8ae42d2d (127.11.229.189:44707): Couldn't send request to peer 8f4f49faad444410bf28c38f8ae42d2d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.229.188@KRBTEST.COM" created.
I20260923 17:14:30.745817 18774 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:14:30.746245 18774 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:14:30.746448 18774 tablet_replica.cc:330] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d: stopping tablet replica
I20260923 17:14:30.762086 18774 master.cc:552] Master@127.11.229.189:44707 shutdown complete.
I20260923 17:14:30.762168 18774 master_runner.cc:305] Clearing existing system tablet
I20260923 17:14:30.762483 18774 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:30.762564 18774 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:30.763794 18774 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260923 17:14:30.765050 18876 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:30.765354 18774 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:30.765492 18774 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260923 17:14:30.765529 18774 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-1/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-1/wal
uuid: "8f4f49faad444410bf28c38f8ae42d2d"
format_stamp: "Formatted at 2026-09-23 17:14:30 on dist-test-slave-1x1f"
server_key: "afd320118ae9c3ab73a2cf64a5bc2e34"
server_key_iv: "a9424c54e5060091182ef847b842b220"
server_key_version: "encryptionkey@0"
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.229.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.188.keytab.
Entry for principal oryx/127.11.229.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.188.keytab.
I20260923 17:14:30.766796 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.188:35815
--webserver_interface=127.11.229.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.188.keytab
--principal=oryx/127.11.229.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:46513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:33923,127.11.229.189:44707,127.11.229.188:35815
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 17:14:30.767897 18774 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:14:30.770761 18774 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260923 17:14:30.770869 18774 log.cc:1196] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260923 17:14:30.771189 18774 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d: Deleting consensus metadata
I20260923 17:14:30.771376 18774 master_runner.cc:315] Copying system tablet from 127.11.229.190:33923
I20260923 17:14:30.772722 18774 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d: tablet copy: Beginning tablet copy session from remote peer at address 127.11.229.190:33923
I20260923 17:14:30.783914 18883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:30.773614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:33923 (local address 127.0.0.1:43396)
0923 17:14:30.773919 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:30.773940 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:30.774096 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:30.774459 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:30.774466 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:30.774765 (+ 299us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:30.774969 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:30.774981 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:30.776160 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:30.776167 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:30.777836 (+ 1669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:30.777849 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:30.778647 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:30.778654 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:30.778785 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:30.779423 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:30.779438 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:30.779939 (+ 501us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:30.782199 (+ 2260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:30.782202 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:30.782212 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:30.782480 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:30.782791 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:30.782794 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:30.782796 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:30.782885 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:30.783333 (+ 448us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:30.783336 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:30.783450 (+ 114us) client_negotiation.cc:769] Sending connection context
0923 17:14:30.783557 (+ 107us) client_negotiation.cc:240] Negotiation successful
0923 17:14:30.783702 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":101,"threads_started":1}
I20260923 17:14:30.783934 18349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:30.773469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43396 (local address 127.11.229.190:33923)
0923 17:14:30.773655 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:30.773663 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:30.774056 (+ 393us) server_negotiation.cc:407] Connection header received
0923 17:14:30.774250 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:30.774255 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:30.774314 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:30.774412 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:30.775118 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:30.776020 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:30.778026 (+ 2006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:30.778503 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:30.778621 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:30.780108 (+ 1487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:30.780113 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:30.780116 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:30.780148 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:30.782080 (+ 1932us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:30.782586 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:30.782590 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:30.782592 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:30.782688 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:30.782979 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:30.782983 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:30.782985 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:30.783230 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:30.783339 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:30.783637 (+ 298us) server_negotiation.cc:299] Negotiation successful
0923 17:14:30.783763 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260923 17:14:30.784901 18330 tablet_copy_service.cc:140] P 82445899ad234187be57c8b10c01f25a: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 8f4f49faad444410bf28c38f8ae42d2d ({username='oryx', principal='oryx/127.11.229.189@KRBTEST.COM'} at 127.0.0.1:43396)
I20260923 17:14:30.785113 18330 tablet_copy_service.cc:161] P 82445899ad234187be57c8b10c01f25a: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 8f4f49faad444410bf28c38f8ae42d2d at {username='oryx', principal='oryx/127.11.229.189@KRBTEST.COM'} at 127.0.0.1:43396: session id = 8f4f49faad444410bf28c38f8ae42d2d-00000000000000000000000000000000
I20260923 17:14:30.787135 18330 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a: Tablet Copy: opened 0 blocks and 1 log segments
I20260923 17:14:30.788941 18774 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260923 17:14:30.791531 18774 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d: tablet copy: Starting download of 0 data blocks...
I20260923 17:14:30.791738 18774 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d: tablet copy: Starting download of 1 WAL segments...
I20260923 17:14:30.793496 18774 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260923 17:14:30.795614 18330 tablet_copy_service.cc:342] P 82445899ad234187be57c8b10c01f25a: Request end of tablet copy session 8f4f49faad444410bf28c38f8ae42d2d-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.11.229.189@KRBTEST.COM'} at 127.0.0.1:43396
I20260923 17:14:30.795744 18330 tablet_copy_service.cc:433] P 82445899ad234187be57c8b10c01f25a: ending tablet copy session 8f4f49faad444410bf28c38f8ae42d2d-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 8f4f49faad444410bf28c38f8ae42d2d
I20260923 17:14:30.803365 18774 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:30.805198 18884 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:30.805320 18887 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:30.805560 18885 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:30.805750 18774 server_base.cc:1034] running on GCE node
I20260923 17:14:30.805984 18774 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:30.806339 18774 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:30.807492 18774 hybrid_clock.cc:648] HybridClock initialized: now 1790183670807480 us; error 29 us; skew 500 ppm
Sep 23 17:14:30 dist-test-slave-1x1f krb5kdc[18265](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183670, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.229.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:30.809356 18774 init.cc:377] Logged in from keytab as oryx/127.11.229.189@KRBTEST.COM (short username oryx)
I20260923 17:14:30.809859 18774 webserver.cc:460] Webserver started at http://127.11.229.189:46883/ using document root <none> and password file <none>
I20260923 17:14:30.810067 18774 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:30.810104 18774 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:30.811565 18774 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260923 17:14:30.812652 18894 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:30.812927 18774 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260923 17:14:30.813052 18774 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-1/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-1/wal
uuid: "8f4f49faad444410bf28c38f8ae42d2d"
format_stamp: "Formatted at 2026-09-23 17:14:30 on dist-test-slave-1x1f"
server_key: "afd320118ae9c3ab73a2cf64a5bc2e34"
server_key_iv: "a9424c54e5060091182ef847b842b220"
server_key_version: "encryptionkey@0"
I20260923 17:14:30.813205 18774 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:30.834355 18774 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:30.836790 18774 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:30.841970 18774 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.189:44707
I20260923 17:14:30.842145 18946 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.189:44707 every 8 connection(s)
I20260923 17:14:30.842849 18774 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-1/data/info.pb
I20260923 17:14:30.844820 18947 sys_catalog.cc:263] Verifying existing consensus state
I20260923 17:14:30.845907 18947 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d: Bootstrap starting.
I20260923 17:14:30.858137 18947 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260923 17:14:30.858537 18947 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d: Bootstrap complete.
I20260923 17:14:30.859119 18947 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } } peers { permanent_uuid: "8f4f49faad444410bf28c38f8ae42d2d" member_type: NON_VOTER last_known_addr { host: "127.11.229.189" port: 44707 } attrs { promote: true } }
I20260923 17:14:30.859273 18947 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 8f4f49faad444410bf28c38f8ae42d2d, State: Initialized, Role: LEARNER
I20260923 17:14:30.859400 18947 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } } peers { permanent_uuid: "8f4f49faad444410bf28c38f8ae42d2d" member_type: NON_VOTER last_known_addr { host: "127.11.229.189" port: 44707 } attrs { promote: true } }
I20260923 17:14:30.859800 18950 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } } peers { permanent_uuid: "8f4f49faad444410bf28c38f8ae42d2d" member_type: NON_VOTER last_known_addr { host: "127.11.229.189" port: 44707 } attrs { promote: true } } }
I20260923 17:14:30.859968 18950 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [sys.catalog]: This master's current role is: LEARNER
I20260923 17:14:30.859977 18947 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:14:30.863168 18961 catalog_manager.cc:1259] Loaded cluster ID: 2af4a61483ae46e0bded270bd7f86176
I20260923 17:14:30.863286 18961 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d: loading cluster ID for follower catalog manager: success
I20260923 17:14:30.865325 18961 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d: acquiring CA information for follower catalog manager: success
I20260923 17:14:30.866588 18961 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260923 17:14:30.910581 18877 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:30.911001 18877 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:30.911069 18877 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:30.917662 18877 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:14:30.917755 18877 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:30.917783 18877 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:30.917807 18877 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:14:30.917829 18877 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:14:30.925889 18877 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:46513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:33923,127.11.229.189:44707,127.11.229.188:35815
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.188.keytab
--principal=oryx/127.11.229.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.188:35815
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.229.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18877
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:30.927359 18877 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:30.928580 18877 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:30.937690 18969 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:30.937734 18967 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:30.937726 18966 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:30.937937 18877 server_base.cc:1034] running on GCE node
I20260923 17:14:30.938673 18877 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:30.939790 18877 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:30.940981 18877 hybrid_clock.cc:648] HybridClock initialized: now 1790183670940971 us; error 24 us; skew 500 ppm
Sep 23 17:14:30 dist-test-slave-1x1f krb5kdc[18265](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183670, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.229.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:30.943832 18877 init.cc:377] Logged in from keytab as oryx/127.11.229.188@KRBTEST.COM (short username oryx)
I20260923 17:14:30.945080 18877 webserver.cc:460] Webserver started at http://127.11.229.188:45401/ using document root <none> and password file <none>
I20260923 17:14:30.945901 18877 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:30.946013 18877 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:30.946323 18877 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:30.948503 18877 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-2/data/instance:
uuid: "e5713f3a43744bcf8c11a6b6f531f8e2"
format_stamp: "Formatted at 2026-09-23 17:14:30 on dist-test-slave-1x1f"
server_key: "f98f7556932f1e007c35dabc48c417cf"
server_key_iv: "f67d384ed041ea961dcc64fc8b6968ea"
server_key_version: "encryptionkey@0"
I20260923 17:14:30.949122 18877 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-2/wal/instance:
uuid: "e5713f3a43744bcf8c11a6b6f531f8e2"
format_stamp: "Formatted at 2026-09-23 17:14:30 on dist-test-slave-1x1f"
server_key: "f98f7556932f1e007c35dabc48c417cf"
server_key_iv: "f67d384ed041ea961dcc64fc8b6968ea"
server_key_version: "encryptionkey@0"
I20260923 17:14:30.953117 18877 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260923 17:14:30.955819 18976 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:30.957252 18877 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260923 17:14:30.957388 18877 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-2/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-2/wal
uuid: "e5713f3a43744bcf8c11a6b6f531f8e2"
format_stamp: "Formatted at 2026-09-23 17:14:30 on dist-test-slave-1x1f"
server_key: "f98f7556932f1e007c35dabc48c417cf"
server_key_iv: "f67d384ed041ea961dcc64fc8b6968ea"
server_key_version: "encryptionkey@0"
I20260923 17:14:30.957499 18877 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:30.982622 18877 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:30.985730 18877 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:30.985944 18877 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:30.986577 18501 heartbeater.cc:503] Master 127.11.229.190:33923 was elected leader, sending a full tablet report...
I20260923 17:14:30.993459 18877 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.188:35815
I20260923 17:14:30.993760 19028 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.188:35815 every 8 connection(s)
I20260923 17:14:30.994755 18877 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-2/data/info.pb
I20260923 17:14:30.997965 19029 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:31.002127 19029 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } has no permanent_uuid. Determining permanent_uuid...
I20260923 17:14:31.004782 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 18877
Sep 23 17:14:31 dist-test-slave-1x1f krb5kdc[18265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183670, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.229.188@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM
Sep 23 17:14:31 dist-test-slave-1x1f krb5kdc[18265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183669, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.229.188@KRBTEST.COM
I20260923 17:14:31.016882 18349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.004810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43404 (local address 127.11.229.190:33923)
0923 17:14:31.004985 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:31.004991 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:31.005616 (+ 625us) server_negotiation.cc:407] Connection header received
0923 17:14:31.006829 (+ 1213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:31.006832 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:31.006891 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:31.006998 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:31.007841 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.008375 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.009406 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.009640 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.009751 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.012864 (+ 3113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:31.012868 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:31.012871 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:31.012907 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:31.014587 (+ 1680us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:31.015287 (+ 700us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:31.015291 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:31.015293 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:31.015380 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:31.015779 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:31.015784 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:31.015786 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:31.015994 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:31.016113 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:31.016573 (+ 460us) server_negotiation.cc:299] Negotiation successful
0923 17:14:31.016704 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260923 17:14:31.017885 19031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.004808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:33923 (local address 127.0.0.1:43404)
0923 17:14:31.005447 (+ 639us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:31.005490 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:31.006613 (+ 1123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:31.007059 (+ 446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:31.007066 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:31.007419 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:31.007704 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:31.007717 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.008518 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.008526 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:31.009271 (+ 745us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:31.009280 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.009791 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.009795 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:31.010020 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.010695 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:31.010717 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:31.012647 (+ 1930us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:31.014760 (+ 2113us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:31.014768 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:31.014777 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:31.015091 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:31.015499 (+ 408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:31.015510 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:31.015512 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:31.015649 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:31.016118 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:31.016128 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:31.016341 (+ 213us) client_negotiation.cc:769] Sending connection context
0923 17:14:31.016532 (+ 191us) client_negotiation.cc:240] Negotiation successful
0923 17:14:31.016899 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":404,"mutex_wait_us":26,"spinlock_wait_cycles":896,"thread_start_us":198,"threads_started":1}
I20260923 17:14:31.017890 19032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.005750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54854 (local address 127.11.229.188:35815)
0923 17:14:31.006124 (+ 374us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:31.006134 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:31.006167 (+ 33us) server_negotiation.cc:407] Connection header received
0923 17:14:31.006627 (+ 460us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:31.006648 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:31.006837 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:31.007101 (+ 264us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:31.007874 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.008766 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.009724 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.010180 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.010348 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.013164 (+ 2816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:31.013174 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:31.013190 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:31.013218 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:31.015132 (+ 1914us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:31.015574 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:31.015580 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:31.015582 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:31.015664 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:31.015947 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:31.015952 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:31.015953 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:31.016320 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:31.016526 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:31.016758 (+ 232us) server_negotiation.cc:299] Negotiation successful
0923 17:14:31.017100 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":53,"server-negotiator.queue_time_us":254,"thread_start_us":132,"threads_started":1}
I20260923 17:14:31.019405 19029 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.229.189" port: 44707 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 17:14:31 dist-test-slave-1x1f krb5kdc[18265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183670, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.229.188@KRBTEST.COM for oryx/127.11.229.189@KRBTEST.COM
I20260923 17:14:31.028786 19033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.020060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34336 (local address 127.11.229.189:44707)
0923 17:14:31.020357 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:31.020371 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:31.020446 (+ 75us) server_negotiation.cc:407] Connection header received
0923 17:14:31.020617 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:31.020621 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:31.020679 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:31.020788 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:31.021223 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.022082 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.022999 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.023262 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.023382 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.025335 (+ 1953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:31.025338 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:31.025340 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:31.025364 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:31.026825 (+ 1461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:31.027257 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:31.027261 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:31.027263 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:31.027377 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:31.027700 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:31.027703 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:31.027704 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:31.027900 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:31.027978 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:31.028515 (+ 537us) server_negotiation.cc:299] Negotiation successful
0923 17:14:31.028625 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":212,"thread_start_us":122,"threads_started":1}
I20260923 17:14:31.028846 19031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.019947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.189:44707 (local address 127.0.0.1:34336)
0923 17:14:31.020381 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:31.020398 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:31.020490 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:31.020800 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:31.020804 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:31.020992 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:31.021092 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:31.021098 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.022193 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.022200 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:31.022860 (+ 660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:31.022868 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.023380 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.023384 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:31.023492 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.023949 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:31.023961 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:31.025196 (+ 1235us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:31.026926 (+ 1730us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:31.026929 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:31.026930 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:31.027133 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:31.027505 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:31.027507 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:31.027509 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:31.027610 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:31.028114 (+ 504us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:31.028119 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:31.028301 (+ 182us) client_negotiation.cc:769] Sending connection context
0923 17:14:31.028455 (+ 154us) client_negotiation.cc:240] Negotiation successful
0923 17:14:31.028711 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325}
I20260923 17:14:31.029810 19029 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.229.188" port: 35815 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 17:14:31 dist-test-slave-1x1f krb5kdc[18265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183670, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.229.188@KRBTEST.COM for oryx/127.11.229.188@KRBTEST.COM
I20260923 17:14:31.039758 19032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.030867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54862 (local address 127.11.229.188:35815)
0923 17:14:31.031008 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:31.031012 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:31.031028 (+ 16us) server_negotiation.cc:407] Connection header received
0923 17:14:31.031140 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:31.031144 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:31.031190 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:31.031285 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:31.031744 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.032344 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.033169 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.033406 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.033500 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.036503 (+ 3003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:31.036506 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:31.036509 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:31.036539 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:31.038067 (+ 1528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:31.038543 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:31.038547 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:31.038549 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:31.038620 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:31.038885 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:31.038891 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:31.038892 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:31.039072 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:31.039173 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:31.039422 (+ 249us) server_negotiation.cc:299] Negotiation successful
0923 17:14:31.039592 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":65,"server-negotiator.queue_time_us":58}
I20260923 17:14:31.039758 19031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.030730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:35815 (local address 127.0.0.1:54862)
0923 17:14:31.030929 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:31.030949 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:31.031035 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:31.031349 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:31.031352 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:31.031503 (+ 151us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:31.031628 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:31.031634 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.032482 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.032485 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:31.033047 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:31.033056 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.033590 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.033594 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:31.033695 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.034402 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:31.034415 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:31.036326 (+ 1911us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:31.038193 (+ 1867us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:31.038198 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:31.038201 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:31.038438 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:31.038713 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:31.038718 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:31.038720 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:31.038798 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:31.039171 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:31.039173 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:31.039260 (+ 87us) client_negotiation.cc:769] Sending connection context
0923 17:14:31.039371 (+ 111us) client_negotiation.cc:240] Negotiation successful
0923 17:14:31.039527 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":88}
I20260923 17:14:31.043467 19029 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2: Bootstrap starting.
I20260923 17:14:31.045917 19029 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:31.046799 19029 log.cc:824] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2: Log is configured to *not* fsync() on all Append() calls
I20260923 17:14:31.048928 19029 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2: No bootstrap required, opened a new log
I20260923 17:14:31.052280 19029 raft_consensus.cc:348] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } } peers { permanent_uuid: "8f4f49faad444410bf28c38f8ae42d2d" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 44707 } } peers { permanent_uuid: "e5713f3a43744bcf8c11a6b6f531f8e2" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 35815 } }
I20260923 17:14:31.052510 19029 raft_consensus.cc:374] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:31.052577 19029 raft_consensus.cc:729] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5713f3a43744bcf8c11a6b6f531f8e2, State: Initialized, Role: FOLLOWER
I20260923 17:14:31.053061 19029 consensus_queue.cc:260] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } } peers { permanent_uuid: "8f4f49faad444410bf28c38f8ae42d2d" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 44707 } } peers { permanent_uuid: "e5713f3a43744bcf8c11a6b6f531f8e2" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 35815 } }
I20260923 17:14:31.053617 19035 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } } peers { permanent_uuid: "8f4f49faad444410bf28c38f8ae42d2d" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 44707 } } peers { permanent_uuid: "e5713f3a43744bcf8c11a6b6f531f8e2" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 35815 } } }
I20260923 17:14:31.053738 19035 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 17:14:31.054500 19029 sys_catalog.cc:564] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2 [sys.catalog]: configured and running, proceeding with master startup.
W20260923 17:14:31.059937 19046 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 17:14:31.060087 19046 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 17:14:31.064571 18877 master_runner.cc:428] Detected that this master e5713f3a43744bcf8c11a6b6f531f8e2 is joining an existing cluster
I20260923 17:14:31.064674 18877 master_runner.cc:432] Initiating AddMaster RPC to add 127.11.229.188:35815
I20260923 17:14:31.071439 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 18372
I20260923 17:14:31.078054 18349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.067904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43416 (local address 127.11.229.190:33923)
0923 17:14:31.068011 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:31.068016 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:31.068033 (+ 17us) server_negotiation.cc:407] Connection header received
0923 17:14:31.068076 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:31.068079 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:31.068131 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:31.068224 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:31.068863 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.069792 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.071220 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.071584 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.071688 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.073443 (+ 1755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:31.073451 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:31.073458 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:31.073494 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:31.075520 (+ 2026us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:31.076122 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:31.076129 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:31.076134 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:31.076229 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:31.076694 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:31.076701 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:31.076706 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:31.076982 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:31.077065 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:31.077610 (+ 545us) server_negotiation.cc:299] Negotiation successful
0923 17:14:31.077771 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260923 17:14:31.078825 19053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.067085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:33923 (local address 127.0.0.1:43416)
0923 17:14:31.067525 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:31.067540 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:31.067631 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:31.068338 (+ 707us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:31.068343 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:31.068596 (+ 253us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:31.068727 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:31.068735 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.069922 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.069925 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:31.071065 (+ 1140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:31.071073 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.071888 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.071895 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:31.072039 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.072618 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:31.072641 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:31.073272 (+ 631us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:31.075663 (+ 2391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:31.075670 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:31.075676 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:31.075969 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:31.076419 (+ 450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:31.076425 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:31.076431 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:31.076577 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:31.077162 (+ 585us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:31.077168 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:31.077292 (+ 124us) client_negotiation.cc:769] Sending connection context
0923 17:14:31.078333 (+ 1041us) client_negotiation.cc:240] Negotiation successful
0923 17:14:31.078512 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":353,"mutex_wait_us":1,"thread_start_us":116,"threads_started":1}
I20260923 17:14:31.081530 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.129:38289
--local_ip_for_outbound_sockets=127.11.229.129
--tserver_master_addrs=127.11.229.190:33923
--webserver_port=46323
--webserver_interface=127.11.229.129
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.129.keytab
--principal=oryx/127.11.229.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:46513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.11.229.190:33923,127.11.229.189:44707
--tserver_master_addrs=127.11.229.190:33923,127.11.229.189:44707,127.11.229.188:35815 with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 17:14:31.087517 19052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.067552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:35815 (local address 127.0.0.1:54872)
0923 17:14:31.068342 (+ 790us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:31.068356 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:31.068488 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:31.068739 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:31.068742 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:31.068994 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:31.069104 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:31.069112 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.070148 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.070151 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:31.077081 (+ 6930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:31.077092 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.077842 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.077845 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:31.077944 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.078456 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:31.078470 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:31.078899 (+ 429us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:31.081002 (+ 2103us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:31.081008 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:31.081014 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:31.081275 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:31.081575 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:31.081577 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:31.081580 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:31.086566 (+ 4986us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:31.087017 (+ 451us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:31.087020 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:31.087095 (+ 75us) client_negotiation.cc:769] Sending connection context
0923 17:14:31.087187 (+ 92us) client_negotiation.cc:240] Negotiation successful
0923 17:14:31.087324 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":347,"thread_start_us":90,"threads_started":1}
I20260923 17:14:31.088918 19032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.067583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54872 (local address 127.11.229.188:35815)
0923 17:14:31.067691 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:31.067696 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:31.068441 (+ 745us) server_negotiation.cc:407] Connection header received
0923 17:14:31.068577 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:31.068580 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:31.068624 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:31.068713 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:31.069229 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.070044 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.077223 (+ 7179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.077554 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.077645 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.079058 (+ 1413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:31.079064 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:31.079071 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:31.079114 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:31.080883 (+ 1769us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:31.081385 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:31.081388 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:31.081390 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:31.081468 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:31.086674 (+ 5206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:31.086677 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:31.086679 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:31.086882 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:31.086969 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:31.088663 (+ 1694us) server_negotiation.cc:299] Negotiation successful
0923 17:14:31.088773 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":44}
Sep 23 17:14:31 dist-test-slave-1x1f krb5kdc[18265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183669, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.229.190@KRBTEST.COM for oryx/127.11.229.188@KRBTEST.COM
I20260923 17:14:31.092943 19054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.067152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.189:44707 (local address 127.0.0.1:34350)
0923 17:14:31.067840 (+ 688us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:31.067852 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:31.067975 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:31.068923 (+ 948us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:31.068926 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:31.069126 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:31.069359 (+ 233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:31.069366 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.070497 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.070501 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:31.071385 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:31.071395 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.072011 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.072014 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:31.072096 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.087701 (+ 15605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:31.087715 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:31.088122 (+ 407us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:31.090463 (+ 2341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:31.090467 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:31.090469 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:31.090700 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:31.091106 (+ 406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:31.091112 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:31.091114 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:31.091227 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:31.092190 (+ 963us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:31.092196 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:31.092319 (+ 123us) client_negotiation.cc:769] Sending connection context
0923 17:14:31.092460 (+ 141us) client_negotiation.cc:240] Negotiation successful
0923 17:14:31.092648 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":630,"mutex_wait_us":25,"thread_start_us":109,"threads_started":1}
I20260923 17:14:31.094195 19033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.067307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34350 (local address 127.11.229.189:44707)
0923 17:14:31.067457 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:31.067465 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:31.067915 (+ 450us) server_negotiation.cc:407] Connection header received
0923 17:14:31.068074 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:31.068077 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:31.068132 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:31.068224 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:31.069502 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.070356 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.071522 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.071799 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.071861 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.088313 (+ 16452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:31.088318 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:31.088321 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:31.088350 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:31.090336 (+ 1986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:31.090818 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:31.090826 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:31.090831 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:31.090945 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:31.091362 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:31.091370 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:31.091374 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:31.091994 (+ 620us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:31.092129 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:31.093424 (+ 1295us) server_negotiation.cc:299] Negotiation successful
0923 17:14:31.093599 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260923 17:14:31.097442 18867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.083560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:35815 (local address 127.0.0.1:54886)
0923 17:14:31.083687 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:31.083703 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:31.083784 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:31.084156 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:31.084159 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:31.084362 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:31.084450 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:31.084455 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.085723 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.085731 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:31.087248 (+ 1517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:31.087264 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.091156 (+ 3892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.091161 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:31.091281 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.091793 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:31.091808 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:31.093306 (+ 1498us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:31.095496 (+ 2190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:31.095500 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:31.095502 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:31.095743 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:31.096066 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:31.096072 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:31.096076 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:31.096295 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:31.096833 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:31.096838 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:31.096972 (+ 134us) client_negotiation.cc:769] Sending connection context
0923 17:14:31.097104 (+ 132us) client_negotiation.cc:240] Negotiation successful
0923 17:14:31.097270 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260923 17:14:31.097450 19056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.083613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54886 (local address 127.11.229.188:35815)
0923 17:14:31.083896 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:31.083903 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:31.083915 (+ 12us) server_negotiation.cc:407] Connection header received
0923 17:14:31.083972 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:31.083974 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:31.084016 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:31.084139 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:31.084572 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.085578 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.089437 (+ 3859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.091019 (+ 1582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.091497 (+ 478us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.093459 (+ 1962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:31.093462 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:31.093465 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:31.093487 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:31.095368 (+ 1881us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:31.095862 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:31.095864 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:31.095866 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:31.095943 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:31.096501 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:31.096505 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:31.096507 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:31.096713 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:31.096812 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:31.097159 (+ 347us) server_negotiation.cc:299] Negotiation successful
0923 17:14:31.097283 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":218,"thread_start_us":106,"threads_started":1}
I20260923 17:14:31.098495 18306 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.11.229.188:35815: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "e5713f3a43744bcf8c11a6b6f531f8e2"
member_type: NON_VOTER
last_known_addr {
host: "127.11.229.188"
port: 35815
}
attrs {
promote: true
}
}
dest_uuid: "82445899ad234187be57c8b10c01f25a"
cas_config_opid_index: 5
I20260923 17:14:31.099175 18306 consensus_queue.cc:237] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } } peers { permanent_uuid: "8f4f49faad444410bf28c38f8ae42d2d" member_type: NON_VOTER last_known_addr { host: "127.11.229.189" port: 44707 } attrs { promote: true } } peers { permanent_uuid: "e5713f3a43744bcf8c11a6b6f531f8e2" member_type: NON_VOTER last_known_addr { host: "127.11.229.188" port: 35815 } attrs { promote: true } }
I20260923 17:14:31.100251 18871 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER e5713f3a43744bcf8c11a6b6f531f8e2 (127.11.229.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } } peers { permanent_uuid: "8f4f49faad444410bf28c38f8ae42d2d" member_type: NON_VOTER last_known_addr { host: "127.11.229.189" port: 44707 } attrs { promote: true } } peers { permanent_uuid: "e5713f3a43744bcf8c11a6b6f531f8e2" member_type: NON_VOTER last_known_addr { host: "127.11.229.188" port: 35815 } attrs { promote: true } } }
I20260923 17:14:31.100817 19003 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:31.101927 18871 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.11.229.188:35815
I20260923 17:14:31.102208 19003 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2 [term 1 FOLLOWER]: Refusing update from remote peer 82445899ad234187be57c8b10c01f25a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260923 17:14:31.102391 18877 master.cc:537] Master@127.11.229.188:35815 shutting down...
I20260923 17:14:31.102456 18871 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "82445899ad234187be57c8b10c01f25a" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } } peers { permanent_uuid: "8f4f49faad444410bf28c38f8ae42d2d" member_type: NON_VOTER last_known_addr { host: "127.11.229.189" port: 44707 } attrs { promote: true } } peers { permanent_uuid: "e5713f3a43744bcf8c11a6b6f531f8e2" member_type: NON_VOTER last_known_addr { host: "127.11.229.188" port: 35815 } attrs { promote: true } } }
I20260923 17:14:31.102550 18871 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a [sys.catalog]: This master's current role is: LEADER
I20260923 17:14:31.103001 18870 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5713f3a43744bcf8c11a6b6f531f8e2" member_type: NON_VOTER last_known_addr { host: "127.11.229.188" port: 35815 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260923 17:14:31.104609 18295 consensus_peers.cc:487] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a -> Peer e5713f3a43744bcf8c11a6b6f531f8e2 (127.11.229.188:35815): Couldn't send request to peer e5713f3a43744bcf8c11a6b6f531f8e2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260923 17:14:31.108027 18877 raft_consensus.cc:2229] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:14:31.108335 18877 raft_consensus.cc:2258] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:14:31.108441 18877 tablet_replica.cc:330] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2: stopping tablet replica
I20260923 17:14:31.109839 18867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.102886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.189:44707 (local address 127.0.0.1:34358)
0923 17:14:31.102991 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:31.103009 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:31.103110 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:31.103979 (+ 869us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:31.103982 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:31.104000 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:14:31.104126 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:31.104133 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.105409 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.105415 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:31.107884 (+ 2469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:31.107897 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.109341 (+ 1444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.109345 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:31.109449 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.109492 (+ 43us) client_negotiation.cc:769] Sending connection context
0923 17:14:31.109572 (+ 80us) client_negotiation.cc:240] Negotiation successful
0923 17:14:31.109659 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260923 17:14:31.110608 19033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.103468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34358 (local address 127.11.229.189:44707)
0923 17:14:31.103607 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:31.103615 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:31.103633 (+ 18us) server_negotiation.cc:407] Connection header received
0923 17:14:31.103687 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:31.103690 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:31.103752 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:31.103848 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:14:31.104270 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.105178 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.108042 (+ 2864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.108988 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.109132 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.109272 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:31.110137 (+ 865us) server_negotiation.cc:299] Negotiation successful
0923 17:14:31.110481 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260923 17:14:31.111392 18921 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [term 1 LEARNER]: Refusing update from remote peer 82445899ad234187be57c8b10c01f25a: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260923 17:14:31.111857 19058 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4f49faad444410bf28c38f8ae42d2d" member_type: NON_VOTER last_known_addr { host: "127.11.229.189" port: 44707 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260923 17:14:31.114022 18921 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER e5713f3a43744bcf8c11a6b6f531f8e2 (127.11.229.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } } peers { permanent_uuid: "8f4f49faad444410bf28c38f8ae42d2d" member_type: NON_VOTER last_known_addr { host: "127.11.229.189" port: 44707 } attrs { promote: true } } peers { permanent_uuid: "e5713f3a43744bcf8c11a6b6f531f8e2" member_type: NON_VOTER last_known_addr { host: "127.11.229.188" port: 35815 } attrs { promote: true } } }
I20260923 17:14:31.117118 18950 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 82445899ad234187be57c8b10c01f25a. Latest consensus state: current_term: 1 leader_uuid: "82445899ad234187be57c8b10c01f25a" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } } peers { permanent_uuid: "8f4f49faad444410bf28c38f8ae42d2d" member_type: NON_VOTER last_known_addr { host: "127.11.229.189" port: 44707 } attrs { promote: true } } peers { permanent_uuid: "e5713f3a43744bcf8c11a6b6f531f8e2" member_type: NON_VOTER last_known_addr { host: "127.11.229.188" port: 35815 } attrs { promote: true } } }
I20260923 17:14:31.117242 18950 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [sys.catalog]: This master's current role is: LEARNER
I20260923 17:14:31.117341 18950 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "82445899ad234187be57c8b10c01f25a" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } } peers { permanent_uuid: "8f4f49faad444410bf28c38f8ae42d2d" member_type: NON_VOTER last_known_addr { host: "127.11.229.189" port: 44707 } attrs { promote: true } } peers { permanent_uuid: "e5713f3a43744bcf8c11a6b6f531f8e2" member_type: NON_VOTER last_known_addr { host: "127.11.229.188" port: 35815 } attrs { promote: true } } }
I20260923 17:14:31.117414 18950 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [sys.catalog]: This master's current role is: LEARNER
I20260923 17:14:31.117950 19057 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a: attempting to promote NON_VOTER 8f4f49faad444410bf28c38f8ae42d2d to VOTER
I20260923 17:14:31.118516 19057 consensus_queue.cc:237] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } } peers { permanent_uuid: "8f4f49faad444410bf28c38f8ae42d2d" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 44707 } attrs { promote: false } } peers { permanent_uuid: "e5713f3a43744bcf8c11a6b6f531f8e2" member_type: NON_VOTER last_known_addr { host: "127.11.229.188" port: 35815 } attrs { promote: true } }
I20260923 17:14:31.120190 18867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.119727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:35815 (local address 127.0.0.1:54898)
0923 17:14:31.120006 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:31.120076 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.188:35815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198}
I20260923 17:14:31.121052 18867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.120656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:35815 (local address 127.0.0.1:54904)
0923 17:14:31.120932 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:31.120984 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.188:35815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":103,"threads_started":1}
W20260923 17:14:31.121165 18295 consensus_peers.cc:487] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a -> Peer e5713f3a43744bcf8c11a6b6f531f8e2 (127.11.229.188:35815): Couldn't send request to peer e5713f3a43744bcf8c11a6b6f531f8e2. Status: Network error: Client connection negotiation failed: client connection to 127.11.229.188:35815: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260923 17:14:31.122056 18877 master.cc:552] Master@127.11.229.188:35815 shutdown complete.
I20260923 17:14:31.122102 18877 master_runner.cc:305] Clearing existing system tablet
I20260923 17:14:31.122390 18877 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:31.122437 18877 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:31.122910 18921 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [term 1 LEARNER]: Refusing update from remote peer 82445899ad234187be57c8b10c01f25a: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260923 17:14:31.123453 19058 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4f49faad444410bf28c38f8ae42d2d" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 44707 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260923 17:14:31.123656 18877 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260923 17:14:31.124444 19063 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:31.124612 18877 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:31.124715 18877 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260923 17:14:31.124747 18877 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-2/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-2/wal
uuid: "e5713f3a43744bcf8c11a6b6f531f8e2"
format_stamp: "Formatted at 2026-09-23 17:14:30 on dist-test-slave-1x1f"
server_key: "f98f7556932f1e007c35dabc48c417cf"
server_key_iv: "f67d384ed041ea961dcc64fc8b6968ea"
server_key_version: "encryptionkey@0"
I20260923 17:14:31.125581 18870 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 8f4f49faad444410bf28c38f8ae42d2d (127.11.229.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } } peers { permanent_uuid: "8f4f49faad444410bf28c38f8ae42d2d" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 44707 } attrs { promote: false } } peers { permanent_uuid: "e5713f3a43744bcf8c11a6b6f531f8e2" member_type: NON_VOTER last_known_addr { host: "127.11.229.188" port: 35815 } attrs { promote: true } } }
I20260923 17:14:31.126825 18877 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:14:31.127287 19057 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "82445899ad234187be57c8b10c01f25a" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } } peers { permanent_uuid: "8f4f49faad444410bf28c38f8ae42d2d" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 44707 } attrs { promote: false } } peers { permanent_uuid: "e5713f3a43744bcf8c11a6b6f531f8e2" member_type: NON_VOTER last_known_addr { host: "127.11.229.188" port: 35815 } attrs { promote: true } } }
I20260923 17:14:31.127398 19057 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a [sys.catalog]: This master's current role is: LEADER
I20260923 17:14:31.128019 18871 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "82445899ad234187be57c8b10c01f25a" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } } peers { permanent_uuid: "8f4f49faad444410bf28c38f8ae42d2d" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 44707 } attrs { promote: false } } peers { permanent_uuid: "e5713f3a43744bcf8c11a6b6f531f8e2" member_type: NON_VOTER last_known_addr { host: "127.11.229.188" port: 35815 } attrs { promote: true } } }
I20260923 17:14:31.128222 18871 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a [sys.catalog]: This master's current role is: LEADER
I20260923 17:14:31.128165 18920 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 8f4f49faad444410bf28c38f8ae42d2d (127.11.229.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } } peers { permanent_uuid: "8f4f49faad444410bf28c38f8ae42d2d" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 44707 } attrs { promote: false } } peers { permanent_uuid: "e5713f3a43744bcf8c11a6b6f531f8e2" member_type: NON_VOTER last_known_addr { host: "127.11.229.188" port: 35815 } attrs { promote: true } } }
I20260923 17:14:31.129302 18877 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260923 17:14:31.129396 18877 log.cc:1196] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260923 17:14:31.129664 18877 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2: Deleting consensus metadata
I20260923 17:14:31.129850 18877 master_runner.cc:315] Copying system tablet from 127.11.229.190:33923
I20260923 17:14:31.130283 19060 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "82445899ad234187be57c8b10c01f25a" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } } peers { permanent_uuid: "8f4f49faad444410bf28c38f8ae42d2d" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 44707 } attrs { promote: false } } peers { permanent_uuid: "e5713f3a43744bcf8c11a6b6f531f8e2" member_type: NON_VOTER last_known_addr { host: "127.11.229.188" port: 35815 } attrs { promote: true } } }
I20260923 17:14:31.130420 19060 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [sys.catalog]: This master's current role is: FOLLOWER
I20260923 17:14:31.131456 18877 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2: tablet copy: Beginning tablet copy session from remote peer at address 127.11.229.190:33923
I20260923 17:14:31.139532 18349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.132037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43428 (local address 127.11.229.190:33923)
0923 17:14:31.132154 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:31.132159 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:31.132383 (+ 224us) server_negotiation.cc:407] Connection header received
0923 17:14:31.132525 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:31.132528 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:31.132576 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:31.132669 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:31.133088 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.133613 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.134536 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.134780 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.134892 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.136251 (+ 1359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:31.136257 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:31.136262 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:31.136288 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:31.137804 (+ 1516us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:31.138272 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:31.138278 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:31.138284 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:31.138375 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:31.138663 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:31.138666 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:31.138668 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:31.138871 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:31.138976 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:31.139248 (+ 272us) server_negotiation.cc:299] Negotiation successful
0923 17:14:31.139354 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260923 17:14:31.139551 19069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.131997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:33923 (local address 127.0.0.1:43428)
0923 17:14:31.132291 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:31.132302 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:31.132432 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:31.132685 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:31.132688 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:31.132895 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:31.132974 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:31.132979 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.133730 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.133736 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:31.134421 (+ 685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:31.134429 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.134898 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.134901 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:31.134998 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.135680 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:31.135699 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:31.136052 (+ 353us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:31.137926 (+ 1874us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:31.137930 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:31.137933 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:31.138134 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:31.138470 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:31.138474 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:31.138476 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:31.138563 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:31.138976 (+ 413us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:31.138979 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:31.139079 (+ 100us) client_negotiation.cc:769] Sending connection context
0923 17:14:31.139196 (+ 117us) client_negotiation.cc:240] Negotiation successful
0923 17:14:31.139354 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":86,"threads_started":1}
I20260923 17:14:31.140309 18330 tablet_copy_service.cc:140] P 82445899ad234187be57c8b10c01f25a: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer e5713f3a43744bcf8c11a6b6f531f8e2 ({username='oryx', principal='oryx/127.11.229.188@KRBTEST.COM'} at 127.0.0.1:43428)
I20260923 17:14:31.140415 18330 tablet_copy_service.cc:161] P 82445899ad234187be57c8b10c01f25a: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer e5713f3a43744bcf8c11a6b6f531f8e2 at {username='oryx', principal='oryx/127.11.229.188@KRBTEST.COM'} at 127.0.0.1:43428: session id = e5713f3a43744bcf8c11a6b6f531f8e2-00000000000000000000000000000000
I20260923 17:14:31.141296 18330 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a: Tablet Copy: opened 0 blocks and 1 log segments
I20260923 17:14:31.142582 18877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260923 17:14:31.145541 18877 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2: tablet copy: Starting download of 0 data blocks...
I20260923 17:14:31.145742 18877 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2: tablet copy: Starting download of 1 WAL segments...
I20260923 17:14:31.147500 18877 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260923 17:14:31.150784 18330 tablet_copy_service.cc:342] P 82445899ad234187be57c8b10c01f25a: Request end of tablet copy session e5713f3a43744bcf8c11a6b6f531f8e2-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.11.229.188@KRBTEST.COM'} at 127.0.0.1:43428
I20260923 17:14:31.151021 18330 tablet_copy_service.cc:433] P 82445899ad234187be57c8b10c01f25a: ending tablet copy session e5713f3a43744bcf8c11a6b6f531f8e2-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer e5713f3a43744bcf8c11a6b6f531f8e2
I20260923 17:14:31.159996 18877 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:31.161959 19070 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:31.163223 19071 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:31.163401 19073 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:31.163605 18877 server_base.cc:1034] running on GCE node
I20260923 17:14:31.163863 18877 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:31.164184 18877 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:31.167446 18877 hybrid_clock.cc:648] HybridClock initialized: now 1790183671167433 us; error 38 us; skew 500 ppm
Sep 23 17:14:31 dist-test-slave-1x1f krb5kdc[18265](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183671, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.229.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:31.169209 18877 init.cc:377] Logged in from keytab as oryx/127.11.229.188@KRBTEST.COM (short username oryx)
I20260923 17:14:31.169700 18877 webserver.cc:460] Webserver started at http://127.11.229.188:42575/ using document root <none> and password file <none>
I20260923 17:14:31.169898 18877 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:31.169941 18877 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:31.171353 18877 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260923 17:14:31.172394 19080 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:31.172717 18877 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260923 17:14:31.172792 18877 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-2/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-2/wal
uuid: "e5713f3a43744bcf8c11a6b6f531f8e2"
format_stamp: "Formatted at 2026-09-23 17:14:30 on dist-test-slave-1x1f"
server_key: "f98f7556932f1e007c35dabc48c417cf"
server_key_iv: "f67d384ed041ea961dcc64fc8b6968ea"
server_key_version: "encryptionkey@0"
I20260923 17:14:31.172876 18877 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:31.184525 18877 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:31.186724 18877 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:31.191587 18877 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.188:35815
I20260923 17:14:31.192271 18877 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/master-2/data/info.pb
I20260923 17:14:31.194394 19133 sys_catalog.cc:263] Verifying existing consensus state
I20260923 17:14:31.195757 19133 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2: Bootstrap starting.
I20260923 17:14:31.202404 19132 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.188:35815 every 8 connection(s)
I20260923 17:14:31.205816 18635 heartbeater.cc:503] Master 127.11.229.190:33923 was elected leader, sending a full tablet report...
I20260923 17:14:31.208984 19133 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260923 17:14:31.209436 19133 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2: Bootstrap complete.
I20260923 17:14:31.210256 19133 raft_consensus.cc:348] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } } peers { permanent_uuid: "8f4f49faad444410bf28c38f8ae42d2d" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 44707 } attrs { promote: false } } peers { permanent_uuid: "e5713f3a43744bcf8c11a6b6f531f8e2" member_type: NON_VOTER last_known_addr { host: "127.11.229.188" port: 35815 } attrs { promote: true } }
I20260923 17:14:31.210422 19133 raft_consensus.cc:729] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e5713f3a43744bcf8c11a6b6f531f8e2, State: Initialized, Role: LEARNER
I20260923 17:14:31.210549 19133 consensus_queue.cc:260] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } } peers { permanent_uuid: "8f4f49faad444410bf28c38f8ae42d2d" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 44707 } attrs { promote: false } } peers { permanent_uuid: "e5713f3a43744bcf8c11a6b6f531f8e2" member_type: NON_VOTER last_known_addr { host: "127.11.229.188" port: 35815 } attrs { promote: true } }
I20260923 17:14:31.210930 19136 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } } peers { permanent_uuid: "8f4f49faad444410bf28c38f8ae42d2d" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 44707 } attrs { promote: false } } peers { permanent_uuid: "e5713f3a43744bcf8c11a6b6f531f8e2" member_type: NON_VOTER last_known_addr { host: "127.11.229.188" port: 35815 } attrs { promote: true } } }
I20260923 17:14:31.211084 19133 sys_catalog.cc:564] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:14:31.211126 19136 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2 [sys.catalog]: This master's current role is: LEARNER
I20260923 17:14:31.215955 19147 catalog_manager.cc:1259] Loaded cluster ID: 2af4a61483ae46e0bded270bd7f86176
I20260923 17:14:31.216034 19147 catalog_manager.cc:1552] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2: loading cluster ID for follower catalog manager: success
I20260923 17:14:31.218328 19147 catalog_manager.cc:1574] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2: acquiring CA information for follower catalog manager: success
I20260923 17:14:31.219884 19147 catalog_manager.cc:1602] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260923 17:14:31.247658 19055 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:31.248085 19055 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:31.248199 19055 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:31.253186 19055 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:31.253293 19055 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:31.253386 19055 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.129
I20260923 17:14:31.259296 19055 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:46513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.129.keytab
--principal=oryx/127.11.229.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.129:38289
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.229.129
--webserver_port=46323
--tserver_master_addrs=127.11.229.190:33923,127.11.229.189:44707,127.11.229.188:35815
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19055
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.129
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:31.260604 19055 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:31.261785 19055 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:31.271536 19152 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:31.271530 19155 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:31.271715 19153 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:31.271713 19055 server_base.cc:1034] running on GCE node
I20260923 17:14:31.272441 19055 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:31.273208 19055 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:31.274403 19055 hybrid_clock.cc:648] HybridClock initialized: now 1790183671274368 us; error 50 us; skew 500 ppm
Sep 23 17:14:31 dist-test-slave-1x1f krb5kdc[18265](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183671, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.229.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:31.277889 19055 init.cc:377] Logged in from keytab as oryx/127.11.229.129@KRBTEST.COM (short username oryx)
I20260923 17:14:31.279027 19055 webserver.cc:460] Webserver started at http://127.11.229.129:46323/ using document root <none> and password file <none>
I20260923 17:14:31.279683 19055 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:31.279804 19055 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:31.284054 19055 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.004s
I20260923 17:14:31.286428 19162 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:31.287910 19055 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260923 17:14:31.288062 19055 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-0/wal
uuid: "d930318e4a9443309ed6c0a9490175c2"
format_stamp: "Formatted at 2026-09-23 17:14:29 on dist-test-slave-1x1f"
server_key: "61a12f18eefe93e3cc6b204fc3c388be"
server_key_iv: "141f0db760cc3d6e0b37ab661a966c90"
server_key_version: "encryptionkey@0"
I20260923 17:14:31.288676 19055 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:31.305459 19055 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:31.308868 19055 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:31.309106 19055 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:31.309777 19055 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:14:31.310755 19055 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:14:31.310832 19055 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:31.310905 19055 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:14:31.310957 19055 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:31.321430 19055 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.129:38289
I20260923 17:14:31.321460 19275 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.129:38289 every 8 connection(s)
I20260923 17:14:31.322584 19055 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
I20260923 17:14:31.327430 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 19055
I20260923 17:14:31.327637 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 18506
Sep 23 17:14:31 dist-test-slave-1x1f krb5kdc[18265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183671, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.229.129@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM
Sep 23 17:14:31 dist-test-slave-1x1f krb5kdc[18265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183671, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.229.129@KRBTEST.COM for oryx/127.11.229.189@KRBTEST.COM
Sep 23 17:14:31 dist-test-slave-1x1f krb5kdc[18265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183671, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.229.129@KRBTEST.COM for oryx/127.11.229.188@KRBTEST.COM
I20260923 17:14:31.336844 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.130:41891
--local_ip_for_outbound_sockets=127.11.229.130
--tserver_master_addrs=127.11.229.190:33923
--webserver_port=35897
--webserver_interface=127.11.229.130
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.130.keytab
--principal=oryx/127.11.229.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:46513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.11.229.190:33923,127.11.229.189:44707
--tserver_master_addrs=127.11.229.190:33923,127.11.229.189:44707,127.11.229.188:35815 with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 17:14:31.340111 19033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.324375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:54515 (local address 127.11.229.189:44707)
0923 17:14:31.324507 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:31.324513 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:31.325612 (+ 1099us) server_negotiation.cc:407] Connection header received
0923 17:14:31.326930 (+ 1318us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:31.326932 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:31.327023 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:31.327110 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:31.329574 (+ 2464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.330369 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.331643 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.331946 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.332020 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.335746 (+ 3726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:31.335750 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:31.335753 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:31.335785 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:31.337500 (+ 1715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:31.338290 (+ 790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:31.338295 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:31.338300 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:31.338392 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:31.338823 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:31.338826 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:31.338828 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:31.339051 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:31.339168 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:31.339808 (+ 640us) server_negotiation.cc:299] Negotiation successful
0923 17:14:31.339935 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260923 17:14:31.340445 19283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.325929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:56803 (local address 127.11.229.188:35815)
0923 17:14:31.326149 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:31.326165 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:31.326179 (+ 14us) server_negotiation.cc:407] Connection header received
0923 17:14:31.327027 (+ 848us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:31.327031 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:31.327083 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:31.328586 (+ 1503us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:31.329582 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.330800 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.332697 (+ 1897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.333068 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.333178 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.336040 (+ 2862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:31.336044 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:31.336047 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:31.336071 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:31.337810 (+ 1739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:31.338377 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:31.338381 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:31.338383 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:31.338463 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:31.338822 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:31.338825 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:31.338827 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:31.339357 (+ 530us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:31.339441 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:31.340026 (+ 585us) server_negotiation.cc:299] Negotiation successful
0923 17:14:31.340157 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":79,"threads_started":1}
I20260923 17:14:31.341120 18349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.324362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:50047 (local address 127.11.229.190:33923)
0923 17:14:31.324540 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:31.324545 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:31.325909 (+ 1364us) server_negotiation.cc:407] Connection header received
0923 17:14:31.326937 (+ 1028us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:31.326942 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:31.327027 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:31.327110 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:31.328865 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.329562 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.331263 (+ 1701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.331578 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.331669 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.335239 (+ 3570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:31.335245 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:31.335248 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:31.335280 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:31.337490 (+ 2210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:31.338348 (+ 858us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:31.338354 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:31.338359 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:31.338456 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:31.338827 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:31.338830 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:31.338832 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:31.339089 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:31.339187 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:31.340744 (+ 1557us) server_negotiation.cc:299] Negotiation successful
0923 17:14:31.340885 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260923 17:14:31.341522 19282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.325818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:35815 (local address 127.11.229.129:56803)
0923 17:14:31.326083 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:31.326095 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:31.326765 (+ 670us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:31.328730 (+ 1965us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:31.328736 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:31.328948 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:31.329101 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:31.329112 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.330942 (+ 1830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.330948 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:31.332570 (+ 1622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:31.332582 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.333268 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.333275 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:31.333407 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.333895 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:31.333914 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:31.335872 (+ 1958us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:31.337930 (+ 2058us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:31.337936 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:31.337938 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:31.338278 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:31.338563 (+ 285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:31.338565 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:31.338567 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:31.338711 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:31.339485 (+ 774us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:31.339487 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:31.339556 (+ 69us) client_negotiation.cc:769] Sending connection context
0923 17:14:31.339732 (+ 176us) client_negotiation.cc:240] Negotiation successful
0923 17:14:31.340670 (+ 938us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":214,"mutex_wait_us":1138,"spinlock_wait_cycles":16128,"thread_start_us":93,"threads_started":1}
I20260923 17:14:31.341825 19280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.324824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.189:44707 (local address 127.11.229.129:54515)
0923 17:14:31.325398 (+ 574us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:31.325462 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:31.326562 (+ 1100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:31.327373 (+ 811us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:31.327382 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:31.329300 (+ 1918us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:31.329438 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:31.329447 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.330503 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.330507 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:31.331502 (+ 995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:31.331510 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.332165 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.332168 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:31.332278 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.333325 (+ 1047us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:31.333340 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:31.335492 (+ 2152us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:31.337638 (+ 2146us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:31.337644 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:31.337655 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:31.338130 (+ 475us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:31.338509 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:31.338515 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:31.338520 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:31.338717 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:31.339168 (+ 451us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:31.339176 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:31.339520 (+ 344us) client_negotiation.cc:769] Sending connection context
0923 17:14:31.340284 (+ 764us) client_negotiation.cc:240] Negotiation successful
0923 17:14:31.340422 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"mutex_wait_us":5,"spinlock_wait_cycles":30208,"thread_start_us":690,"threads_started":1}
I20260923 17:14:31.342505 19281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.324825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:33923 (local address 127.11.229.129:50047)
0923 17:14:31.325824 (+ 999us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:31.325837 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:31.326562 (+ 725us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:31.327373 (+ 811us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:31.327380 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:31.327986 (+ 606us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:31.328691 (+ 705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:31.328713 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.329723 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.329726 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:31.331130 (+ 1404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:31.331140 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.331834 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.331838 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:31.332035 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.332810 (+ 775us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:31.332830 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:31.335026 (+ 2196us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:31.337625 (+ 2599us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:31.337634 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:31.337655 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:31.338172 (+ 517us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:31.338570 (+ 398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:31.338575 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:31.338579 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:31.338719 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:31.339246 (+ 527us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:31.339251 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:31.339522 (+ 271us) client_negotiation.cc:769] Sending connection context
0923 17:14:31.339732 (+ 210us) client_negotiation.cc:240] Negotiation successful
0923 17:14:31.340131 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":924,"mutex_wait_us":24,"spinlock_wait_cycles":21760,"thread_start_us":121,"threads_started":1}
I20260923 17:14:31.343044 19276 heartbeater.cc:347] Connected to a master server at 127.11.229.188:35815
I20260923 17:14:31.343330 19276 heartbeater.cc:464] Registering TS with master...
I20260923 17:14:31.343561 19277 heartbeater.cc:347] Connected to a master server at 127.11.229.190:33923
I20260923 17:14:31.343650 19277 heartbeater.cc:464] Registering TS with master...
I20260923 17:14:31.343917 19277 heartbeater.cc:511] Master 127.11.229.190:33923 requested a full tablet report, sending...
I20260923 17:14:31.343947 19276 heartbeater.cc:511] Master 127.11.229.188:35815 requested a full tablet report, sending...
I20260923 17:14:31.344395 19278 heartbeater.cc:347] Connected to a master server at 127.11.229.189:44707
I20260923 17:14:31.344485 19278 heartbeater.cc:464] Registering TS with master...
I20260923 17:14:31.344682 19278 heartbeater.cc:511] Master 127.11.229.189:44707 requested a full tablet report, sending...
I20260923 17:14:31.345129 18306 ts_manager.cc:194] Re-registered known tserver with Master: d930318e4a9443309ed6c0a9490175c2 (127.11.229.129:38289)
I20260923 17:14:31.345389 19089 ts_manager.cc:194] Registered new tserver with Master: d930318e4a9443309ed6c0a9490175c2 (127.11.229.129:38289)
I20260923 17:14:31.345814 18911 ts_manager.cc:194] Registered new tserver with Master: d930318e4a9443309ed6c0a9490175c2 (127.11.229.129:38289)
I20260923 17:14:31.345860 18306 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.229.129@KRBTEST.COM'} at 127.11.229.129:50047
I20260923 17:14:31.421978 18769 heartbeater.cc:503] Master 127.11.229.190:33923 was elected leader, sending a full tablet report...
W20260923 17:14:31.458002 19284 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:31.458416 19284 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:31.458489 19284 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:31.462944 19284 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:31.463011 19284 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:31.463073 19284 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.130
I20260923 17:14:31.468614 19284 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:46513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.130.keytab
--principal=oryx/127.11.229.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.130:41891
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.229.130
--webserver_port=35897
--tserver_master_addrs=127.11.229.190:33923,127.11.229.189:44707,127.11.229.188:35815
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19284
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.130
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:31.469784 19284 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:31.470922 19284 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:31.481360 19289 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:31.481349 19290 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:31.481348 19292 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:31.481663 19284 server_base.cc:1034] running on GCE node
I20260923 17:14:31.482290 19284 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:31.482975 19284 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:31.484159 19284 hybrid_clock.cc:648] HybridClock initialized: now 1790183671484124 us; error 48 us; skew 500 ppm
Sep 23 17:14:31 dist-test-slave-1x1f krb5kdc[18265](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183671, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.229.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:31.487083 19284 init.cc:377] Logged in from keytab as oryx/127.11.229.130@KRBTEST.COM (short username oryx)
I20260923 17:14:31.487972 19284 webserver.cc:460] Webserver started at http://127.11.229.130:35897/ using document root <none> and password file <none>
I20260923 17:14:31.488502 19284 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:31.488574 19284 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:31.492615 19284 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260923 17:14:31.495265 19299 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:31.496838 19284 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 17:14:31.496981 19284 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-1/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-1/wal
uuid: "d093525f85d24b5c8553b86206c34471"
format_stamp: "Formatted at 2026-09-23 17:14:30 on dist-test-slave-1x1f"
server_key: "b84f52253504d0de22c30b823e52a38e"
server_key_iv: "dc98b174bbbabac46c84639032209f85"
server_key_version: "encryptionkey@0"
I20260923 17:14:31.497537 19284 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:31.516131 19284 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:31.519866 19284 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:31.520072 19284 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:31.520721 19284 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:14:31.521605 19284 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:14:31.521654 19284 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:31.521718 19284 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:14:31.521749 19284 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:31.532589 19284 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.130:41891
I20260923 17:14:31.532966 19412 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.130:41891 every 8 connection(s)
I20260923 17:14:31.533878 19284 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
I20260923 17:14:31.535327 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 19284
I20260923 17:14:31.537367 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 18640
I20260923 17:14:31.543845 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.131:42203
--local_ip_for_outbound_sockets=127.11.229.131
--tserver_master_addrs=127.11.229.190:33923
--webserver_port=38881
--webserver_interface=127.11.229.131
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.131.keytab
--principal=oryx/127.11.229.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:46513
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.11.229.190:33923,127.11.229.189:44707
--tserver_master_addrs=127.11.229.190:33923,127.11.229.189:44707,127.11.229.188:35815 with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 23 17:14:31 dist-test-slave-1x1f krb5kdc[18265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183671, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.229.130@KRBTEST.COM for oryx/127.11.229.189@KRBTEST.COM
Sep 23 17:14:31 dist-test-slave-1x1f krb5kdc[18265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183671, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.229.130@KRBTEST.COM for oryx/127.11.229.188@KRBTEST.COM
Sep 23 17:14:31 dist-test-slave-1x1f krb5kdc[18265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183671, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.229.130@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM
I20260923 17:14:31.554131 18349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.539560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:52347 (local address 127.11.229.190:33923)
0923 17:14:31.539681 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:31.539686 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:31.543144 (+ 3458us) server_negotiation.cc:407] Connection header received
0923 17:14:31.543316 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:31.543321 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:31.543376 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:31.543429 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:31.544246 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.545000 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.546059 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.546450 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.546528 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.550384 (+ 3856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:31.550394 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:31.550398 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:31.550431 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:31.552398 (+ 1967us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:31.552862 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:31.552866 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:31.552869 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:31.552944 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:31.553248 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:31.553252 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:31.553253 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:31.553444 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:31.553515 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:31.553834 (+ 319us) server_negotiation.cc:299] Negotiation successful
0923 17:14:31.553958 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260923 17:14:31.554731 19033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.536198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:40981 (local address 127.11.229.189:44707)
0923 17:14:31.536412 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:31.536417 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:31.539867 (+ 3450us) server_negotiation.cc:407] Connection header received
0923 17:14:31.540749 (+ 882us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:31.540753 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:31.540809 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:31.540908 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:31.542158 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.542948 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.544859 (+ 1911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.545276 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.545371 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.550053 (+ 4682us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:31.550059 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:31.550064 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:31.550101 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:31.552450 (+ 2349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:31.553061 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:31.553067 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:31.553071 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:31.553171 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:31.553535 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:31.553541 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:31.553545 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:31.553815 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:31.553912 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:31.554363 (+ 451us) server_negotiation.cc:299] Negotiation successful
0923 17:14:31.554507 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150}
I20260923 17:14:31.555244 19417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.536563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:35815 (local address 127.11.229.130:32841)
0923 17:14:31.537412 (+ 849us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:31.542737 (+ 5325us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:31.542852 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:31.543218 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:31.543222 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:31.543463 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:31.543646 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:31.543652 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.544710 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.544713 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:31.545587 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:31.545595 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.546362 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.546365 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:31.546453 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.546967 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:31.546989 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:31.549277 (+ 2288us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:31.551634 (+ 2357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:31.551644 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:31.551670 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:31.552048 (+ 378us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:31.552428 (+ 380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:31.552434 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:31.552439 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:31.552652 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:31.553168 (+ 516us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:31.553178 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:31.553538 (+ 360us) client_negotiation.cc:769] Sending connection context
0923 17:14:31.553755 (+ 217us) client_negotiation.cc:240] Negotiation successful
0923 17:14:31.554103 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":361,"mutex_wait_us":35,"spinlock_wait_cycles":3968,"thread_start_us":144,"threads_started":1}
I20260923 17:14:31.555459 19419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.536564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.189:44707 (local address 127.11.229.130:40981)
0923 17:14:31.539724 (+ 3160us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:31.539762 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:31.540542 (+ 780us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:31.541067 (+ 525us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:31.541074 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:31.541479 (+ 405us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:31.541996 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:31.542010 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.543110 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.543116 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:31.544709 (+ 1593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:31.544724 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.545610 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.545615 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:31.545862 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.546655 (+ 793us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:31.546682 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:31.549866 (+ 3184us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:31.552595 (+ 2729us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:31.552601 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:31.552606 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:31.552925 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:31.553316 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:31.553320 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:31.553322 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:31.553416 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:31.553997 (+ 581us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:31.554002 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:31.554115 (+ 113us) client_negotiation.cc:769] Sending connection context
0923 17:14:31.554954 (+ 839us) client_negotiation.cc:240] Negotiation successful
0923 17:14:31.555129 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3066,"mutex_wait_us":47,"spinlock_wait_cycles":45056,"thread_start_us":124,"threads_started":1}
I20260923 17:14:31.556106 19283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.536078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:32841 (local address 127.11.229.188:35815)
0923 17:14:31.536327 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:31.536332 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:31.542819 (+ 6487us) server_negotiation.cc:407] Connection header received
0923 17:14:31.542933 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:31.542936 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:31.542995 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:31.543069 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:31.543775 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.544590 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.545705 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.546069 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.546168 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.549550 (+ 3382us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:31.549554 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:31.549559 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:31.549588 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:31.551498 (+ 1910us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:31.552177 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:31.552223 (+ 46us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:31.552225 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:31.552318 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:31.552773 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:31.552780 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:31.552784 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:31.553032 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:31.553119 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:31.555812 (+ 2693us) server_negotiation.cc:299] Negotiation successful
0923 17:14:31.555957 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165}
I20260923 17:14:31.556630 19415 heartbeater.cc:347] Connected to a master server at 127.11.229.189:44707
I20260923 17:14:31.556691 19413 heartbeater.cc:347] Connected to a master server at 127.11.229.188:35815
I20260923 17:14:31.556875 19418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.539455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:33923 (local address 127.11.229.130:52347)
0923 17:14:31.543068 (+ 3613us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:31.543080 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:31.543207 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:31.543578 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:31.543580 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:31.543775 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:31.543884 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:31.543890 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.545126 (+ 1236us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.545129 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:31.545943 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:31.545950 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.546686 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.546691 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:31.546826 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.547287 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:31.547302 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:31.550173 (+ 2871us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:31.552505 (+ 2332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:31.552508 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:31.552509 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:31.552758 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:31.553054 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:31.553060 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:31.553065 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:31.553150 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:31.553583 (+ 433us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:31.553586 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:31.553654 (+ 68us) client_negotiation.cc:769] Sending connection context
0923 17:14:31.554559 (+ 905us) client_negotiation.cc:240] Negotiation successful
0923 17:14:31.554709 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3532,"mutex_wait_us":3,"thread_start_us":100,"threads_started":1}
I20260923 17:14:31.556896 19415 heartbeater.cc:464] Registering TS with master...
I20260923 17:14:31.556890 19413 heartbeater.cc:464] Registering TS with master...
I20260923 17:14:31.557475 19414 heartbeater.cc:347] Connected to a master server at 127.11.229.190:33923
I20260923 17:14:31.557560 19415 heartbeater.cc:511] Master 127.11.229.189:44707 requested a full tablet report, sending...
I20260923 17:14:31.557576 19414 heartbeater.cc:464] Registering TS with master...
I20260923 17:14:31.557775 19414 heartbeater.cc:511] Master 127.11.229.190:33923 requested a full tablet report, sending...
I20260923 17:14:31.558168 19413 heartbeater.cc:511] Master 127.11.229.188:35815 requested a full tablet report, sending...
I20260923 17:14:31.558880 19089 ts_manager.cc:194] Registered new tserver with Master: d093525f85d24b5c8553b86206c34471 (127.11.229.130:41891)
I20260923 17:14:31.558885 18911 ts_manager.cc:194] Registered new tserver with Master: d093525f85d24b5c8553b86206c34471 (127.11.229.130:41891)
I20260923 17:14:31.559289 18306 ts_manager.cc:194] Re-registered known tserver with Master: d093525f85d24b5c8553b86206c34471 (127.11.229.130:41891)
I20260923 17:14:31.559891 18306 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.229.130@KRBTEST.COM'} at 127.11.229.130:52347
W20260923 17:14:31.665002 19420 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:31.665290 19420 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:31.665334 19420 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:31.669636 19420 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:31.669697 19420 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:31.669759 19420 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.131
I20260923 17:14:31.675524 19420 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:46513
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.131.keytab
--principal=oryx/127.11.229.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.131:42203
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.229.131
--webserver_port=38881
--tserver_master_addrs=127.11.229.190:33923,127.11.229.189:44707,127.11.229.188:35815
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19420
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.131
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:31.676678 19420 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:31.677855 19420 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:31.687805 19426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:31.687947 19428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:31.687805 19425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:31.688261 19420 server_base.cc:1034] running on GCE node
I20260923 17:14:31.689011 19420 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:31.689893 19420 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:31.691156 19420 hybrid_clock.cc:648] HybridClock initialized: now 1790183671691115 us; error 64 us; skew 500 ppm
Sep 23 17:14:31 dist-test-slave-1x1f krb5kdc[18265](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183671, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.229.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:31.694399 19420 init.cc:377] Logged in from keytab as oryx/127.11.229.131@KRBTEST.COM (short username oryx)
I20260923 17:14:31.695528 19420 webserver.cc:460] Webserver started at http://127.11.229.131:38881/ using document root <none> and password file <none>
I20260923 17:14:31.696144 19420 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:31.696265 19420 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:31.700285 19420 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260923 17:14:31.702698 19435 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:31.704353 19420 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 17:14:31.704509 19420 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-2/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-2/wal
uuid: "2a945117689c4bd4893b29d15d7acb56"
format_stamp: "Formatted at 2026-09-23 17:14:30 on dist-test-slave-1x1f"
server_key: "475ff1aef368c3fdb305d94911ffdd5c"
server_key_iv: "e023422b7e287da12397ec2d05a836fd"
server_key_version: "encryptionkey@0"
I20260923 17:14:31.705490 19420 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:31.709889 19437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.705953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:35815 (local address 127.0.0.1:54912)
0923 17:14:31.706213 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:31.706276 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:31.706427 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:31.706723 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:31.706726 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:31.706744 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:14:31.706852 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:31.706858 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.707633 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.707636 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:31.708493 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:31.708502 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.709547 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.709550 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:31.709629 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.709651 (+ 22us) client_negotiation.cc:769] Sending connection context
0923 17:14:31.709703 (+ 52us) client_negotiation.cc:240] Negotiation successful
0923 17:14:31.709771 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":66,"threads_started":1}
I20260923 17:14:31.709975 19283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.706013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54912 (local address 127.11.229.188:35815)
0923 17:14:31.706144 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:31.706149 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:31.706367 (+ 218us) server_negotiation.cc:407] Connection header received
0923 17:14:31.706544 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:31.706547 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:31.706608 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:31.706709 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:14:31.706963 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.707515 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.708634 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.709387 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.709562 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.709731 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:31.709775 (+ 44us) server_negotiation.cc:299] Negotiation successful
0923 17:14:31.709848 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260923 17:14:31.710683 19107 raft_consensus.cc:1203] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260923 17:14:31.711105 19136 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 82445899ad234187be57c8b10c01f25a. Latest consensus state: current_term: 1 leader_uuid: "82445899ad234187be57c8b10c01f25a" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } } peers { permanent_uuid: "8f4f49faad444410bf28c38f8ae42d2d" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 44707 } attrs { promote: false } } peers { permanent_uuid: "e5713f3a43744bcf8c11a6b6f531f8e2" member_type: NON_VOTER last_known_addr { host: "127.11.229.188" port: 35815 } attrs { promote: true } } }
I20260923 17:14:31.711252 19136 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2 [sys.catalog]: This master's current role is: LEARNER
I20260923 17:14:31.733331 19420 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:31.737058 19420 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:31.737274 19420 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:31.737942 19420 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:14:31.738919 19420 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:14:31.738970 19420 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:31.739046 19420 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:14:31.739079 19420 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:31.749104 19420 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.131:42203
I20260923 17:14:31.749126 19550 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.131:42203 every 8 connection(s)
I20260923 17:14:31.750201 19420 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
I20260923 17:14:31.751884 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 19420
Sep 23 17:14:31 dist-test-slave-1x1f krb5kdc[18265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183671, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.229.131@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM
I20260923 17:14:31.765537 19564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.753870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34362 (local address 127.11.229.189:44707)
0923 17:14:31.754464 (+ 594us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:31.754468 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:31.755161 (+ 693us) server_negotiation.cc:407] Connection header received
0923 17:14:31.755233 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:31.755236 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:31.755297 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:31.755386 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:31.756418 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.757353 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.758674 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.759065 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.759169 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.761107 (+ 1938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:31.761111 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:31.761114 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:31.761143 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:31.762948 (+ 1805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:31.763456 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:31.763460 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:31.763462 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:31.763552 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:31.763881 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:31.763887 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:31.763888 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:31.764134 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:31.764299 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:31.765064 (+ 765us) server_negotiation.cc:299] Negotiation successful
0923 17:14:31.765275 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":530,"thread_start_us":84,"threads_started":1}
I20260923 17:14:31.766707 19561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.753773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43436 (local address 127.11.229.190:33923)
0923 17:14:31.754007 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:31.754019 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:31.754815 (+ 796us) server_negotiation.cc:407] Connection header received
0923 17:14:31.754861 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:31.754864 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:31.754915 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:31.754994 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:31.756023 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.756819 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.758221 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.758580 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.758676 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.762270 (+ 3594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:31.762274 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:31.762277 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:31.762303 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:31.764296 (+ 1993us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:31.764784 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:31.764788 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:31.764790 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:31.764881 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:31.765170 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:31.765173 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:31.765174 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:31.765642 (+ 468us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:31.765760 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:31.766350 (+ 590us) server_negotiation.cc:299] Negotiation successful
0923 17:14:31.766505 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":73,"threads_started":1}
Sep 23 17:14:31 dist-test-slave-1x1f krb5kdc[18265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183671, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.229.131@KRBTEST.COM for oryx/127.11.229.188@KRBTEST.COM
Sep 23 17:14:31 dist-test-slave-1x1f krb5kdc[18265](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183671, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.229.131@KRBTEST.COM for oryx/127.11.229.189@KRBTEST.COM
I20260923 17:14:31.770056 19566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.754466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54924 (local address 127.11.229.188:35815)
0923 17:14:31.754687 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:31.754691 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:31.755240 (+ 549us) server_negotiation.cc:407] Connection header received
0923 17:14:31.756419 (+ 1179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:31.756422 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:31.756468 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:31.756548 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:31.757571 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.758507 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.759779 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.761379 (+ 1600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.761459 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.765492 (+ 4033us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:31.765496 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:31.765498 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:31.765524 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:31.767745 (+ 2221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:31.768298 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:31.768302 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:31.768304 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:31.768391 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:31.768753 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:31.768757 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:31.768759 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:31.769078 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:31.769203 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:31.769657 (+ 454us) server_negotiation.cc:299] Negotiation successful
0923 17:14:31.769821 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":100,"threads_started":1}
I20260923 17:14:31.772369 18349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.752171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:52469 (local address 127.11.229.190:33923)
0923 17:14:31.752345 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:31.752351 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:31.753443 (+ 1092us) server_negotiation.cc:407] Connection header received
0923 17:14:31.755696 (+ 2253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:31.755700 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:31.755764 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:31.755819 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:31.757505 (+ 1686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.758193 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.759951 (+ 1758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.760303 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.760382 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.767119 (+ 6737us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:31.767124 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:31.767128 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:31.767158 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:31.769543 (+ 2385us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:31.770200 (+ 657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:31.770205 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:31.770207 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:31.770333 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:31.770823 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:31.770827 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:31.770829 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:31.771101 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:31.771194 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:31.772019 (+ 825us) server_negotiation.cc:299] Negotiation successful
0923 17:14:31.772183 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260923 17:14:31.774191 19560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.752677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:33923 (local address 127.11.229.131:52469)
0923 17:14:31.753279 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:31.753333 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:31.755579 (+ 2246us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:31.756210 (+ 631us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:31.756219 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:31.756685 (+ 466us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:31.757352 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:31.757370 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.758369 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.758372 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:31.759786 (+ 1414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:31.759799 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.760649 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.760656 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:31.760896 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.762313 (+ 1417us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:31.762334 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:31.765407 (+ 3073us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:31.769669 (+ 4262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:31.769677 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:31.769697 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:31.770096 (+ 399us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:31.770472 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:31.770478 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:31.770483 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:31.770686 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:31.771294 (+ 608us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:31.771304 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:31.771683 (+ 379us) client_negotiation.cc:769] Sending connection context
0923 17:14:31.772545 (+ 862us) client_negotiation.cc:240] Negotiation successful
0923 17:14:31.772959 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":390,"thread_start_us":176,"threads_started":1}
I20260923 17:14:31.769948 18306 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43436:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 17:14:31.774690 19033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.752690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:37711 (local address 127.11.229.189:44707)
0923 17:14:31.752815 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:31.752819 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:31.754326 (+ 1507us) server_negotiation.cc:407] Connection header received
0923 17:14:31.757871 (+ 3545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:31.757874 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:31.757920 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:31.757968 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:31.761256 (+ 3288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.762096 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.765581 (+ 3485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.765959 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.766036 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.770911 (+ 4875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:31.770914 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:31.770917 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:31.770942 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:31.772783 (+ 1841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:31.773257 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:31.773261 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:31.773263 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:31.773340 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:31.773711 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:31.773714 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:31.773719 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:31.773958 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:31.774031 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:31.774436 (+ 405us) server_negotiation.cc:299] Negotiation successful
0923 17:14:31.774553 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260923 17:14:31.775601 19559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.752677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.189:44707 (local address 127.11.229.131:37711)
0923 17:14:31.754216 (+ 1539us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:31.754254 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:31.755373 (+ 1119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:31.759368 (+ 3995us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:31.759371 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:31.759561 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:31.760322 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:31.760330 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.763918 (+ 3588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.763922 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:31.764820 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:31.764831 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.766895 (+ 2064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.766898 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:31.766994 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.768213 (+ 1219us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:31.768229 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:31.770756 (+ 2527us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:31.772917 (+ 2161us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:31.772919 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:31.772921 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:31.773147 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:31.773441 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:31.773443 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:31.773445 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:31.773611 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:31.774101 (+ 490us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:31.774106 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:31.774210 (+ 104us) client_negotiation.cc:769] Sending connection context
0923 17:14:31.774874 (+ 664us) client_negotiation.cc:240] Negotiation successful
0923 17:14:31.775014 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1432,"mutex_wait_us":58,"spinlock_wait_cycles":32512,"thread_start_us":151,"threads_started":1}
W20260923 17:14:31.775835 18306 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 17:14:31.775956 19283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.754155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:45789 (local address 127.11.229.188:35815)
0923 17:14:31.754350 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:31.754355 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:31.755495 (+ 1140us) server_negotiation.cc:407] Connection header received
0923 17:14:31.755826 (+ 331us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:31.755832 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:31.755895 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:31.755963 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:31.760213 (+ 4250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.761137 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.763271 (+ 2134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.763660 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.763751 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.770017 (+ 6266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:31.770021 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:31.770024 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:31.770051 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:31.771878 (+ 1827us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:31.772782 (+ 904us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:31.772786 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:31.772788 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:31.772878 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:31.773708 (+ 830us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:31.773712 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:31.773713 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:31.773930 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:31.774018 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:31.775653 (+ 1635us) server_negotiation.cc:299] Negotiation successful
0923 17:14:31.775808 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260923 17:14:31.775997 19552 heartbeater.cc:347] Connected to a master server at 127.11.229.190:33923
I20260923 17:14:31.776232 19552 heartbeater.cc:464] Registering TS with master...
I20260923 17:14:31.776458 19562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.753807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:35815 (local address 127.11.229.131:45789)
0923 17:14:31.755415 (+ 1608us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:31.755430 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:31.755557 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:31.756212 (+ 655us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:31.756220 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:31.759969 (+ 3749us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:31.760094 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:31.760100 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.761619 (+ 1519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.761623 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:31.762717 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:31.762731 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.765081 (+ 2350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.765085 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:31.765186 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.766569 (+ 1383us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:31.766585 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:31.769863 (+ 3278us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:31.772004 (+ 2141us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:31.772009 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:31.772011 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:31.772306 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:31.773053 (+ 747us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:31.773056 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:31.773070 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:31.773571 (+ 501us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:31.774139 (+ 568us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:31.774142 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:31.774607 (+ 465us) client_negotiation.cc:769] Sending connection context
0923 17:14:31.776107 (+ 1500us) client_negotiation.cc:240] Negotiation successful
0923 17:14:31.776259 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1542,"mutex_wait_us":3,"thread_start_us":89,"threads_started":1}
I20260923 17:14:31.776842 19552 heartbeater.cc:511] Master 127.11.229.190:33923 requested a full tablet report, sending...
I20260923 17:14:31.777053 19551 heartbeater.cc:347] Connected to a master server at 127.11.229.188:35815
I20260923 17:14:31.777130 19551 heartbeater.cc:464] Registering TS with master...
I20260923 17:14:31.777289 19551 heartbeater.cc:511] Master 127.11.229.188:35815 requested a full tablet report, sending...
I20260923 17:14:31.777365 19553 heartbeater.cc:347] Connected to a master server at 127.11.229.189:44707
I20260923 17:14:31.777422 19553 heartbeater.cc:464] Registering TS with master...
I20260923 17:14:31.777554 19553 heartbeater.cc:511] Master 127.11.229.189:44707 requested a full tablet report, sending...
I20260923 17:14:31.778057 18307 ts_manager.cc:194] Re-registered known tserver with Master: 2a945117689c4bd4893b29d15d7acb56 (127.11.229.131:42203)
I20260923 17:14:31.778170 19089 ts_manager.cc:194] Registered new tserver with Master: 2a945117689c4bd4893b29d15d7acb56 (127.11.229.131:42203)
I20260923 17:14:31.778317 18911 ts_manager.cc:194] Registered new tserver with Master: 2a945117689c4bd4893b29d15d7acb56 (127.11.229.131:42203)
I20260923 17:14:31.778852 18307 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.229.131@KRBTEST.COM'} at 127.11.229.131:52469
I20260923 17:14:31.780109 19436 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "82445899ad234187be57c8b10c01f25a" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } } peers { permanent_uuid: "8f4f49faad444410bf28c38f8ae42d2d" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 44707 } attrs { promote: false } } peers { permanent_uuid: "e5713f3a43744bcf8c11a6b6f531f8e2" member_type: NON_VOTER last_known_addr { host: "127.11.229.188" port: 35815 } attrs { promote: true } } }
I20260923 17:14:31.780253 19436 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a [sys.catalog]: This master's current role is: LEADER
I20260923 17:14:31.783629 19570 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a: attempting to promote NON_VOTER e5713f3a43744bcf8c11a6b6f531f8e2 to VOTER
I20260923 17:14:31.783978 19570 consensus_queue.cc:237] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } } peers { permanent_uuid: "8f4f49faad444410bf28c38f8ae42d2d" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 44707 } attrs { promote: false } } peers { permanent_uuid: "e5713f3a43744bcf8c11a6b6f531f8e2" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 35815 } attrs { promote: false } }
I20260923 17:14:31.785629 18920 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [term 1 FOLLOWER]: Refusing update from remote peer 82445899ad234187be57c8b10c01f25a: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260923 17:14:31.786090 19569 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f4f49faad444410bf28c38f8ae42d2d" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 44707 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260923 17:14:31.788281 19569 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, e5713f3a43744bcf8c11a6b6f531f8e2 (127.11.229.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } } peers { permanent_uuid: "8f4f49faad444410bf28c38f8ae42d2d" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 44707 } attrs { promote: false } } peers { permanent_uuid: "e5713f3a43744bcf8c11a6b6f531f8e2" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 35815 } attrs { promote: false } } }
I20260923 17:14:31.788607 19107 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2 [term 1 LEARNER]: Refusing update from remote peer 82445899ad234187be57c8b10c01f25a: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260923 17:14:31.789047 19578 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5713f3a43744bcf8c11a6b6f531f8e2" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 35815 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260923 17:14:31.790126 19107 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, e5713f3a43744bcf8c11a6b6f531f8e2 (127.11.229.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } } peers { permanent_uuid: "8f4f49faad444410bf28c38f8ae42d2d" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 44707 } attrs { promote: false } } peers { permanent_uuid: "e5713f3a43744bcf8c11a6b6f531f8e2" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 35815 } attrs { promote: false } } }
I20260923 17:14:31.790542 19570 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "82445899ad234187be57c8b10c01f25a" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } } peers { permanent_uuid: "8f4f49faad444410bf28c38f8ae42d2d" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 44707 } attrs { promote: false } } peers { permanent_uuid: "e5713f3a43744bcf8c11a6b6f531f8e2" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 35815 } attrs { promote: false } } }
I20260923 17:14:31.790655 19570 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a [sys.catalog]: This master's current role is: LEADER
I20260923 17:14:31.791129 18920 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, e5713f3a43744bcf8c11a6b6f531f8e2 (127.11.229.188) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } } peers { permanent_uuid: "8f4f49faad444410bf28c38f8ae42d2d" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 44707 } attrs { promote: false } } peers { permanent_uuid: "e5713f3a43744bcf8c11a6b6f531f8e2" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 35815 } attrs { promote: false } } }
I20260923 17:14:31.791322 19436 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "82445899ad234187be57c8b10c01f25a" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } } peers { permanent_uuid: "8f4f49faad444410bf28c38f8ae42d2d" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 44707 } attrs { promote: false } } peers { permanent_uuid: "e5713f3a43744bcf8c11a6b6f531f8e2" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 35815 } attrs { promote: false } } }
I20260923 17:14:31.791415 19436 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a [sys.catalog]: This master's current role is: LEADER
I20260923 17:14:31.792100 19136 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "82445899ad234187be57c8b10c01f25a" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } } peers { permanent_uuid: "8f4f49faad444410bf28c38f8ae42d2d" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 44707 } attrs { promote: false } } peers { permanent_uuid: "e5713f3a43744bcf8c11a6b6f531f8e2" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 35815 } attrs { promote: false } } }
I20260923 17:14:31.792222 19136 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 17:14:31.792591 19578 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "82445899ad234187be57c8b10c01f25a" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } } peers { permanent_uuid: "8f4f49faad444410bf28c38f8ae42d2d" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 44707 } attrs { promote: false } } peers { permanent_uuid: "e5713f3a43744bcf8c11a6b6f531f8e2" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 35815 } attrs { promote: false } } }
I20260923 17:14:31.792764 19578 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a [sys.catalog]: This master's current role is: LEADER
I20260923 17:14:31.792793 19579 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "82445899ad234187be57c8b10c01f25a" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } } peers { permanent_uuid: "8f4f49faad444410bf28c38f8ae42d2d" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 44707 } attrs { promote: false } } peers { permanent_uuid: "e5713f3a43744bcf8c11a6b6f531f8e2" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 35815 } attrs { promote: false } } }
I20260923 17:14:31.792934 19579 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [sys.catalog]: This master's current role is: FOLLOWER
I20260923 17:14:31.803325 19437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.797076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.130:41891 (local address 127.0.0.1:49160)
0923 17:14:31.797725 (+ 649us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:31.797744 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:31.797838 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:31.798709 (+ 871us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:31.798712 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:31.798729 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:14:31.798855 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:31.798864 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.800417 (+ 1553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.800421 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:31.801696 (+ 1275us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:31.801707 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.802879 (+ 1172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.802883 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:31.802990 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.803011 (+ 21us) client_negotiation.cc:769] Sending connection context
0923 17:14:31.803075 (+ 64us) client_negotiation.cc:240] Negotiation successful
0923 17:14:31.803158 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":570,"spinlock_wait_cycles":768}
I20260923 17:14:31.803527 19581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.797386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.131:42203 (local address 127.0.0.1:37236)
0923 17:14:31.798639 (+ 1253us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:31.798654 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:31.798757 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:31.799655 (+ 898us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:31.799658 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:31.799675 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:14:31.799771 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:31.799775 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.800995 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.801000 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:31.801941 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:31.801950 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.803172 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.803175 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:31.803255 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.803276 (+ 21us) client_negotiation.cc:769] Sending connection context
0923 17:14:31.803345 (+ 69us) client_negotiation.cc:240] Negotiation successful
0923 17:14:31.803418 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1150,"thread_start_us":164,"threads_started":1}
I20260923 17:14:31.803359 19580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.797305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49160 (local address 127.11.229.130:41891)
0923 17:14:31.798103 (+ 798us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:31.798116 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:31.798144 (+ 28us) server_negotiation.cc:407] Connection header received
0923 17:14:31.798260 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:31.798269 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:31.798539 (+ 270us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:31.799032 (+ 493us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:14:31.799191 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.800293 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.801841 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.802751 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.802881 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.803056 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:31.803112 (+ 56us) server_negotiation.cc:299] Negotiation successful
0923 17:14:31.803207 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":642,"thread_start_us":214,"threads_started":1}
I20260923 17:14:31.803967 19583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.798167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37236 (local address 127.11.229.131:42203)
0923 17:14:31.799192 (+ 1025us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:31.799204 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:31.799226 (+ 22us) server_negotiation.cc:407] Connection header received
0923 17:14:31.799296 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:31.799301 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:31.799479 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:31.799648 (+ 169us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:14:31.799913 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.800802 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.802102 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.802868 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.802984 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.803116 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:31.803695 (+ 579us) server_negotiation.cc:299] Negotiation successful
0923 17:14:31.803832 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":924,"thread_start_us":141,"threads_started":1}
I20260923 17:14:31.805583 19582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.797825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:38289 (local address 127.0.0.1:41150)
0923 17:14:31.798934 (+ 1109us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:31.798945 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:31.799005 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:31.800302 (+ 1297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:31.800305 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:31.800324 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:14:31.800405 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:31.800411 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.801743 (+ 1332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.801749 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:31.803773 (+ 2024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:31.803786 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.805215 (+ 1429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.805219 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:31.805307 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.805328 (+ 21us) client_negotiation.cc:769] Sending connection context
0923 17:14:31.805393 (+ 65us) client_negotiation.cc:240] Negotiation successful
0923 17:14:31.805463 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1061,"thread_start_us":190,"threads_started":1}
I20260923 17:14:31.805642 19584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.798490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41150 (local address 127.11.229.129:38289)
0923 17:14:31.799891 (+ 1401us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:31.799905 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:31.799926 (+ 21us) server_negotiation.cc:407] Connection header received
0923 17:14:31.799993 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:31.799997 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:31.800154 (+ 157us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:31.800292 (+ 138us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:14:31.800512 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.801608 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.803917 (+ 2309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.805074 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.805230 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.805358 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:31.805414 (+ 56us) server_negotiation.cc:299] Negotiation successful
0923 17:14:31.805498 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1304,"thread_start_us":97,"threads_started":1}
I20260923 17:14:31.806955 19347 tablet_service.cc:1467] Processing CreateTablet for tablet 2468da2cb7a946e480822cc2620da7a8 (DEFAULT_TABLE table=test-table [id=4aa2727f1f914be4bb3c8ecc314c588e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:14:31.806958 19485 tablet_service.cc:1467] Processing CreateTablet for tablet 2468da2cb7a946e480822cc2620da7a8 (DEFAULT_TABLE table=test-table [id=4aa2727f1f914be4bb3c8ecc314c588e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:14:31.808099 19347 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2468da2cb7a946e480822cc2620da7a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:31.808109 19485 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2468da2cb7a946e480822cc2620da7a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:31.808086 19210 tablet_service.cc:1467] Processing CreateTablet for tablet 2468da2cb7a946e480822cc2620da7a8 (DEFAULT_TABLE table=test-table [id=4aa2727f1f914be4bb3c8ecc314c588e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:14:31.808825 19210 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2468da2cb7a946e480822cc2620da7a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:31.816146 19585 tablet_bootstrap.cc:492] T 2468da2cb7a946e480822cc2620da7a8 P d930318e4a9443309ed6c0a9490175c2: Bootstrap starting.
I20260923 17:14:31.818652 19585 tablet_bootstrap.cc:654] T 2468da2cb7a946e480822cc2620da7a8 P d930318e4a9443309ed6c0a9490175c2: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:31.818622 19586 tablet_bootstrap.cc:492] T 2468da2cb7a946e480822cc2620da7a8 P 2a945117689c4bd4893b29d15d7acb56: Bootstrap starting.
I20260923 17:14:31.819542 19585 log.cc:824] T 2468da2cb7a946e480822cc2620da7a8 P d930318e4a9443309ed6c0a9490175c2: Log is configured to *not* fsync() on all Append() calls
I20260923 17:14:31.820840 19586 tablet_bootstrap.cc:654] T 2468da2cb7a946e480822cc2620da7a8 P 2a945117689c4bd4893b29d15d7acb56: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:31.821656 19586 log.cc:824] T 2468da2cb7a946e480822cc2620da7a8 P 2a945117689c4bd4893b29d15d7acb56: Log is configured to *not* fsync() on all Append() calls
I20260923 17:14:31.822062 19585 tablet_bootstrap.cc:492] T 2468da2cb7a946e480822cc2620da7a8 P d930318e4a9443309ed6c0a9490175c2: No bootstrap required, opened a new log
I20260923 17:14:31.822309 19585 ts_tablet_manager.cc:1397] T 2468da2cb7a946e480822cc2620da7a8 P d930318e4a9443309ed6c0a9490175c2: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260923 17:14:31.822456 19587 tablet_bootstrap.cc:492] T 2468da2cb7a946e480822cc2620da7a8 P d093525f85d24b5c8553b86206c34471: Bootstrap starting.
I20260923 17:14:31.823565 19586 tablet_bootstrap.cc:492] T 2468da2cb7a946e480822cc2620da7a8 P 2a945117689c4bd4893b29d15d7acb56: No bootstrap required, opened a new log
I20260923 17:14:31.823766 19586 ts_tablet_manager.cc:1397] T 2468da2cb7a946e480822cc2620da7a8 P 2a945117689c4bd4893b29d15d7acb56: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260923 17:14:31.824608 19587 tablet_bootstrap.cc:654] T 2468da2cb7a946e480822cc2620da7a8 P d093525f85d24b5c8553b86206c34471: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:31.825423 19587 log.cc:824] T 2468da2cb7a946e480822cc2620da7a8 P d093525f85d24b5c8553b86206c34471: Log is configured to *not* fsync() on all Append() calls
I20260923 17:14:31.826323 19585 raft_consensus.cc:348] T 2468da2cb7a946e480822cc2620da7a8 P d930318e4a9443309ed6c0a9490175c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d093525f85d24b5c8553b86206c34471" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 41891 } } peers { permanent_uuid: "2a945117689c4bd4893b29d15d7acb56" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42203 } } peers { permanent_uuid: "d930318e4a9443309ed6c0a9490175c2" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38289 } }
I20260923 17:14:31.826610 19585 raft_consensus.cc:374] T 2468da2cb7a946e480822cc2620da7a8 P d930318e4a9443309ed6c0a9490175c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:31.826664 19585 raft_consensus.cc:729] T 2468da2cb7a946e480822cc2620da7a8 P d930318e4a9443309ed6c0a9490175c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d930318e4a9443309ed6c0a9490175c2, State: Initialized, Role: FOLLOWER
I20260923 17:14:31.827136 19585 consensus_queue.cc:260] T 2468da2cb7a946e480822cc2620da7a8 P d930318e4a9443309ed6c0a9490175c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d093525f85d24b5c8553b86206c34471" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 41891 } } peers { permanent_uuid: "2a945117689c4bd4893b29d15d7acb56" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42203 } } peers { permanent_uuid: "d930318e4a9443309ed6c0a9490175c2" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38289 } }
I20260923 17:14:31.827541 19587 tablet_bootstrap.cc:492] T 2468da2cb7a946e480822cc2620da7a8 P d093525f85d24b5c8553b86206c34471: No bootstrap required, opened a new log
I20260923 17:14:31.827911 19277 heartbeater.cc:503] Master 127.11.229.190:33923 was elected leader, sending a full tablet report...
I20260923 17:14:31.827888 19586 raft_consensus.cc:348] T 2468da2cb7a946e480822cc2620da7a8 P 2a945117689c4bd4893b29d15d7acb56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d093525f85d24b5c8553b86206c34471" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 41891 } } peers { permanent_uuid: "2a945117689c4bd4893b29d15d7acb56" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42203 } } peers { permanent_uuid: "d930318e4a9443309ed6c0a9490175c2" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38289 } }
I20260923 17:14:31.828145 19586 raft_consensus.cc:374] T 2468da2cb7a946e480822cc2620da7a8 P 2a945117689c4bd4893b29d15d7acb56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:31.828200 19586 raft_consensus.cc:729] T 2468da2cb7a946e480822cc2620da7a8 P 2a945117689c4bd4893b29d15d7acb56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a945117689c4bd4893b29d15d7acb56, State: Initialized, Role: FOLLOWER
I20260923 17:14:31.828239 19585 ts_tablet_manager.cc:1428] T 2468da2cb7a946e480822cc2620da7a8 P d930318e4a9443309ed6c0a9490175c2: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260923 17:14:31.828603 19586 consensus_queue.cc:260] T 2468da2cb7a946e480822cc2620da7a8 P 2a945117689c4bd4893b29d15d7acb56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d093525f85d24b5c8553b86206c34471" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 41891 } } peers { permanent_uuid: "2a945117689c4bd4893b29d15d7acb56" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42203 } } peers { permanent_uuid: "d930318e4a9443309ed6c0a9490175c2" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38289 } }
I20260923 17:14:31.827721 19587 ts_tablet_manager.cc:1397] T 2468da2cb7a946e480822cc2620da7a8 P d093525f85d24b5c8553b86206c34471: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260923 17:14:31.829579 19586 ts_tablet_manager.cc:1428] T 2468da2cb7a946e480822cc2620da7a8 P 2a945117689c4bd4893b29d15d7acb56: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260923 17:14:31.829964 19552 heartbeater.cc:503] Master 127.11.229.190:33923 was elected leader, sending a full tablet report...
I20260923 17:14:31.835196 19587 raft_consensus.cc:348] T 2468da2cb7a946e480822cc2620da7a8 P d093525f85d24b5c8553b86206c34471 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d093525f85d24b5c8553b86206c34471" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 41891 } } peers { permanent_uuid: "2a945117689c4bd4893b29d15d7acb56" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42203 } } peers { permanent_uuid: "d930318e4a9443309ed6c0a9490175c2" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38289 } }
I20260923 17:14:31.835454 19587 raft_consensus.cc:374] T 2468da2cb7a946e480822cc2620da7a8 P d093525f85d24b5c8553b86206c34471 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:31.835500 19587 raft_consensus.cc:729] T 2468da2cb7a946e480822cc2620da7a8 P d093525f85d24b5c8553b86206c34471 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d093525f85d24b5c8553b86206c34471, State: Initialized, Role: FOLLOWER
I20260923 17:14:31.835896 19587 consensus_queue.cc:260] T 2468da2cb7a946e480822cc2620da7a8 P d093525f85d24b5c8553b86206c34471 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d093525f85d24b5c8553b86206c34471" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 41891 } } peers { permanent_uuid: "2a945117689c4bd4893b29d15d7acb56" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42203 } } peers { permanent_uuid: "d930318e4a9443309ed6c0a9490175c2" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38289 } }
I20260923 17:14:31.836581 19414 heartbeater.cc:503] Master 127.11.229.190:33923 was elected leader, sending a full tablet report...
I20260923 17:14:31.836911 19587 ts_tablet_manager.cc:1428] T 2468da2cb7a946e480822cc2620da7a8 P d093525f85d24b5c8553b86206c34471: Time spent starting tablet: real 0.007s user 0.002s sys 0.004s
I20260923 17:14:31.881971 19592 raft_consensus.cc:482] T 2468da2cb7a946e480822cc2620da7a8 P 2a945117689c4bd4893b29d15d7acb56 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 17:14:31.882166 19592 raft_consensus.cc:504] T 2468da2cb7a946e480822cc2620da7a8 P 2a945117689c4bd4893b29d15d7acb56 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d093525f85d24b5c8553b86206c34471" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 41891 } } peers { permanent_uuid: "2a945117689c4bd4893b29d15d7acb56" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42203 } } peers { permanent_uuid: "d930318e4a9443309ed6c0a9490175c2" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38289 } }
I20260923 17:14:31.883414 19592 leader_election.cc:288] T 2468da2cb7a946e480822cc2620da7a8 P 2a945117689c4bd4893b29d15d7acb56 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d093525f85d24b5c8553b86206c34471 (127.11.229.130:41891), d930318e4a9443309ed6c0a9490175c2 (127.11.229.129:38289)
I20260923 17:14:31.887495 19580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.883808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:60279 (local address 127.11.229.130:41891)
0923 17:14:31.883957 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:31.883962 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:31.884012 (+ 50us) server_negotiation.cc:407] Connection header received
0923 17:14:31.884071 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:31.884074 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:31.884132 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:31.884214 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:14:31.884516 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.885417 (+ 901us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.886485 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.886880 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.887027 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.887085 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:31.887325 (+ 240us) server_negotiation.cc:299] Negotiation successful
0923 17:14:31.887394 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260923 17:14:31.887516 19562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.883666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.130:41891 (local address 127.11.229.131:60279)
0923 17:14:31.883801 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:31.883817 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:31.883920 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:31.884270 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:31.884273 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:31.884291 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:14:31.884405 (+ 114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:31.884410 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.885522 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.885524 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:31.886363 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:31.886372 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.887001 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.887018 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:31.887120 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.887150 (+ 30us) client_negotiation.cc:769] Sending connection context
0923 17:14:31.887290 (+ 140us) client_negotiation.cc:240] Negotiation successful
0923 17:14:31.887364 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260923 17:14:31.887836 19559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.883976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:38289 (local address 127.11.229.131:46535)
0923 17:14:31.884075 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:31.884088 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:31.884150 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:31.884658 (+ 508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:31.884659 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:31.884673 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:14:31.884747 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:31.884751 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.885735 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.885741 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:31.886651 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:31.886661 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.887382 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.887386 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:31.887508 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.887525 (+ 17us) client_negotiation.cc:769] Sending connection context
0923 17:14:31.887624 (+ 99us) client_negotiation.cc:240] Negotiation successful
0923 17:14:31.887718 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260923 17:14:31.887946 19584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.884237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:46535 (local address 127.11.229.129:38289)
0923 17:14:31.884402 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:31.884406 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:31.884418 (+ 12us) server_negotiation.cc:407] Connection header received
0923 17:14:31.884488 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:31.884493 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:31.884550 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:31.884644 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:14:31.884849 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.885616 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.886798 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.887247 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.887382 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.887435 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:31.887746 (+ 311us) server_negotiation.cc:299] Negotiation successful
0923 17:14:31.887825 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260923 17:14:31.888185 19366 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2468da2cb7a946e480822cc2620da7a8" candidate_uuid: "2a945117689c4bd4893b29d15d7acb56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d093525f85d24b5c8553b86206c34471" is_pre_election: true
I20260923 17:14:31.888523 19366 raft_consensus.cc:2454] T 2468da2cb7a946e480822cc2620da7a8 P d093525f85d24b5c8553b86206c34471 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a945117689c4bd4893b29d15d7acb56 in term 0.
I20260923 17:14:31.888882 19230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2468da2cb7a946e480822cc2620da7a8" candidate_uuid: "2a945117689c4bd4893b29d15d7acb56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d930318e4a9443309ed6c0a9490175c2" is_pre_election: true
I20260923 17:14:31.889040 19439 leader_election.cc:302] T 2468da2cb7a946e480822cc2620da7a8 P 2a945117689c4bd4893b29d15d7acb56 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a945117689c4bd4893b29d15d7acb56, d093525f85d24b5c8553b86206c34471; no voters:
I20260923 17:14:31.889130 19230 raft_consensus.cc:2454] T 2468da2cb7a946e480822cc2620da7a8 P d930318e4a9443309ed6c0a9490175c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a945117689c4bd4893b29d15d7acb56 in term 0.
I20260923 17:14:31.889366 19592 raft_consensus.cc:2781] T 2468da2cb7a946e480822cc2620da7a8 P 2a945117689c4bd4893b29d15d7acb56 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 17:14:31.889460 19592 raft_consensus.cc:482] T 2468da2cb7a946e480822cc2620da7a8 P 2a945117689c4bd4893b29d15d7acb56 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 17:14:31.889515 19592 raft_consensus.cc:3037] T 2468da2cb7a946e480822cc2620da7a8 P 2a945117689c4bd4893b29d15d7acb56 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:31.890594 19592 raft_consensus.cc:504] T 2468da2cb7a946e480822cc2620da7a8 P 2a945117689c4bd4893b29d15d7acb56 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d093525f85d24b5c8553b86206c34471" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 41891 } } peers { permanent_uuid: "2a945117689c4bd4893b29d15d7acb56" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42203 } } peers { permanent_uuid: "d930318e4a9443309ed6c0a9490175c2" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38289 } }
I20260923 17:14:31.890939 19592 leader_election.cc:288] T 2468da2cb7a946e480822cc2620da7a8 P 2a945117689c4bd4893b29d15d7acb56 [CANDIDATE]: Term 1 election: Requested vote from peers d093525f85d24b5c8553b86206c34471 (127.11.229.130:41891), d930318e4a9443309ed6c0a9490175c2 (127.11.229.129:38289)
I20260923 17:14:31.891363 19230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2468da2cb7a946e480822cc2620da7a8" candidate_uuid: "2a945117689c4bd4893b29d15d7acb56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d930318e4a9443309ed6c0a9490175c2"
I20260923 17:14:31.891390 19366 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2468da2cb7a946e480822cc2620da7a8" candidate_uuid: "2a945117689c4bd4893b29d15d7acb56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d093525f85d24b5c8553b86206c34471"
I20260923 17:14:31.891501 19230 raft_consensus.cc:3037] T 2468da2cb7a946e480822cc2620da7a8 P d930318e4a9443309ed6c0a9490175c2 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:31.891528 19366 raft_consensus.cc:3037] T 2468da2cb7a946e480822cc2620da7a8 P d093525f85d24b5c8553b86206c34471 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:31.892652 19230 raft_consensus.cc:2454] T 2468da2cb7a946e480822cc2620da7a8 P d930318e4a9443309ed6c0a9490175c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a945117689c4bd4893b29d15d7acb56 in term 1.
I20260923 17:14:31.892805 19366 raft_consensus.cc:2454] T 2468da2cb7a946e480822cc2620da7a8 P d093525f85d24b5c8553b86206c34471 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2a945117689c4bd4893b29d15d7acb56 in term 1.
I20260923 17:14:31.892944 19439 leader_election.cc:302] T 2468da2cb7a946e480822cc2620da7a8 P 2a945117689c4bd4893b29d15d7acb56 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a945117689c4bd4893b29d15d7acb56, d930318e4a9443309ed6c0a9490175c2; no voters:
I20260923 17:14:31.893356 19592 raft_consensus.cc:2781] T 2468da2cb7a946e480822cc2620da7a8 P 2a945117689c4bd4893b29d15d7acb56 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:14:31.893589 19592 raft_consensus.cc:686] T 2468da2cb7a946e480822cc2620da7a8 P 2a945117689c4bd4893b29d15d7acb56 [term 1 LEADER]: Becoming Leader. State: Replica: 2a945117689c4bd4893b29d15d7acb56, State: Running, Role: LEADER
I20260923 17:14:31.894306 19592 consensus_queue.cc:237] T 2468da2cb7a946e480822cc2620da7a8 P 2a945117689c4bd4893b29d15d7acb56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d093525f85d24b5c8553b86206c34471" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 41891 } } peers { permanent_uuid: "2a945117689c4bd4893b29d15d7acb56" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42203 } } peers { permanent_uuid: "d930318e4a9443309ed6c0a9490175c2" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38289 } }
I20260923 17:14:31.897950 18306 catalog_manager.cc:5495] T 2468da2cb7a946e480822cc2620da7a8 P 2a945117689c4bd4893b29d15d7acb56 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2a945117689c4bd4893b29d15d7acb56 (127.11.229.131). New cstate: current_term: 1 leader_uuid: "2a945117689c4bd4893b29d15d7acb56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d093525f85d24b5c8553b86206c34471" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 41891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a945117689c4bd4893b29d15d7acb56" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42203 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d930318e4a9443309ed6c0a9490175c2" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38289 } health_report { overall_health: UNKNOWN } } }
I20260923 17:14:31.925575 19583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.921925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37252 (local address 127.11.229.131:42203)
0923 17:14:31.922050 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:31.922053 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:31.922066 (+ 13us) server_negotiation.cc:407] Connection header received
0923 17:14:31.922190 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:31.922193 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:31.922350 (+ 157us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:31.922447 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 17:14:31.922706 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.923244 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.924123 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.924367 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.924445 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.924750 (+ 305us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 17:14:31.925174 (+ 424us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 17:14:31.925301 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:31.925414 (+ 113us) server_negotiation.cc:299] Negotiation successful
0923 17:14:31.925464 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260923 17:14:31.931650 19230 raft_consensus.cc:1261] T 2468da2cb7a946e480822cc2620da7a8 P d930318e4a9443309ed6c0a9490175c2 [term 1 FOLLOWER]: Refusing update from remote peer 2a945117689c4bd4893b29d15d7acb56: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:14:31.931651 19366 raft_consensus.cc:1261] T 2468da2cb7a946e480822cc2620da7a8 P d093525f85d24b5c8553b86206c34471 [term 1 FOLLOWER]: Refusing update from remote peer 2a945117689c4bd4893b29d15d7acb56: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:14:31.932478 19592 consensus_queue.cc:1035] T 2468da2cb7a946e480822cc2620da7a8 P 2a945117689c4bd4893b29d15d7acb56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d930318e4a9443309ed6c0a9490175c2" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:14:31.932741 19594 consensus_queue.cc:1035] T 2468da2cb7a946e480822cc2620da7a8 P 2a945117689c4bd4893b29d15d7acb56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d093525f85d24b5c8553b86206c34471" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 41891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:14:31.942896 19598 mvcc.cc:205] Tried to move back new op lower bound from 7332592320224124928 to 7332592320082063360. Current Snapshot: MvccSnapshot[applied={T|T < 7332592320224124928}]
I20260923 17:14:31.947615 19599 mvcc.cc:205] Tried to move back new op lower bound from 7332592320224124928 to 7332592320082063360. Current Snapshot: MvccSnapshot[applied={T|T < 7332592320224124928 or (T in {7332592320224124928})}]
I20260923 17:14:31.951712 18306 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43436:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:14:31.951925 18306 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43436:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:14:31.956471 18306 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 82445899ad234187be57c8b10c01f25a: Sending DeleteTablet for 3 replicas of tablet 2468da2cb7a946e480822cc2620da7a8
I20260923 17:14:31.957283 19347 tablet_service.cc:1514] Processing DeleteTablet for tablet 2468da2cb7a946e480822cc2620da7a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:14:31 UTC) from {username='oryx', principal='oryx/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:49160
I20260923 17:14:31.957271 19485 tablet_service.cc:1514] Processing DeleteTablet for tablet 2468da2cb7a946e480822cc2620da7a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:14:31 UTC) from {username='oryx', principal='oryx/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:37236
I20260923 17:14:31.957948 19210 tablet_service.cc:1514] Processing DeleteTablet for tablet 2468da2cb7a946e480822cc2620da7a8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:14:31 UTC) from {username='oryx', principal='oryx/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:41150
I20260923 17:14:31.958470 19607 tablet_replica.cc:330] T 2468da2cb7a946e480822cc2620da7a8 P d093525f85d24b5c8553b86206c34471: stopping tablet replica
I20260923 17:14:31.958822 19607 raft_consensus.cc:2229] T 2468da2cb7a946e480822cc2620da7a8 P d093525f85d24b5c8553b86206c34471 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:14:31.959175 19607 raft_consensus.cc:2258] T 2468da2cb7a946e480822cc2620da7a8 P d093525f85d24b5c8553b86206c34471 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:14:31.959558 19608 tablet_replica.cc:330] T 2468da2cb7a946e480822cc2620da7a8 P d930318e4a9443309ed6c0a9490175c2: stopping tablet replica
I20260923 17:14:31.960111 19606 tablet_replica.cc:330] T 2468da2cb7a946e480822cc2620da7a8 P 2a945117689c4bd4893b29d15d7acb56: stopping tablet replica
I20260923 17:14:31.960383 19606 raft_consensus.cc:2229] T 2468da2cb7a946e480822cc2620da7a8 P 2a945117689c4bd4893b29d15d7acb56 [term 1 LEADER]: Raft consensus shutting down.
I20260923 17:14:31.960708 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 18278
I20260923 17:14:31.961851 19607 ts_tablet_manager.cc:1905] T 2468da2cb7a946e480822cc2620da7a8 P d093525f85d24b5c8553b86206c34471: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:14:31.962571 19606 raft_consensus.cc:2258] T 2468da2cb7a946e480822cc2620da7a8 P 2a945117689c4bd4893b29d15d7acb56 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:14:31.962738 19608 raft_consensus.cc:2229] T 2468da2cb7a946e480822cc2620da7a8 P d930318e4a9443309ed6c0a9490175c2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:14:31.963084 19608 raft_consensus.cc:2258] T 2468da2cb7a946e480822cc2620da7a8 P d930318e4a9443309ed6c0a9490175c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:14:31.964860 19606 ts_tablet_manager.cc:1905] T 2468da2cb7a946e480822cc2620da7a8 P 2a945117689c4bd4893b29d15d7acb56: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:14:31.964860 19607 ts_tablet_manager.cc:1918] T 2468da2cb7a946e480822cc2620da7a8 P d093525f85d24b5c8553b86206c34471: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 17:14:31.964953 19607 log.cc:1196] T 2468da2cb7a946e480822cc2620da7a8 P d093525f85d24b5c8553b86206c34471: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-1/wal/wals/2468da2cb7a946e480822cc2620da7a8
I20260923 17:14:31.965304 19607 ts_tablet_manager.cc:1939] T 2468da2cb7a946e480822cc2620da7a8 P d093525f85d24b5c8553b86206c34471: Deleting consensus metadata
I20260923 17:14:31.968791 19608 ts_tablet_manager.cc:1905] T 2468da2cb7a946e480822cc2620da7a8 P d930318e4a9443309ed6c0a9490175c2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:14:31.970141 19606 ts_tablet_manager.cc:1918] T 2468da2cb7a946e480822cc2620da7a8 P 2a945117689c4bd4893b29d15d7acb56: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 17:14:31.970495 19606 log.cc:1196] T 2468da2cb7a946e480822cc2620da7a8 P 2a945117689c4bd4893b29d15d7acb56: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-2/wal/wals/2468da2cb7a946e480822cc2620da7a8
I20260923 17:14:31.971199 19606 ts_tablet_manager.cc:1939] T 2468da2cb7a946e480822cc2620da7a8 P 2a945117689c4bd4893b29d15d7acb56: Deleting consensus metadata
W20260923 17:14:31.971293 19303 connection.cc:535] server connection from 127.0.0.1:49160 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260923 17:14:31.972617 19441 connection.cc:441] server connection from 127.0.0.1:37236 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37236 (request call id 1) could send its response
I20260923 17:14:31.974826 19608 ts_tablet_manager.cc:1918] T 2468da2cb7a946e480822cc2620da7a8 P d930318e4a9443309ed6c0a9490175c2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 17:14:31.974959 19608 log.cc:1196] T 2468da2cb7a946e480822cc2620da7a8 P d930318e4a9443309ed6c0a9490175c2: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-0/wal/wals/2468da2cb7a946e480822cc2620da7a8
I20260923 17:14:31.975340 19608 ts_tablet_manager.cc:1939] T 2468da2cb7a946e480822cc2620da7a8 P d930318e4a9443309ed6c0a9490175c2: Deleting consensus metadata
W20260923 17:14:31.977070 19166 connection.cc:441] server connection from 127.0.0.1:41150 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41150 (request call id 1) could send its response
I20260923 17:14:31.984331 19033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.959358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34364 (local address 127.11.229.189:44707)
0923 17:14:31.959501 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:31.959506 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:31.965427 (+ 5921us) server_negotiation.cc:407] Connection header received
0923 17:14:31.972546 (+ 7119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:31.972551 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:31.972633 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:31.972706 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:31.974325 (+ 1619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.975268 (+ 943us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.976792 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.977178 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.977259 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.979706 (+ 2447us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:31.979710 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:31.979713 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:31.979740 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:31.981649 (+ 1909us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:31.982168 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:31.982172 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:31.982174 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:31.982305 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:31.982652 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:31.982658 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:31.982661 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:31.982886 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:31.983466 (+ 580us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:31.983914 (+ 448us) server_negotiation.cc:299] Negotiation successful
0923 17:14:31.984054 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260923 17:14:31.990787 19564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.977039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34372 (local address 127.11.229.189:44707)
0923 17:14:31.977171 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:31.977176 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:31.977860 (+ 684us) server_negotiation.cc:407] Connection header received
0923 17:14:31.978030 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:31.978034 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:31.978081 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:31.978136 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:31.979362 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.980237 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.981798 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.982193 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.982309 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.985603 (+ 3294us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:31.985607 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:31.985609 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:31.985636 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:31.988447 (+ 2811us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:31.989113 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:31.989117 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:31.989119 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:31.989219 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:31.989585 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:31.989588 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:31.989591 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:31.989809 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:31.989922 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:31.990468 (+ 546us) server_negotiation.cc:299] Negotiation successful
0923 17:14:31.990606 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260923 17:14:31.990787 19566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.976411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54946 (local address 127.11.229.188:35815)
0923 17:14:31.976540 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:31.976545 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:31.977766 (+ 1221us) server_negotiation.cc:407] Connection header received
0923 17:14:31.977981 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:31.977986 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:31.978045 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:31.978106 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:31.979347 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.980239 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.981798 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.982201 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.982309 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.985670 (+ 3361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:31.985676 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:31.985682 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:31.985711 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:31.988410 (+ 2699us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:31.989113 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:31.989117 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:31.989119 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:31.989210 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:31.989585 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:31.989588 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:31.989591 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:31.989809 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:31.989922 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:31.990468 (+ 546us) server_negotiation.cc:299] Negotiation successful
0923 17:14:31.990606 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260923 17:14:31.995590 19283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:31.959988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54936 (local address 127.11.229.188:35815)
0923 17:14:31.960103 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:31.960108 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:31.984334 (+ 24226us) server_negotiation.cc:407] Connection header received
0923 17:14:31.985196 (+ 862us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:31.985200 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:31.985254 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:31.985311 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:31.986132 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.987168 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.988436 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:31.988829 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:31.988908 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:31.990698 (+ 1790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:31.990702 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:31.990705 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:31.990731 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:31.993025 (+ 2294us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:31.993547 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:31.993551 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:31.993553 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:31.993649 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:31.994050 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:31.994055 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:31.994056 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:31.994635 (+ 579us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:31.994843 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:31.995159 (+ 316us) server_negotiation.cc:299] Negotiation successful
0923 17:14:31.995360 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260923 17:14:32.948266 19617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:32.946988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:33923 (local address 127.11.229.129:35913)
0923 17:14:32.947487 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:32.948136 (+ 649us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:33923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":139,"threads_started":1}
W20260923 17:14:32.948715 19277 heartbeater.cc:644] Failed to heartbeat to 127.11.229.190:33923 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.229.190:33923: connect: Connection refused (error 111)
I20260923 17:14:32.949337 19618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:32.947962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:33923 (local address 127.11.229.130:59859)
0923 17:14:32.949153 (+ 1191us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:32.949240 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:33923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1106,"thread_start_us":66,"threads_started":1}
I20260923 17:14:32.949642 19619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:32.949137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:33923 (local address 127.11.229.131:54081)
0923 17:14:32.949464 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:32.949543 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:33923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":67,"threads_started":1}
W20260923 17:14:32.949692 19414 heartbeater.cc:644] Failed to heartbeat to 127.11.229.190:33923 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.229.190:33923: connect: Connection refused (error 111)
W20260923 17:14:32.949944 19552 heartbeater.cc:644] Failed to heartbeat to 127.11.229.190:33923 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.229.190:33923: connect: Connection refused (error 111)
I20260923 17:14:33.457531 19620 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 82445899ad234187be57c8b10c01f25a)
I20260923 17:14:33.457772 19620 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } } peers { permanent_uuid: "8f4f49faad444410bf28c38f8ae42d2d" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 44707 } attrs { promote: false } } peers { permanent_uuid: "e5713f3a43744bcf8c11a6b6f531f8e2" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 35815 } attrs { promote: false } }
I20260923 17:14:33.458849 19621 raft_consensus.cc:482] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 82445899ad234187be57c8b10c01f25a)
I20260923 17:14:33.458961 19620 leader_election.cc:288] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 82445899ad234187be57c8b10c01f25a (127.11.229.190:33923), e5713f3a43744bcf8c11a6b6f531f8e2 (127.11.229.188:35815)
I20260923 17:14:33.459030 19621 raft_consensus.cc:504] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } } peers { permanent_uuid: "8f4f49faad444410bf28c38f8ae42d2d" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 44707 } attrs { promote: false } } peers { permanent_uuid: "e5713f3a43744bcf8c11a6b6f531f8e2" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 35815 } attrs { promote: false } }
I20260923 17:14:33.459650 19622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:33.459044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:33923 (local address 127.0.0.1:37168)
0923 17:14:33.459434 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:33.459538 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:33923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":66,"threads_started":1}
W20260923 17:14:33.459815 18896 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.229.190:33923: connect: Connection refused (error 111)
I20260923 17:14:33.460708 19627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:33.460183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:33923 (local address 127.0.0.1:37182)
0923 17:14:33.460508 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:33.460613 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:33923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":66,"threads_started":1}
I20260923 17:14:33.460716 19622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:33.460486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:33923 (local address 127.0.0.1:37188)
0923 17:14:33.460623 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:33.460663 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:33923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260923 17:14:33.460742 19621 leader_election.cc:288] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 82445899ad234187be57c8b10c01f25a (127.11.229.190:33923), 8f4f49faad444410bf28c38f8ae42d2d (127.11.229.189:44707)
W20260923 17:14:33.460984 19082 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.229.190:33923: connect: Connection refused (error 111)
W20260923 17:14:33.460976 18896 leader_election.cc:334] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 82445899ad234187be57c8b10c01f25a (127.11.229.190:33923): Network error: Client connection negotiation failed: client connection to 127.11.229.190:33923: connect: Connection refused (error 111)
I20260923 17:14:33.461771 19626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:33.461568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:33923 (local address 127.0.0.1:37196)
0923 17:14:33.461655 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:33.461704 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:33923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260923 17:14:33.461941 19082 leader_election.cc:334] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 82445899ad234187be57c8b10c01f25a (127.11.229.190:33923): Network error: Client connection negotiation failed: client connection to 127.11.229.190:33923: connect: Connection refused (error 111)
I20260923 17:14:33.463953 19623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:33.459361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:35815 (local address 127.0.0.1:44524)
0923 17:14:33.459585 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:33.459597 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:33.459688 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:33.460152 (+ 464us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:33.460158 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:33.460182 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:14:33.460285 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:33.460292 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:33.461365 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:33.461370 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:33.462658 (+ 1288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:33.462668 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:33.463631 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:33.463634 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:33.463717 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:33.463737 (+ 20us) client_negotiation.cc:769] Sending connection context
0923 17:14:33.463799 (+ 62us) client_negotiation.cc:240] Negotiation successful
0923 17:14:33.463855 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":60,"threads_started":1}
I20260923 17:14:33.464008 19624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:33.459515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44524 (local address 127.11.229.188:35815)
0923 17:14:33.459814 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:33.459819 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:33.459833 (+ 14us) server_negotiation.cc:407] Connection header received
0923 17:14:33.459877 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:33.459880 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:33.459924 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:33.460012 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:14:33.460409 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:33.461243 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:33.462774 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:33.463510 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:33.463633 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:33.463681 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:33.463834 (+ 153us) server_negotiation.cc:299] Negotiation successful
0923 17:14:33.463899 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":55,"server-negotiator.queue_time_us":139,"thread_start_us":66,"threads_started":1}
I20260923 17:14:33.464439 19107 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8f4f49faad444410bf28c38f8ae42d2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "e5713f3a43744bcf8c11a6b6f531f8e2" is_pre_election: true
I20260923 17:14:33.464643 19107 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f4f49faad444410bf28c38f8ae42d2d in term 1.
I20260923 17:14:33.464993 18896 leader_election.cc:302] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f4f49faad444410bf28c38f8ae42d2d, e5713f3a43744bcf8c11a6b6f531f8e2; no voters: 82445899ad234187be57c8b10c01f25a
I20260923 17:14:33.465221 19620 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260923 17:14:33.465281 19620 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 82445899ad234187be57c8b10c01f25a)
I20260923 17:14:33.465322 19620 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [term 1 FOLLOWER]: Advancing to term 2
I20260923 17:14:33.465575 19627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:33.460260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.189:44707 (local address 127.0.0.1:58198)
0923 17:14:33.460844 (+ 584us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:33.460858 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:33.460938 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:33.461399 (+ 461us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:33.461402 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:33.461420 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:14:33.461494 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:33.461498 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:33.462774 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:33.462778 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:33.464223 (+ 1445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:33.464231 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:33.465194 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:33.465198 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:33.465326 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:33.465350 (+ 24us) client_negotiation.cc:769] Sending connection context
0923 17:14:33.465424 (+ 74us) client_negotiation.cc:240] Negotiation successful
0923 17:14:33.465489 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":523,"mutex_wait_us":58,"thread_start_us":51,"threads_started":1}
I20260923 17:14:33.465898 19628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:33.460536 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58198 (local address 127.11.229.189:44707)
0923 17:14:33.461167 (+ 631us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:33.461179 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:33.461193 (+ 14us) server_negotiation.cc:407] Connection header received
0923 17:14:33.461232 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:33.461235 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:33.461275 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:33.461391 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:14:33.461608 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:33.462618 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:33.464517 (+ 1899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:33.465037 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:33.465168 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:33.465214 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:33.465750 (+ 536us) server_negotiation.cc:299] Negotiation successful
0923 17:14:33.465818 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":563,"thread_start_us":96,"threads_started":1}
I20260923 17:14:33.466364 18920 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e5713f3a43744bcf8c11a6b6f531f8e2" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "8f4f49faad444410bf28c38f8ae42d2d" is_pre_election: true
I20260923 17:14:33.466753 19620 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } } peers { permanent_uuid: "8f4f49faad444410bf28c38f8ae42d2d" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 44707 } attrs { promote: false } } peers { permanent_uuid: "e5713f3a43744bcf8c11a6b6f531f8e2" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 35815 } attrs { promote: false } }
I20260923 17:14:33.467029 18920 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e5713f3a43744bcf8c11a6b6f531f8e2 in current term 2: Already voted for candidate 8f4f49faad444410bf28c38f8ae42d2d in this term.
I20260923 17:14:33.467172 19620 leader_election.cc:288] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [CANDIDATE]: Term 2 election: Requested vote from peers 82445899ad234187be57c8b10c01f25a (127.11.229.190:33923), e5713f3a43744bcf8c11a6b6f531f8e2 (127.11.229.188:35815)
I20260923 17:14:33.467495 19623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:33.467274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:33923 (local address 127.0.0.1:37210)
0923 17:14:33.467380 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:33.467437 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:33923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260923 17:14:33.467514 19081 leader_election.cc:302] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e5713f3a43744bcf8c11a6b6f531f8e2; no voters: 82445899ad234187be57c8b10c01f25a, 8f4f49faad444410bf28c38f8ae42d2d
I20260923 17:14:33.467624 19107 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8f4f49faad444410bf28c38f8ae42d2d" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "e5713f3a43744bcf8c11a6b6f531f8e2"
I20260923 17:14:33.467717 19107 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2 [term 1 FOLLOWER]: Advancing to term 2
I20260923 17:14:33.468106 19623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:33.467908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:33923 (local address 127.0.0.1:37216)
0923 17:14:33.468008 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:33.468052 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:33923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260923 17:14:33.468196 18896 leader_election.cc:334] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 82445899ad234187be57c8b10c01f25a (127.11.229.190:33923): Network error: Client connection negotiation failed: client connection to 127.11.229.190:33923: connect: Connection refused (error 111)
I20260923 17:14:33.468643 19107 raft_consensus.cc:2454] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f4f49faad444410bf28c38f8ae42d2d in term 2.
I20260923 17:14:33.468741 19621 raft_consensus.cc:2726] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260923 17:14:33.468945 18896 leader_election.cc:302] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8f4f49faad444410bf28c38f8ae42d2d, e5713f3a43744bcf8c11a6b6f531f8e2; no voters: 82445899ad234187be57c8b10c01f25a
I20260923 17:14:33.469215 19620 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [term 2 FOLLOWER]: Leader election won for term 2
I20260923 17:14:33.469465 19620 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [term 2 LEADER]: Becoming Leader. State: Replica: 8f4f49faad444410bf28c38f8ae42d2d, State: Running, Role: LEADER
I20260923 17:14:33.469726 19620 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } } peers { permanent_uuid: "8f4f49faad444410bf28c38f8ae42d2d" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 44707 } attrs { promote: false } } peers { permanent_uuid: "e5713f3a43744bcf8c11a6b6f531f8e2" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 35815 } attrs { promote: false } }
I20260923 17:14:33.470732 19630 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8f4f49faad444410bf28c38f8ae42d2d. Latest consensus state: current_term: 2 leader_uuid: "8f4f49faad444410bf28c38f8ae42d2d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } } peers { permanent_uuid: "8f4f49faad444410bf28c38f8ae42d2d" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 44707 } attrs { promote: false } } peers { permanent_uuid: "e5713f3a43744bcf8c11a6b6f531f8e2" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 35815 } attrs { promote: false } } }
I20260923 17:14:33.470827 19630 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [sys.catalog]: This master's current role is: LEADER
I20260923 17:14:33.471112 19632 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:14:33.473340 19632 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:14:33.473775 19632 catalog_manager.cc:1259] Loaded cluster ID: 2af4a61483ae46e0bded270bd7f86176
I20260923 17:14:33.473819 19632 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:14:33.474460 19632 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:14:33.474856 19632 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d: Loaded TSK: 0
I20260923 17:14:33.475543 19632 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 17:14:33.522302 18911 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34372:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 17:14:33.525534 18911 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 17:14:33.535427 19623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:33.534618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:33923 (local address 127.0.0.1:37242)
0923 17:14:33.535249 (+ 631us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:33.535324 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:33923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":533}
I20260923 17:14:33.535410 19107 raft_consensus.cc:1261] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2 [term 2 FOLLOWER]: Refusing update from remote peer 8f4f49faad444410bf28c38f8ae42d2d: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260923 17:14:33.536089 19620 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5713f3a43744bcf8c11a6b6f531f8e2" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 35815 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260923 17:14:33.536528 19623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:33.536200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:33923 (local address 127.0.0.1:37258)
0923 17:14:33.536405 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:33.536461 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:33923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
W20260923 17:14:33.537211 18896 consensus_peers.cc:487] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d -> Peer 82445899ad234187be57c8b10c01f25a (127.11.229.190:33923): Couldn't send request to peer 82445899ad234187be57c8b10c01f25a. Status: Network error: Client connection negotiation failed: client connection to 127.11.229.190:33923: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260923 17:14:33.540040 19620 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "8f4f49faad444410bf28c38f8ae42d2d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } } peers { permanent_uuid: "8f4f49faad444410bf28c38f8ae42d2d" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 44707 } attrs { promote: false } } peers { permanent_uuid: "e5713f3a43744bcf8c11a6b6f531f8e2" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 35815 } attrs { promote: false } } }
I20260923 17:14:33.540170 19620 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d [sys.catalog]: This master's current role is: LEADER
I20260923 17:14:33.541004 19637 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "8f4f49faad444410bf28c38f8ae42d2d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } } peers { permanent_uuid: "8f4f49faad444410bf28c38f8ae42d2d" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 44707 } attrs { promote: false } } peers { permanent_uuid: "e5713f3a43744bcf8c11a6b6f531f8e2" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 35815 } attrs { promote: false } } }
I20260923 17:14:33.541185 19637 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 17:14:33.538599 19621 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8f4f49faad444410bf28c38f8ae42d2d. Latest consensus state: current_term: 2 leader_uuid: "8f4f49faad444410bf28c38f8ae42d2d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "82445899ad234187be57c8b10c01f25a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33923 } } peers { permanent_uuid: "8f4f49faad444410bf28c38f8ae42d2d" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 44707 } attrs { promote: false } } peers { permanent_uuid: "e5713f3a43744bcf8c11a6b6f531f8e2" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 35815 } attrs { promote: false } } }
I20260923 17:14:33.542804 19621 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5713f3a43744bcf8c11a6b6f531f8e2 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 17:14:33.544222 19634 mvcc.cc:205] Tried to move back new op lower bound from 7332592326772015104 to 7332592326534438912. Current Snapshot: MvccSnapshot[applied={T|T < 7332592326772015104 or (T in {7332592326772015104})}]
I20260923 17:14:33.552857 19640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:33.548391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37546 (local address 127.11.229.129:38289)
0923 17:14:33.548704 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:33.548709 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:33.548723 (+ 14us) server_negotiation.cc:407] Connection header received
0923 17:14:33.548780 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:33.548782 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:33.548855 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:33.548955 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:14:33.549363 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:33.550170 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:33.551570 (+ 1400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:33.552196 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:33.552317 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:33.552373 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:33.552624 (+ 251us) server_negotiation.cc:299] Negotiation successful
0923 17:14:33.552714 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":219,"thread_start_us":102,"threads_started":1}
I20260923 17:14:33.552870 19623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:33.548285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:38289 (local address 127.0.0.1:37546)
0923 17:14:33.548433 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:33.548448 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:33.548526 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:33.548965 (+ 439us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:33.548986 (+ 21us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:33.549005 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:14:33.549122 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:33.549129 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:33.550304 (+ 1175us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:33.550307 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:33.551464 (+ 1157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:33.551473 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:33.552316 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:33.552320 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:33.552486 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:33.552526 (+ 40us) client_negotiation.cc:769] Sending connection context
0923 17:14:33.552608 (+ 82us) client_negotiation.cc:240] Negotiation successful
0923 17:14:33.552724 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":79,"mutex_wait_us":55}
I20260923 17:14:33.553791 19210 tablet_service.cc:1467] Processing CreateTablet for tablet 6725b35d3e5c48bf9866a713d6a12e72 (DEFAULT_TABLE table=test-table [id=d9f6c7f99a00436bb5103b08664b9620]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:14:33.553946 19622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:33.549003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.131:42203 (local address 127.0.0.1:38062)
0923 17:14:33.549271 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:33.549287 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:33.549369 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:33.550011 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:33.550014 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:33.550033 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:14:33.550116 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:33.550121 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:33.551171 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:33.551174 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:33.552459 (+ 1285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:33.552468 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:33.553543 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:33.553555 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:33.553640 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:33.553664 (+ 24us) client_negotiation.cc:769] Sending connection context
0923 17:14:33.553738 (+ 74us) client_negotiation.cc:240] Negotiation successful
0923 17:14:33.553818 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"mutex_wait_us":41}
I20260923 17:14:33.554137 19210 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6725b35d3e5c48bf9866a713d6a12e72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:33.554507 19642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:33.549517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38062 (local address 127.11.229.131:42203)
0923 17:14:33.549765 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:33.549770 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:33.549797 (+ 27us) server_negotiation.cc:407] Connection header received
0923 17:14:33.549850 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:33.549852 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:33.549905 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:33.549985 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:14:33.550264 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:33.551041 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:33.552595 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:33.553206 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:33.553322 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:33.553369 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:33.554269 (+ 900us) server_negotiation.cc:299] Negotiation successful
0923 17:14:33.554370 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":82,"threads_started":1}
I20260923 17:14:33.554993 19485 tablet_service.cc:1467] Processing CreateTablet for tablet 6725b35d3e5c48bf9866a713d6a12e72 (DEFAULT_TABLE table=test-table [id=d9f6c7f99a00436bb5103b08664b9620]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:14:33.555218 19643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:33.549005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.130:41891 (local address 127.0.0.1:39634)
0923 17:14:33.549883 (+ 878us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:33.549897 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:33.549993 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:33.550707 (+ 714us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:33.550710 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:33.550725 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:14:33.550805 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:33.550810 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:33.551819 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:33.551822 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:33.553085 (+ 1263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:33.553094 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:33.554825 (+ 1731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:33.554829 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:33.554911 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:33.554933 (+ 22us) client_negotiation.cc:769] Sending connection context
0923 17:14:33.555002 (+ 69us) client_negotiation.cc:240] Negotiation successful
0923 17:14:33.555077 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":825,"mutex_wait_us":650,"thread_start_us":84,"threads_started":1}
I20260923 17:14:33.555260 19485 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6725b35d3e5c48bf9866a713d6a12e72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:33.555274 19641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:33.549178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39634 (local address 127.11.229.130:41891)
0923 17:14:33.549433 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:33.549437 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:33.550265 (+ 828us) server_negotiation.cc:407] Connection header received
0923 17:14:33.550331 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:33.550336 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:33.550385 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:33.550461 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:14:33.550937 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:33.551685 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:33.553194 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:33.553798 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:33.553920 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:33.553965 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:33.555038 (+ 1073us) server_negotiation.cc:299] Negotiation successful
0923 17:14:33.555147 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":81,"threads_started":1}
I20260923 17:14:33.557060 19644 tablet_bootstrap.cc:492] T 6725b35d3e5c48bf9866a713d6a12e72 P d930318e4a9443309ed6c0a9490175c2: Bootstrap starting.
I20260923 17:14:33.557969 19347 tablet_service.cc:1467] Processing CreateTablet for tablet 6725b35d3e5c48bf9866a713d6a12e72 (DEFAULT_TABLE table=test-table [id=d9f6c7f99a00436bb5103b08664b9620]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:14:33.558084 19644 tablet_bootstrap.cc:654] T 6725b35d3e5c48bf9866a713d6a12e72 P d930318e4a9443309ed6c0a9490175c2: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:33.558298 19347 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6725b35d3e5c48bf9866a713d6a12e72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:33.559392 19644 tablet_bootstrap.cc:492] T 6725b35d3e5c48bf9866a713d6a12e72 P d930318e4a9443309ed6c0a9490175c2: No bootstrap required, opened a new log
I20260923 17:14:33.559559 19644 ts_tablet_manager.cc:1397] T 6725b35d3e5c48bf9866a713d6a12e72 P d930318e4a9443309ed6c0a9490175c2: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260923 17:14:33.560236 19644 raft_consensus.cc:348] T 6725b35d3e5c48bf9866a713d6a12e72 P d930318e4a9443309ed6c0a9490175c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d930318e4a9443309ed6c0a9490175c2" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38289 } } peers { permanent_uuid: "d093525f85d24b5c8553b86206c34471" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 41891 } } peers { permanent_uuid: "2a945117689c4bd4893b29d15d7acb56" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42203 } }
I20260923 17:14:33.560431 19644 raft_consensus.cc:374] T 6725b35d3e5c48bf9866a713d6a12e72 P d930318e4a9443309ed6c0a9490175c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:33.560472 19644 raft_consensus.cc:729] T 6725b35d3e5c48bf9866a713d6a12e72 P d930318e4a9443309ed6c0a9490175c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d930318e4a9443309ed6c0a9490175c2, State: Initialized, Role: FOLLOWER
I20260923 17:14:33.560595 19644 consensus_queue.cc:260] T 6725b35d3e5c48bf9866a713d6a12e72 P d930318e4a9443309ed6c0a9490175c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d930318e4a9443309ed6c0a9490175c2" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38289 } } peers { permanent_uuid: "d093525f85d24b5c8553b86206c34471" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 41891 } } peers { permanent_uuid: "2a945117689c4bd4893b29d15d7acb56" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42203 } }
I20260923 17:14:33.560984 19644 ts_tablet_manager.cc:1428] T 6725b35d3e5c48bf9866a713d6a12e72 P d930318e4a9443309ed6c0a9490175c2: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260923 17:14:33.557730 19645 tablet_bootstrap.cc:492] T 6725b35d3e5c48bf9866a713d6a12e72 P 2a945117689c4bd4893b29d15d7acb56: Bootstrap starting.
I20260923 17:14:33.562031 19649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:33.561587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:33923 (local address 127.11.229.129:48549)
0923 17:14:33.561831 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:33.561898 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:33923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":99,"threads_started":1}
I20260923 17:14:33.562826 19649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:33.562587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:33923 (local address 127.11.229.129:37619)
0923 17:14:33.562704 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:33.562754 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:33923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260923 17:14:33.562906 19645 tablet_bootstrap.cc:654] T 6725b35d3e5c48bf9866a713d6a12e72 P 2a945117689c4bd4893b29d15d7acb56: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:33.564252 19645 tablet_bootstrap.cc:492] T 6725b35d3e5c48bf9866a713d6a12e72 P 2a945117689c4bd4893b29d15d7acb56: No bootstrap required, opened a new log
I20260923 17:14:33.564342 19645 ts_tablet_manager.cc:1397] T 6725b35d3e5c48bf9866a713d6a12e72 P 2a945117689c4bd4893b29d15d7acb56: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260923 17:14:33.564563 19278 heartbeater.cc:503] Master 127.11.229.189:44707 was elected leader, sending a full tablet report...
I20260923 17:14:33.565514 19645 raft_consensus.cc:348] T 6725b35d3e5c48bf9866a713d6a12e72 P 2a945117689c4bd4893b29d15d7acb56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d930318e4a9443309ed6c0a9490175c2" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38289 } } peers { permanent_uuid: "d093525f85d24b5c8553b86206c34471" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 41891 } } peers { permanent_uuid: "2a945117689c4bd4893b29d15d7acb56" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42203 } }
I20260923 17:14:33.565634 19645 raft_consensus.cc:374] T 6725b35d3e5c48bf9866a713d6a12e72 P 2a945117689c4bd4893b29d15d7acb56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:33.565680 19645 raft_consensus.cc:729] T 6725b35d3e5c48bf9866a713d6a12e72 P 2a945117689c4bd4893b29d15d7acb56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a945117689c4bd4893b29d15d7acb56, State: Initialized, Role: FOLLOWER
I20260923 17:14:33.565821 19645 consensus_queue.cc:260] T 6725b35d3e5c48bf9866a713d6a12e72 P 2a945117689c4bd4893b29d15d7acb56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d930318e4a9443309ed6c0a9490175c2" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38289 } } peers { permanent_uuid: "d093525f85d24b5c8553b86206c34471" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 41891 } } peers { permanent_uuid: "2a945117689c4bd4893b29d15d7acb56" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42203 } }
I20260923 17:14:33.566553 19648 tablet_bootstrap.cc:492] T 6725b35d3e5c48bf9866a713d6a12e72 P d093525f85d24b5c8553b86206c34471: Bootstrap starting.
I20260923 17:14:33.566934 19652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:33.566532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:33923 (local address 127.11.229.131:43655)
0923 17:14:33.566776 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:33.566842 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:33923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":95,"threads_started":1}
I20260923 17:14:33.566968 19645 ts_tablet_manager.cc:1428] T 6725b35d3e5c48bf9866a713d6a12e72 P 2a945117689c4bd4893b29d15d7acb56: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260923 17:14:33.567606 19652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:33.567384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:33923 (local address 127.11.229.131:55389)
0923 17:14:33.567475 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:33.567518 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:33923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260923 17:14:33.567868 19553 heartbeater.cc:503] Master 127.11.229.189:44707 was elected leader, sending a full tablet report...
I20260923 17:14:33.569517 19648 tablet_bootstrap.cc:654] T 6725b35d3e5c48bf9866a713d6a12e72 P d093525f85d24b5c8553b86206c34471: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:33.572955 19648 tablet_bootstrap.cc:492] T 6725b35d3e5c48bf9866a713d6a12e72 P d093525f85d24b5c8553b86206c34471: No bootstrap required, opened a new log
I20260923 17:14:33.573069 19648 ts_tablet_manager.cc:1397] T 6725b35d3e5c48bf9866a713d6a12e72 P d093525f85d24b5c8553b86206c34471: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s
I20260923 17:14:33.573599 19648 raft_consensus.cc:348] T 6725b35d3e5c48bf9866a713d6a12e72 P d093525f85d24b5c8553b86206c34471 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d930318e4a9443309ed6c0a9490175c2" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38289 } } peers { permanent_uuid: "d093525f85d24b5c8553b86206c34471" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 41891 } } peers { permanent_uuid: "2a945117689c4bd4893b29d15d7acb56" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42203 } }
I20260923 17:14:33.573742 19648 raft_consensus.cc:374] T 6725b35d3e5c48bf9866a713d6a12e72 P d093525f85d24b5c8553b86206c34471 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:33.573784 19648 raft_consensus.cc:729] T 6725b35d3e5c48bf9866a713d6a12e72 P d093525f85d24b5c8553b86206c34471 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d093525f85d24b5c8553b86206c34471, State: Initialized, Role: FOLLOWER
I20260923 17:14:33.573935 19648 consensus_queue.cc:260] T 6725b35d3e5c48bf9866a713d6a12e72 P d093525f85d24b5c8553b86206c34471 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d930318e4a9443309ed6c0a9490175c2" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38289 } } peers { permanent_uuid: "d093525f85d24b5c8553b86206c34471" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 41891 } } peers { permanent_uuid: "2a945117689c4bd4893b29d15d7acb56" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42203 } }
I20260923 17:14:33.574307 19648 ts_tablet_manager.cc:1428] T 6725b35d3e5c48bf9866a713d6a12e72 P d093525f85d24b5c8553b86206c34471: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260923 17:14:33.574406 19647 raft_consensus.cc:482] T 6725b35d3e5c48bf9866a713d6a12e72 P d930318e4a9443309ed6c0a9490175c2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 17:14:33.574525 19647 raft_consensus.cc:504] T 6725b35d3e5c48bf9866a713d6a12e72 P d930318e4a9443309ed6c0a9490175c2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d930318e4a9443309ed6c0a9490175c2" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38289 } } peers { permanent_uuid: "d093525f85d24b5c8553b86206c34471" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 41891 } } peers { permanent_uuid: "2a945117689c4bd4893b29d15d7acb56" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42203 } }
I20260923 17:14:33.575191 19655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:33.574751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:33923 (local address 127.11.229.130:48891)
0923 17:14:33.575004 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:33.575070 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:33923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":103,"threads_started":1}
I20260923 17:14:33.575843 19647 leader_election.cc:288] T 6725b35d3e5c48bf9866a713d6a12e72 P d930318e4a9443309ed6c0a9490175c2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d093525f85d24b5c8553b86206c34471 (127.11.229.130:41891), 2a945117689c4bd4893b29d15d7acb56 (127.11.229.131:42203)
W20260923 17:14:33.576175 19279 tablet.cc:2369] T 6725b35d3e5c48bf9866a713d6a12e72 P d930318e4a9443309ed6c0a9490175c2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 17:14:33.576931 19655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:33.576708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:33923 (local address 127.11.229.130:38757)
0923 17:14:33.576818 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:33.576867 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:33923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260923 17:14:33.581287 19649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:33.575956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.130:41891 (local address 127.11.229.129:59307)
0923 17:14:33.576182 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:33.576198 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:33.576291 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:33.576835 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:33.576840 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:33.576865 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:14:33.576991 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:33.577001 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:33.578748 (+ 1747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:33.578754 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:33.579967 (+ 1213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:33.579979 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:33.580804 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:33.580808 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:33.580915 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:33.581001 (+ 86us) client_negotiation.cc:769] Sending connection context
0923 17:14:33.581075 (+ 74us) client_negotiation.cc:240] Negotiation successful
0923 17:14:33.581173 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"mutex_wait_us":52}
I20260923 17:14:33.581284 19642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:33.576334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:59039 (local address 127.11.229.131:42203)
0923 17:14:33.576813 (+ 479us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:33.576817 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:33.577051 (+ 234us) server_negotiation.cc:407] Connection header received
0923 17:14:33.577249 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:33.577253 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:33.577301 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:33.577381 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:14:33.577655 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:33.578416 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:33.580080 (+ 1664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:33.580655 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:33.580731 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:33.580769 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:33.581089 (+ 320us) server_negotiation.cc:299] Negotiation successful
0923 17:14:33.581163 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":394}
I20260923 17:14:33.581303 19641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:33.576219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:59307 (local address 127.11.229.130:41891)
0923 17:14:33.576460 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:33.576466 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:33.576481 (+ 15us) server_negotiation.cc:407] Connection header received
0923 17:14:33.576524 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:33.576527 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:33.576569 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:33.576645 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:14:33.577123 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:33.577935 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:33.580119 (+ 2184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:33.580645 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:33.580787 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:33.580838 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:33.581140 (+ 302us) server_negotiation.cc:299] Negotiation successful
0923 17:14:33.581212 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162}
I20260923 17:14:33.581470 19415 heartbeater.cc:503] Master 127.11.229.189:44707 was elected leader, sending a full tablet report...
I20260923 17:14:33.582154 19656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:33.576149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.131:42203 (local address 127.11.229.129:59039)
0923 17:14:33.576969 (+ 820us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:33.576982 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:33.577121 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:33.577392 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:33.577395 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:33.577410 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:14:33.577536 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:33.577542 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:33.578545 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:33.578551 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:33.579922 (+ 1371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:33.579937 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:33.580845 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:33.580848 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:33.580942 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:33.580985 (+ 43us) client_negotiation.cc:769] Sending connection context
0923 17:14:33.581074 (+ 89us) client_negotiation.cc:240] Negotiation successful
0923 17:14:33.582008 (+ 934us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":760,"mutex_wait_us":92,"thread_start_us":80,"threads_started":1}
I20260923 17:14:33.582692 19505 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6725b35d3e5c48bf9866a713d6a12e72" candidate_uuid: "d930318e4a9443309ed6c0a9490175c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a945117689c4bd4893b29d15d7acb56" is_pre_election: true
I20260923 17:14:33.582859 19366 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6725b35d3e5c48bf9866a713d6a12e72" candidate_uuid: "d930318e4a9443309ed6c0a9490175c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d093525f85d24b5c8553b86206c34471" is_pre_election: true
I20260923 17:14:33.582943 19505 raft_consensus.cc:2454] T 6725b35d3e5c48bf9866a713d6a12e72 P 2a945117689c4bd4893b29d15d7acb56 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d930318e4a9443309ed6c0a9490175c2 in term 0.
I20260923 17:14:33.582971 19366 raft_consensus.cc:2454] T 6725b35d3e5c48bf9866a713d6a12e72 P d093525f85d24b5c8553b86206c34471 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d930318e4a9443309ed6c0a9490175c2 in term 0.
I20260923 17:14:33.583392 19165 leader_election.cc:302] T 6725b35d3e5c48bf9866a713d6a12e72 P d930318e4a9443309ed6c0a9490175c2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2a945117689c4bd4893b29d15d7acb56, d093525f85d24b5c8553b86206c34471, d930318e4a9443309ed6c0a9490175c2; no voters:
I20260923 17:14:33.583631 19647 raft_consensus.cc:2781] T 6725b35d3e5c48bf9866a713d6a12e72 P d930318e4a9443309ed6c0a9490175c2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 17:14:33.583706 19647 raft_consensus.cc:482] T 6725b35d3e5c48bf9866a713d6a12e72 P d930318e4a9443309ed6c0a9490175c2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 17:14:33.583760 19647 raft_consensus.cc:3037] T 6725b35d3e5c48bf9866a713d6a12e72 P d930318e4a9443309ed6c0a9490175c2 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:33.584774 19647 raft_consensus.cc:504] T 6725b35d3e5c48bf9866a713d6a12e72 P d930318e4a9443309ed6c0a9490175c2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d930318e4a9443309ed6c0a9490175c2" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38289 } } peers { permanent_uuid: "d093525f85d24b5c8553b86206c34471" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 41891 } } peers { permanent_uuid: "2a945117689c4bd4893b29d15d7acb56" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42203 } }
I20260923 17:14:33.585178 19647 leader_election.cc:288] T 6725b35d3e5c48bf9866a713d6a12e72 P d930318e4a9443309ed6c0a9490175c2 [CANDIDATE]: Term 1 election: Requested vote from peers d093525f85d24b5c8553b86206c34471 (127.11.229.130:41891), 2a945117689c4bd4893b29d15d7acb56 (127.11.229.131:42203)
I20260923 17:14:33.585511 19366 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6725b35d3e5c48bf9866a713d6a12e72" candidate_uuid: "d930318e4a9443309ed6c0a9490175c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d093525f85d24b5c8553b86206c34471"
I20260923 17:14:33.585632 19366 raft_consensus.cc:3037] T 6725b35d3e5c48bf9866a713d6a12e72 P d093525f85d24b5c8553b86206c34471 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:33.585624 19505 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6725b35d3e5c48bf9866a713d6a12e72" candidate_uuid: "d930318e4a9443309ed6c0a9490175c2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a945117689c4bd4893b29d15d7acb56"
I20260923 17:14:33.585765 19505 raft_consensus.cc:3037] T 6725b35d3e5c48bf9866a713d6a12e72 P 2a945117689c4bd4893b29d15d7acb56 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:33.586695 19366 raft_consensus.cc:2454] T 6725b35d3e5c48bf9866a713d6a12e72 P d093525f85d24b5c8553b86206c34471 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d930318e4a9443309ed6c0a9490175c2 in term 1.
I20260923 17:14:33.587001 19164 leader_election.cc:302] T 6725b35d3e5c48bf9866a713d6a12e72 P d930318e4a9443309ed6c0a9490175c2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d093525f85d24b5c8553b86206c34471, d930318e4a9443309ed6c0a9490175c2; no voters:
I20260923 17:14:33.587118 19505 raft_consensus.cc:2454] T 6725b35d3e5c48bf9866a713d6a12e72 P 2a945117689c4bd4893b29d15d7acb56 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d930318e4a9443309ed6c0a9490175c2 in term 1.
I20260923 17:14:33.587221 19647 raft_consensus.cc:2781] T 6725b35d3e5c48bf9866a713d6a12e72 P d930318e4a9443309ed6c0a9490175c2 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:14:33.587430 19647 raft_consensus.cc:686] T 6725b35d3e5c48bf9866a713d6a12e72 P d930318e4a9443309ed6c0a9490175c2 [term 1 LEADER]: Becoming Leader. State: Replica: d930318e4a9443309ed6c0a9490175c2, State: Running, Role: LEADER
I20260923 17:14:33.587697 19647 consensus_queue.cc:237] T 6725b35d3e5c48bf9866a713d6a12e72 P d930318e4a9443309ed6c0a9490175c2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d930318e4a9443309ed6c0a9490175c2" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38289 } } peers { permanent_uuid: "d093525f85d24b5c8553b86206c34471" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 41891 } } peers { permanent_uuid: "2a945117689c4bd4893b29d15d7acb56" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42203 } }
I20260923 17:14:33.588081 19656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:33.587851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:33923 (local address 127.11.229.129:44343)
0923 17:14:33.587953 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:33.588007 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:33923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260923 17:14:33.590029 18911 catalog_manager.cc:5495] T 6725b35d3e5c48bf9866a713d6a12e72 P d930318e4a9443309ed6c0a9490175c2 reported cstate change: term changed from 0 to 1, leader changed from <none> to d930318e4a9443309ed6c0a9490175c2 (127.11.229.129). New cstate: current_term: 1 leader_uuid: "d930318e4a9443309ed6c0a9490175c2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d930318e4a9443309ed6c0a9490175c2" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d093525f85d24b5c8553b86206c34471" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 41891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a945117689c4bd4893b29d15d7acb56" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42203 } health_report { overall_health: UNKNOWN } } }
I20260923 17:14:33.606887 19640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:33.602385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37560 (local address 127.11.229.129:38289)
0923 17:14:33.602532 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:33.602538 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:33.602554 (+ 16us) server_negotiation.cc:407] Connection header received
0923 17:14:33.602742 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:33.602745 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:33.602821 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:33.602929 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 17:14:33.603167 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:33.603874 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:33.605041 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:33.605287 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:33.605599 (+ 312us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:33.605909 (+ 310us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 17:14:33.606471 (+ 562us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 17:14:33.606592 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:33.606666 (+ 74us) server_negotiation.cc:299] Negotiation successful
0923 17:14:33.606734 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260923 17:14:33.609648 19366 raft_consensus.cc:1261] T 6725b35d3e5c48bf9866a713d6a12e72 P d093525f85d24b5c8553b86206c34471 [term 1 FOLLOWER]: Refusing update from remote peer d930318e4a9443309ed6c0a9490175c2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:14:33.609884 19505 raft_consensus.cc:1261] T 6725b35d3e5c48bf9866a713d6a12e72 P 2a945117689c4bd4893b29d15d7acb56 [term 1 FOLLOWER]: Refusing update from remote peer d930318e4a9443309ed6c0a9490175c2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:14:33.610205 19657 consensus_queue.cc:1035] T 6725b35d3e5c48bf9866a713d6a12e72 P d930318e4a9443309ed6c0a9490175c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d093525f85d24b5c8553b86206c34471" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 41891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:14:33.610551 19647 consensus_queue.cc:1035] T 6725b35d3e5c48bf9866a713d6a12e72 P d930318e4a9443309ed6c0a9490175c2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a945117689c4bd4893b29d15d7acb56" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:14:33.612322 19655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:33.612022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:33923 (local address 127.11.229.130:58919)
0923 17:14:33.612179 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:33.612236 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:33923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260923 17:14:33.612576 19652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:33.612285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:33923 (local address 127.11.229.131:59453)
0923 17:14:33.612455 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:33.612510 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:33923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
I20260923 17:14:33.614779 19656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:33.614370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:33923 (local address 127.11.229.129:39391)
0923 17:14:33.614628 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:33.614692 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:33923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175}
I20260923 17:14:33.617715 19655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:33.615671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:33923 (local address 127.11.229.130:56569)
0923 17:14:33.617569 (+ 1898us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:33.617630 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:33923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1825}
I20260923 17:14:33.617899 19656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:33.617584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:33923 (local address 127.11.229.129:46197)
0923 17:14:33.617770 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:33.617826 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:33923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127}
I20260923 17:14:33.618024 19663 mvcc.cc:205] Tried to move back new op lower bound from 7332592327100076032 to 7332592327017836544. Current Snapshot: MvccSnapshot[applied={T|T < 7332592327100076032}]
I20260923 17:14:33.620432 19652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:33.620177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:33923 (local address 127.11.229.131:38495)
0923 17:14:33.620299 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:33.620355 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:33923: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260923 17:14:33.625679 18911 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34372:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:14:33.625875 18911 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34372:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:14:33.629896 18911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8f4f49faad444410bf28c38f8ae42d2d: Sending DeleteTablet for 3 replicas of tablet 6725b35d3e5c48bf9866a713d6a12e72
I20260923 17:14:33.630698 19210 tablet_service.cc:1514] Processing DeleteTablet for tablet 6725b35d3e5c48bf9866a713d6a12e72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:14:33 UTC) from {username='oryx', principal='oryx/127.11.229.189@KRBTEST.COM'} at 127.0.0.1:37546
I20260923 17:14:33.630884 19485 tablet_service.cc:1514] Processing DeleteTablet for tablet 6725b35d3e5c48bf9866a713d6a12e72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:14:33 UTC) from {username='oryx', principal='oryx/127.11.229.189@KRBTEST.COM'} at 127.0.0.1:38062
I20260923 17:14:33.631038 19347 tablet_service.cc:1514] Processing DeleteTablet for tablet 6725b35d3e5c48bf9866a713d6a12e72 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:14:33 UTC) from {username='oryx', principal='oryx/127.11.229.189@KRBTEST.COM'} at 127.0.0.1:39634
I20260923 17:14:33.631278 19671 tablet_replica.cc:330] T 6725b35d3e5c48bf9866a713d6a12e72 P 2a945117689c4bd4893b29d15d7acb56: stopping tablet replica
I20260923 17:14:33.631402 19670 tablet_replica.cc:330] T 6725b35d3e5c48bf9866a713d6a12e72 P d930318e4a9443309ed6c0a9490175c2: stopping tablet replica
I20260923 17:14:33.631429 19671 raft_consensus.cc:2229] T 6725b35d3e5c48bf9866a713d6a12e72 P 2a945117689c4bd4893b29d15d7acb56 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:14:33.631445 19672 tablet_replica.cc:330] T 6725b35d3e5c48bf9866a713d6a12e72 P d093525f85d24b5c8553b86206c34471: stopping tablet replica
I20260923 17:14:33.631531 19670 raft_consensus.cc:2229] T 6725b35d3e5c48bf9866a713d6a12e72 P d930318e4a9443309ed6c0a9490175c2 [term 1 LEADER]: Raft consensus shutting down.
I20260923 17:14:33.631588 19671 raft_consensus.cc:2258] T 6725b35d3e5c48bf9866a713d6a12e72 P 2a945117689c4bd4893b29d15d7acb56 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:14:33.631713 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 19055
I20260923 17:14:33.631851 19670 raft_consensus.cc:2258] T 6725b35d3e5c48bf9866a713d6a12e72 P d930318e4a9443309ed6c0a9490175c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:14:33.632539 19672 raft_consensus.cc:2229] T 6725b35d3e5c48bf9866a713d6a12e72 P d093525f85d24b5c8553b86206c34471 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:14:33.632880 19671 ts_tablet_manager.cc:1905] T 6725b35d3e5c48bf9866a713d6a12e72 P 2a945117689c4bd4893b29d15d7acb56: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:14:33.633002 19672 raft_consensus.cc:2258] T 6725b35d3e5c48bf9866a713d6a12e72 P d093525f85d24b5c8553b86206c34471 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:14:33.633805 19672 ts_tablet_manager.cc:1905] T 6725b35d3e5c48bf9866a713d6a12e72 P d093525f85d24b5c8553b86206c34471: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:14:33.635938 19671 ts_tablet_manager.cc:1918] T 6725b35d3e5c48bf9866a713d6a12e72 P 2a945117689c4bd4893b29d15d7acb56: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 17:14:33.636034 19671 log.cc:1196] T 6725b35d3e5c48bf9866a713d6a12e72 P 2a945117689c4bd4893b29d15d7acb56: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-2/wal/wals/6725b35d3e5c48bf9866a713d6a12e72
I20260923 17:14:33.636346 19671 ts_tablet_manager.cc:1939] T 6725b35d3e5c48bf9866a713d6a12e72 P 2a945117689c4bd4893b29d15d7acb56: Deleting consensus metadata
I20260923 17:14:33.636930 19672 ts_tablet_manager.cc:1918] T 6725b35d3e5c48bf9866a713d6a12e72 P d093525f85d24b5c8553b86206c34471: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 17:14:33.637018 19672 log.cc:1196] T 6725b35d3e5c48bf9866a713d6a12e72 P d093525f85d24b5c8553b86206c34471: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790183633736342-12182-0/minicluster-data/ts-1/wal/wals/6725b35d3e5c48bf9866a713d6a12e72
I20260923 17:14:33.637326 19672 ts_tablet_manager.cc:1939] T 6725b35d3e5c48bf9866a713d6a12e72 P d093525f85d24b5c8553b86206c34471: Deleting consensus metadata
I20260923 17:14:33.637315 18897 catalog_manager.cc:4841] TS 2a945117689c4bd4893b29d15d7acb56 (127.11.229.131:42203): tablet 6725b35d3e5c48bf9866a713d6a12e72 (table test-table [id=d9f6c7f99a00436bb5103b08664b9620]) successfully deleted
I20260923 17:14:33.638345 18896 catalog_manager.cc:4841] TS d093525f85d24b5c8553b86206c34471 (127.11.229.130:41891): tablet 6725b35d3e5c48bf9866a713d6a12e72 (table test-table [id=d9f6c7f99a00436bb5103b08664b9620]) successfully deleted
I20260923 17:14:33.639878 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 19284
I20260923 17:14:33.640092 19643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:33.639780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:38289 (local address 127.0.0.1:37564)
0923 17:14:33.639928 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:33.639994 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.129:38289: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260923 17:14:33.640628 18896 catalog_manager.cc:4584] TS d930318e4a9443309ed6c0a9490175c2 (127.11.229.129:38289): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6725b35d3e5c48bf9866a713d6a12e72: Network error: Client connection negotiation failed: client connection to 127.11.229.129:38289: connect: Connection refused (error 111)
I20260923 17:14:33.646767 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 19420
I20260923 17:14:33.653295 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 18774
I20260923 17:14:33.659411 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 18877
2026-09-23T17:14:33Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (5427 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 17:14:33 dist-test-slave-1x1f krb5kdc[19675](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 17:14:33 dist-test-slave-1x1f krb5kdc[19675](info): set up 2 sockets
Sep 23 17:14:33 dist-test-slave-1x1f krb5kdc[19675](info): commencing operation
krb5kdc: starting...
W20260923 17:14:34.787561 12182 mini_kdc.cc:121] Time spent starting KDC: real 1.102s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Sep 23 17:14:34 dist-test-slave-1x1f krb5kdc[19675](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183674, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T17:14:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:14:34Z Disabled control of system clock
WARNING: no policy specified for oryx/127.11.229.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.229.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.229.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.190.keytab.
Entry for principal oryx/127.11.229.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.190.keytab.
I20260923 17:14:34.918309 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:38787
--webserver_interface=127.11.229.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.190.keytab
--principal=oryx/127.11.229.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:37205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:38787
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:14:35.032977 19688 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:35.033311 19688 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:35.033386 19688 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:35.037524 19688 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:14:35.037618 19688 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260923 17:14:35.037649 19688 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:35.037680 19688 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:35.037720 19688 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:14:35.037752 19688 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:14:35.043239 19688 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:37205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:38787
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.190.keytab
--principal=oryx/127.11.229.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:38787
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.229.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19688
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:35.044368 19688 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:35.045426 19688 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:35.054983 19693 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:35.054987 19696 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:35.054987 19694 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:35.055430 19688 server_base.cc:1034] running on GCE node
I20260923 17:14:35.056529 19688 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:35.058305 19688 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:35.059553 19688 hybrid_clock.cc:648] HybridClock initialized: now 1790183675059522 us; error 47 us; skew 500 ppm
Sep 23 17:14:35 dist-test-slave-1x1f krb5kdc[19675](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183675, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.229.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:35.062510 19688 init.cc:377] Logged in from keytab as oryx/127.11.229.190@KRBTEST.COM (short username oryx)
I20260923 17:14:35.063524 19688 webserver.cc:460] Webserver started at http://127.11.229.190:46631/ using document root <none> and password file <none>
I20260923 17:14:35.064154 19688 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:35.064248 19688 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:35.064486 19688 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:35.066634 19688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "ad4a043a0e6c49429daa823bd4a05146"
format_stamp: "Formatted at 2026-09-23 17:14:35 on dist-test-slave-1x1f"
server_key: "6c32304044cc198524a5c33ce424bb3e"
server_key_iv: "e340466e04adcb237938b896a21fd2cf"
server_key_version: "encryptionkey@0"
I20260923 17:14:35.067216 19688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "ad4a043a0e6c49429daa823bd4a05146"
format_stamp: "Formatted at 2026-09-23 17:14:35 on dist-test-slave-1x1f"
server_key: "6c32304044cc198524a5c33ce424bb3e"
server_key_iv: "e340466e04adcb237938b896a21fd2cf"
server_key_version: "encryptionkey@0"
I20260923 17:14:35.070967 19688 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260923 17:14:35.073401 19703 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:35.074677 19688 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 17:14:35.074813 19688 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "ad4a043a0e6c49429daa823bd4a05146"
format_stamp: "Formatted at 2026-09-23 17:14:35 on dist-test-slave-1x1f"
server_key: "6c32304044cc198524a5c33ce424bb3e"
server_key_iv: "e340466e04adcb237938b896a21fd2cf"
server_key_version: "encryptionkey@0"
I20260923 17:14:35.074934 19688 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:35.096504 19688 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:35.099859 19688 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:35.100065 19688 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:35.108747 19688 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.190:38787
I20260923 17:14:35.108764 19765 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.190:38787 every 8 connection(s)
I20260923 17:14:35.109690 19688 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:14:35.112654 19766 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:35.115490 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 19688
I20260923 17:14:35.115633 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:14:35.115959 12182 external_mini_cluster.cc:1428] Setting key 46181a6a6ee633af0e8fe916ce0e9114
I20260923 17:14:35.119185 19766 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad4a043a0e6c49429daa823bd4a05146: Bootstrap starting.
I20260923 17:14:35.121778 19766 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ad4a043a0e6c49429daa823bd4a05146: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:35.122706 19766 log.cc:824] T 00000000000000000000000000000000 P ad4a043a0e6c49429daa823bd4a05146: Log is configured to *not* fsync() on all Append() calls
I20260923 17:14:35.125008 19766 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad4a043a0e6c49429daa823bd4a05146: No bootstrap required, opened a new log
Sep 23 17:14:35 dist-test-slave-1x1f krb5kdc[19675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183674, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM
I20260923 17:14:35.129604 19766 raft_consensus.cc:348] T 00000000000000000000000000000000 P ad4a043a0e6c49429daa823bd4a05146 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad4a043a0e6c49429daa823bd4a05146" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 38787 } }
I20260923 17:14:35.129900 19766 raft_consensus.cc:374] T 00000000000000000000000000000000 P ad4a043a0e6c49429daa823bd4a05146 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:35.129972 19766 raft_consensus.cc:729] T 00000000000000000000000000000000 P ad4a043a0e6c49429daa823bd4a05146 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad4a043a0e6c49429daa823bd4a05146, State: Initialized, Role: FOLLOWER
I20260923 17:14:35.130493 19766 consensus_queue.cc:260] T 00000000000000000000000000000000 P ad4a043a0e6c49429daa823bd4a05146 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad4a043a0e6c49429daa823bd4a05146" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 38787 } }
I20260923 17:14:35.130642 19766 raft_consensus.cc:388] T 00000000000000000000000000000000 P ad4a043a0e6c49429daa823bd4a05146 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:14:35.130705 19766 raft_consensus.cc:482] T 00000000000000000000000000000000 P ad4a043a0e6c49429daa823bd4a05146 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:14:35.130795 19766 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ad4a043a0e6c49429daa823bd4a05146 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:35.131070 19769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:35.117475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44982 (local address 127.11.229.190:38787)
0923 17:14:35.117890 (+ 415us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:35.117909 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:35.117942 (+ 33us) server_negotiation.cc:407] Connection header received
0923 17:14:35.118621 (+ 679us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:35.118639 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:35.118954 (+ 315us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:35.119282 (+ 328us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:35.120104 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:35.121095 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:35.122049 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:35.122769 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:35.122936 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:35.125730 (+ 2794us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:35.125739 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:35.125759 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:35.125793 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:35.127805 (+ 2012us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:35.128221 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:35.128227 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:35.128234 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:35.128398 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:35.128732 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:35.128736 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:35.128737 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:35.129240 (+ 503us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:35.129425 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:35.129711 (+ 286us) server_negotiation.cc:299] Negotiation successful
0923 17:14:35.130085 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":287,"thread_start_us":124,"threads_started":1}
I20260923 17:14:35.131877 19766 raft_consensus.cc:504] T 00000000000000000000000000000000 P ad4a043a0e6c49429daa823bd4a05146 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad4a043a0e6c49429daa823bd4a05146" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 38787 } }
I20260923 17:14:35.132248 19766 leader_election.cc:302] T 00000000000000000000000000000000 P ad4a043a0e6c49429daa823bd4a05146 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ad4a043a0e6c49429daa823bd4a05146; no voters:
I20260923 17:14:35.132571 19766 leader_election.cc:288] T 00000000000000000000000000000000 P ad4a043a0e6c49429daa823bd4a05146 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 17:14:35.132706 19771 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ad4a043a0e6c49429daa823bd4a05146 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:14:35.132929 19771 raft_consensus.cc:686] T 00000000000000000000000000000000 P ad4a043a0e6c49429daa823bd4a05146 [term 1 LEADER]: Becoming Leader. State: Replica: ad4a043a0e6c49429daa823bd4a05146, State: Running, Role: LEADER
I20260923 17:14:35.133616 19771 consensus_queue.cc:237] T 00000000000000000000000000000000 P ad4a043a0e6c49429daa823bd4a05146 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad4a043a0e6c49429daa823bd4a05146" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 38787 } }
I20260923 17:14:35.133709 19766 sys_catalog.cc:564] T 00000000000000000000000000000000 P ad4a043a0e6c49429daa823bd4a05146 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:14:35.135389 19772 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad4a043a0e6c49429daa823bd4a05146 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ad4a043a0e6c49429daa823bd4a05146" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad4a043a0e6c49429daa823bd4a05146" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 38787 } } }
I20260923 17:14:35.135532 19772 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad4a043a0e6c49429daa823bd4a05146 [sys.catalog]: This master's current role is: LEADER
I20260923 17:14:35.135856 19773 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad4a043a0e6c49429daa823bd4a05146 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ad4a043a0e6c49429daa823bd4a05146. Latest consensus state: current_term: 1 leader_uuid: "ad4a043a0e6c49429daa823bd4a05146" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad4a043a0e6c49429daa823bd4a05146" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 38787 } } }
I20260923 17:14:35.135936 19773 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad4a043a0e6c49429daa823bd4a05146 [sys.catalog]: This master's current role is: LEADER
I20260923 17:14:35.136246 19783 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:14:35.139714 19783 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:14:35.145015 19783 catalog_manager.cc:1347] Generated new cluster ID: 586b32785f2748f69dda36ba6681dbb6
I20260923 17:14:35.145095 19783 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:14:35.158004 19783 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:14:35.158972 19783 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:14:35.166862 19783 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ad4a043a0e6c49429daa823bd4a05146: Generated new TSK 0
I20260923 17:14:35.167709 19783 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.11.229.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.229.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.229.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.129.keytab.
Entry for principal oryx/127.11.229.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.129.keytab.
I20260923 17:14:35.213783 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.129:0
--local_ip_for_outbound_sockets=127.11.229.129
--webserver_interface=127.11.229.129
--webserver_port=0
--tserver_master_addrs=127.11.229.190:38787
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.129.keytab
--principal=oryx/127.11.229.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:37205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:14:35.351164 19792 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:35.351516 19792 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:35.351596 19792 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:35.356151 19792 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:35.356276 19792 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:35.356354 19792 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260923 17:14:35.356436 19792 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.129
I20260923 17:14:35.362130 19792 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:37205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.129.keytab
--principal=oryx/127.11.229.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.229.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.229.190:38787
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19792
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.129
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:35.363358 19792 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:35.364428 19792 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:35.374415 19798 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:35.374478 19792 server_base.cc:1034] running on GCE node
W20260923 17:14:35.374398 19800 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:35.374398 19797 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:35.375003 19792 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:35.375720 19792 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:35.376897 19792 hybrid_clock.cc:648] HybridClock initialized: now 1790183675376870 us; error 42 us; skew 500 ppm
Sep 23 17:14:35 dist-test-slave-1x1f krb5kdc[19675](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183675, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.229.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:35.379993 19792 init.cc:377] Logged in from keytab as oryx/127.11.229.129@KRBTEST.COM (short username oryx)
I20260923 17:14:35.380932 19792 webserver.cc:460] Webserver started at http://127.11.229.129:35857/ using document root <none> and password file <none>
I20260923 17:14:35.381517 19792 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:35.381608 19792 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:35.381850 19792 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:35.384042 19792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-0/data/instance:
uuid: "b476811982d34641b7b980144c756044"
format_stamp: "Formatted at 2026-09-23 17:14:35 on dist-test-slave-1x1f"
server_key: "8911abce5501b022ed8f53d5a9f031a3"
server_key_iv: "b14d5cf77246f79c9400aedd6171283e"
server_key_version: "encryptionkey@0"
I20260923 17:14:35.384647 19792 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance:
uuid: "b476811982d34641b7b980144c756044"
format_stamp: "Formatted at 2026-09-23 17:14:35 on dist-test-slave-1x1f"
server_key: "8911abce5501b022ed8f53d5a9f031a3"
server_key_iv: "b14d5cf77246f79c9400aedd6171283e"
server_key_version: "encryptionkey@0"
I20260923 17:14:35.388518 19792 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260923 17:14:35.391080 19807 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:35.392356 19792 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 17:14:35.392498 19792 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-0/wal
uuid: "b476811982d34641b7b980144c756044"
format_stamp: "Formatted at 2026-09-23 17:14:35 on dist-test-slave-1x1f"
server_key: "8911abce5501b022ed8f53d5a9f031a3"
server_key_iv: "b14d5cf77246f79c9400aedd6171283e"
server_key_version: "encryptionkey@0"
I20260923 17:14:35.392617 19792 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:35.403311 19792 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:35.406486 19792 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:35.406684 19792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:35.408092 19792 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:14:35.408143 19792 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:35.408241 19792 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:14:35.408288 19792 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 23 17:14:35 dist-test-slave-1x1f krb5kdc[19675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183675, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.229.129@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM
I20260923 17:14:35.419239 19792 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.129:45629
I20260923 17:14:35.419358 19922 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.129:45629 every 8 connection(s)
I20260923 17:14:35.420151 19792 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
I20260923 17:14:35.422503 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 19792
I20260923 17:14:35.422659 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance
I20260923 17:14:35.422987 12182 external_mini_cluster.cc:1428] Setting key a33b81e47f2b9a08c7a579ff83da1b89
I20260923 17:14:35.423496 19769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:35.409044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:50573 (local address 127.11.229.190:38787)
0923 17:14:35.409187 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:35.409191 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:35.410221 (+ 1030us) server_negotiation.cc:407] Connection header received
0923 17:14:35.411331 (+ 1110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:35.411334 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:35.411392 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:35.411500 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:35.413046 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:35.413962 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:35.415539 (+ 1577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:35.415917 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:35.416027 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:35.419162 (+ 3135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:35.419165 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:35.419167 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:35.419222 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:35.420981 (+ 1759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:35.421588 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:35.421591 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:35.421592 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:35.421667 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:35.422059 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:35.422062 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:35.422063 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:35.422353 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:35.422451 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:35.423198 (+ 747us) server_negotiation.cc:299] Negotiation successful
0923 17:14:35.423323 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260923 17:14:35.424356 19816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:35.409552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:38787 (local address 127.11.229.129:50573)
0923 17:14:35.410049 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:35.410090 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:35.411089 (+ 999us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:35.411672 (+ 583us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:35.411680 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:35.412226 (+ 546us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:35.412876 (+ 650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:35.412894 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:35.414074 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:35.414095 (+ 21us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:35.415393 (+ 1298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:35.415404 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:35.416246 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:35.416249 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:35.416487 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:35.417132 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:35.417155 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:35.418918 (+ 1763us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:35.421175 (+ 2257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:35.421183 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:35.421200 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:35.421482 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:35.421778 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:35.421780 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:35.421782 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:35.421918 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:35.422478 (+ 560us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:35.422486 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:35.422818 (+ 332us) client_negotiation.cc:769] Sending connection context
0923 17:14:35.423036 (+ 218us) client_negotiation.cc:240] Negotiation successful
0923 17:14:35.423394 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":143,"threads_started":1}
I20260923 17:14:35.425571 19923 heartbeater.cc:347] Connected to a master server at 127.11.229.190:38787
I20260923 17:14:35.425740 19923 heartbeater.cc:464] Registering TS with master...
I20260923 17:14:35.426338 19923 heartbeater.cc:511] Master 127.11.229.190:38787 requested a full tablet report, sending...
I20260923 17:14:35.428063 19719 ts_manager.cc:194] Registered new tserver with Master: b476811982d34641b7b980144c756044 (127.11.229.129:45629)
I20260923 17:14:35.429687 19719 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.229.129@KRBTEST.COM'} at 127.11.229.129:50573
WARNING: no policy specified for oryx/127.11.229.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.229.130@KRBTEST.COM" created.
I20260923 17:14:35.438128 19769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:35.427985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:44133 (local address 127.11.229.190:38787)
0923 17:14:35.428114 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:35.428118 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:35.430650 (+ 2532us) server_negotiation.cc:407] Connection header received
0923 17:14:35.430848 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:35.430852 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:35.430912 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:35.431015 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:35.431528 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:35.432348 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:35.433152 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:35.433541 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:35.433684 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:35.435023 (+ 1339us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:35.435025 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:35.435027 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:35.435047 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:35.436479 (+ 1432us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:35.436907 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:35.436911 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:35.436912 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:35.436986 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:35.437263 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:35.437268 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:35.437270 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:35.437434 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:35.437544 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:35.437908 (+ 364us) server_negotiation.cc:299] Negotiation successful
0923 17:14:35.438007 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260923 17:14:35.438287 19930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:35.427946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:38787 (local address 127.11.229.129:44133)
0923 17:14:35.430537 (+ 2591us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:35.430554 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:35.430695 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:35.431046 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:35.431050 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:35.431278 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:35.431400 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:35.431407 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:35.432478 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:35.432480 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:35.433039 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:35.433047 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:35.433687 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:35.433690 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:35.433784 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:35.434467 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:35.434487 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:35.434906 (+ 419us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:35.436583 (+ 1677us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:35.436587 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:35.436589 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:35.436799 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:35.437075 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:35.437079 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:35.437081 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:35.437166 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:35.437595 (+ 429us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:35.437600 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:35.437710 (+ 110us) client_negotiation.cc:769] Sending connection context
0923 17:14:35.437837 (+ 127us) client_negotiation.cc:240] Negotiation successful
0923 17:14:35.438000 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2496,"thread_start_us":98,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.229.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.130.keytab.
Entry for principal oryx/127.11.229.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.130.keytab.
I20260923 17:14:35.453155 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.130:0
--local_ip_for_outbound_sockets=127.11.229.130
--webserver_interface=127.11.229.130
--webserver_port=0
--tserver_master_addrs=127.11.229.190:38787
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.130.keytab
--principal=oryx/127.11.229.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:37205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:14:35.567767 19932 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:35.568066 19932 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:35.568145 19932 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:35.572230 19932 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:35.572311 19932 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:35.572389 19932 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260923 17:14:35.572484 19932 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.130
I20260923 17:14:35.577831 19932 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:37205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.130.keytab
--principal=oryx/127.11.229.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.229.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.229.190:38787
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19932
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.130
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:35.579206 19932 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:35.580360 19932 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:35.590030 19937 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:35.590054 19938 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:35.590041 19940 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:35.590106 19932 server_base.cc:1034] running on GCE node
I20260923 17:14:35.590672 19932 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:35.591300 19932 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:35.592484 19932 hybrid_clock.cc:648] HybridClock initialized: now 1790183675592477 us; error 32 us; skew 500 ppm
Sep 23 17:14:35 dist-test-slave-1x1f krb5kdc[19675](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183675, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.229.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:35.595244 19932 init.cc:377] Logged in from keytab as oryx/127.11.229.130@KRBTEST.COM (short username oryx)
I20260923 17:14:35.596169 19932 webserver.cc:460] Webserver started at http://127.11.229.130:42913/ using document root <none> and password file <none>
I20260923 17:14:35.596688 19932 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:35.596745 19932 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:35.596904 19932 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:35.599005 19932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-1/data/instance:
uuid: "50bfee15e69e45568301f1c244c3c22f"
format_stamp: "Formatted at 2026-09-23 17:14:35 on dist-test-slave-1x1f"
server_key: "36f803c4931c2869240d7ec90bbc5292"
server_key_iv: "612de40a624f7e94f378ca7d03af3742"
server_key_version: "encryptionkey@0"
I20260923 17:14:35.599514 19932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance:
uuid: "50bfee15e69e45568301f1c244c3c22f"
format_stamp: "Formatted at 2026-09-23 17:14:35 on dist-test-slave-1x1f"
server_key: "36f803c4931c2869240d7ec90bbc5292"
server_key_iv: "612de40a624f7e94f378ca7d03af3742"
server_key_version: "encryptionkey@0"
I20260923 17:14:35.603364 19932 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260923 17:14:35.605785 19947 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:35.607128 19932 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260923 17:14:35.607229 19932 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-1/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-1/wal
uuid: "50bfee15e69e45568301f1c244c3c22f"
format_stamp: "Formatted at 2026-09-23 17:14:35 on dist-test-slave-1x1f"
server_key: "36f803c4931c2869240d7ec90bbc5292"
server_key_iv: "612de40a624f7e94f378ca7d03af3742"
server_key_version: "encryptionkey@0"
I20260923 17:14:35.607384 19932 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:35.623471 19932 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:35.626699 19932 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:35.626860 19932 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:35.628288 19932 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:14:35.628338 19932 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:35.628378 19932 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:14:35.628432 19932 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 23 17:14:35 dist-test-slave-1x1f krb5kdc[19675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183675, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.229.130@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM
I20260923 17:14:35.639573 19932 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.130:38051
I20260923 17:14:35.639655 20062 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.130:38051 every 8 connection(s)
I20260923 17:14:35.640702 19932 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
I20260923 17:14:35.642972 19769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:35.629058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:49899 (local address 127.11.229.190:38787)
0923 17:14:35.629235 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:35.629242 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:35.630277 (+ 1035us) server_negotiation.cc:407] Connection header received
0923 17:14:35.631359 (+ 1082us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:35.631365 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:35.631460 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:35.631528 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:35.633234 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:35.634024 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:35.635645 (+ 1621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:35.636084 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:35.636226 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:35.639082 (+ 2856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:35.639086 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:35.639088 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:35.639116 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:35.640853 (+ 1737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:35.641490 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:35.641493 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:35.641495 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:35.641588 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:35.641919 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:35.641921 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:35.641922 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:35.642161 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:35.642300 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:35.642746 (+ 446us) server_negotiation.cc:299] Negotiation successful
0923 17:14:35.642851 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260923 17:14:35.643893 19956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:35.629599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:38787 (local address 127.11.229.130:49899)
0923 17:14:35.630090 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:35.630139 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:35.631103 (+ 964us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:35.631865 (+ 762us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:35.631872 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:35.632346 (+ 474us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:35.633037 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:35.633054 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:35.634179 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:35.634187 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:35.635500 (+ 1313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:35.635510 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:35.636264 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:35.636270 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:35.636487 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:35.637193 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:35.637216 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:35.638900 (+ 1684us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:35.640963 (+ 2063us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:35.640967 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:35.640978 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:35.641364 (+ 386us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:35.641690 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:35.641693 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:35.641694 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:35.641822 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:35.642297 (+ 475us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:35.642303 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:35.642522 (+ 219us) client_negotiation.cc:769] Sending connection context
0923 17:14:35.642678 (+ 156us) client_negotiation.cc:240] Negotiation successful
0923 17:14:35.642949 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":133,"threads_started":1}
I20260923 17:14:35.645040 20063 heartbeater.cc:347] Connected to a master server at 127.11.229.190:38787
I20260923 17:14:35.645200 20063 heartbeater.cc:464] Registering TS with master...
I20260923 17:14:35.645677 20063 heartbeater.cc:511] Master 127.11.229.190:38787 requested a full tablet report, sending...
I20260923 17:14:35.646757 19720 ts_manager.cc:194] Registered new tserver with Master: 50bfee15e69e45568301f1c244c3c22f (127.11.229.130:38051)
I20260923 17:14:35.647403 19720 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.229.130@KRBTEST.COM'} at 127.11.229.130:49899
I20260923 17:14:35.650132 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 19932
I20260923 17:14:35.650277 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance
I20260923 17:14:35.650628 12182 external_mini_cluster.cc:1428] Setting key 1cd229eeb93602430e2754e3219678b8
I20260923 17:14:35.654791 19769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:35.647394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:51559 (local address 127.11.229.190:38787)
0923 17:14:35.647516 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:35.647520 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:35.647688 (+ 168us) server_negotiation.cc:407] Connection header received
0923 17:14:35.647802 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:35.647805 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:35.647849 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:35.647933 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:35.648370 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:35.649089 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:35.649862 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:35.650059 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:35.650138 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:35.651388 (+ 1250us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:35.651392 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:35.651394 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:35.651418 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:35.653066 (+ 1648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:35.653498 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:35.653504 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:35.653509 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:35.653610 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:35.653899 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:35.653904 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:35.653905 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:35.654116 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:35.654225 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:35.654529 (+ 304us) server_negotiation.cc:299] Negotiation successful
0923 17:14:35.654632 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260923 17:14:35.654801 20069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:35.647282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:38787 (local address 127.11.229.130:51559)
0923 17:14:35.647579 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:35.647593 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:35.647712 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:35.647953 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:35.647955 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:35.648163 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:35.648258 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:35.648264 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:35.649217 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:35.649219 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:35.649761 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:35.649768 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:35.650183 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:35.650189 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:35.650327 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:35.650862 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:35.650876 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:35.651235 (+ 359us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:35.653175 (+ 1940us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:35.653178 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:35.653180 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:35.653400 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:35.653699 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:35.653701 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:35.653702 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:35.653807 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:35.654214 (+ 407us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:35.654275 (+ 61us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:35.654361 (+ 86us) client_negotiation.cc:769] Sending connection context
0923 17:14:35.654467 (+ 106us) client_negotiation.cc:240] Negotiation successful
0923 17:14:35.654616 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":92,"threads_started":1}
WARNING: no policy specified for oryx/127.11.229.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.229.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.229.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.131.keytab.
Entry for principal oryx/127.11.229.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.131.keytab.
I20260923 17:14:35.679589 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.131:0
--local_ip_for_outbound_sockets=127.11.229.131
--webserver_interface=127.11.229.131
--webserver_port=0
--tserver_master_addrs=127.11.229.190:38787
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.131.keytab
--principal=oryx/127.11.229.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:37205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:14:35.790045 20072 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:35.790359 20072 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:35.790437 20072 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:35.794535 20072 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:35.794636 20072 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:35.794737 20072 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260923 17:14:35.794807 20072 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.131
I20260923 17:14:35.800344 20072 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:37205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.131.keytab
--principal=oryx/127.11.229.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.229.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.229.190:38787
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20072
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.131
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:35.801465 20072 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:35.802590 20072 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:35.812515 20078 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:35.812521 20077 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:35.812659 20072 server_base.cc:1034] running on GCE node
W20260923 17:14:35.812553 20080 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:35.813205 20072 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:35.813838 20072 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:35.814977 20072 hybrid_clock.cc:648] HybridClock initialized: now 1790183675814936 us; error 52 us; skew 500 ppm
Sep 23 17:14:35 dist-test-slave-1x1f krb5kdc[19675](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183675, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.229.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:35.817893 20072 init.cc:377] Logged in from keytab as oryx/127.11.229.131@KRBTEST.COM (short username oryx)
I20260923 17:14:35.818840 20072 webserver.cc:460] Webserver started at http://127.11.229.131:38441/ using document root <none> and password file <none>
I20260923 17:14:35.819418 20072 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:35.819480 20072 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:35.819690 20072 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:35.821718 20072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-2/data/instance:
uuid: "8bfbc623d17f4a4ab8c94b8f466ed410"
format_stamp: "Formatted at 2026-09-23 17:14:35 on dist-test-slave-1x1f"
server_key: "c0bdff58ff4b53c42be281e4247b2f9b"
server_key_iv: "c4a749c1d077c462e62b83d1cb441146"
server_key_version: "encryptionkey@0"
I20260923 17:14:35.822347 20072 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance:
uuid: "8bfbc623d17f4a4ab8c94b8f466ed410"
format_stamp: "Formatted at 2026-09-23 17:14:35 on dist-test-slave-1x1f"
server_key: "c0bdff58ff4b53c42be281e4247b2f9b"
server_key_iv: "c4a749c1d077c462e62b83d1cb441146"
server_key_version: "encryptionkey@0"
I20260923 17:14:35.826077 20072 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260923 17:14:35.828666 20087 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:35.829933 20072 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 17:14:35.830098 20072 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-2/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-2/wal
uuid: "8bfbc623d17f4a4ab8c94b8f466ed410"
format_stamp: "Formatted at 2026-09-23 17:14:35 on dist-test-slave-1x1f"
server_key: "c0bdff58ff4b53c42be281e4247b2f9b"
server_key_iv: "c4a749c1d077c462e62b83d1cb441146"
server_key_version: "encryptionkey@0"
I20260923 17:14:35.830219 20072 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:35.846190 20072 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:35.849519 20072 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:35.849741 20072 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:35.851167 20072 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:14:35.851248 20072 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:35.851315 20072 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:14:35.851365 20072 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 23 17:14:35 dist-test-slave-1x1f krb5kdc[19675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183675, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.229.131@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM
I20260923 17:14:35.862649 20072 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.131:42787
I20260923 17:14:35.862828 20202 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.131:42787 every 8 connection(s)
I20260923 17:14:35.863788 20072 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
I20260923 17:14:35.866014 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 20072
I20260923 17:14:35.866158 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance
I20260923 17:14:35.866554 12182 external_mini_cluster.cc:1428] Setting key ea97d572d56179ee01c8abce0e5105b1
I20260923 17:14:35.868248 19769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:35.852289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:51505 (local address 127.11.229.190:38787)
0923 17:14:35.852424 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:35.852428 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:35.853343 (+ 915us) server_negotiation.cc:407] Connection header received
0923 17:14:35.854612 (+ 1269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:35.854616 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:35.854684 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:35.854777 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:35.856536 (+ 1759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:35.857428 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:35.859220 (+ 1792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:35.859597 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:35.859720 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:35.863371 (+ 3651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:35.863378 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:35.863384 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:35.863420 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:35.865307 (+ 1887us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:35.865883 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:35.865890 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:35.865895 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:35.866005 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:35.866852 (+ 847us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:35.866857 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:35.866859 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:35.867128 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:35.867239 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:35.867931 (+ 692us) server_negotiation.cc:299] Negotiation successful
0923 17:14:35.868049 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260923 17:14:35.869091 20096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:35.852664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:38787 (local address 127.11.229.131:51505)
0923 17:14:35.853191 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:35.853243 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:35.854346 (+ 1103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:35.855056 (+ 710us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:35.855087 (+ 31us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:35.855610 (+ 523us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:35.856353 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:35.856376 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:35.857591 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:35.857597 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:35.859051 (+ 1454us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:35.859065 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:35.859788 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:35.859793 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:35.859998 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:35.860740 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:35.860763 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:35.863142 (+ 2379us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:35.865414 (+ 2272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:35.865419 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:35.865430 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:35.865713 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:35.866147 (+ 434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:35.866152 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:35.866157 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:35.866390 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:35.867254 (+ 864us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:35.867259 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:35.867565 (+ 306us) client_negotiation.cc:769] Sending connection context
0923 17:14:35.867728 (+ 163us) client_negotiation.cc:240] Negotiation successful
0923 17:14:35.868051 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":145,"threads_started":1}
I20260923 17:14:35.870213 20203 heartbeater.cc:347] Connected to a master server at 127.11.229.190:38787
I20260923 17:14:35.870421 20203 heartbeater.cc:464] Registering TS with master...
I20260923 17:14:35.871037 20203 heartbeater.cc:511] Master 127.11.229.190:38787 requested a full tablet report, sending...
I20260923 17:14:35.872531 19719 ts_manager.cc:194] Registered new tserver with Master: 8bfbc623d17f4a4ab8c94b8f466ed410 (127.11.229.131:42787)
I20260923 17:14:35.873384 19719 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.229.131@KRBTEST.COM'} at 127.11.229.131:51505
I20260923 17:14:35.880038 20209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:35.872911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:38787 (local address 127.11.229.131:56725)
0923 17:14:35.873297 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:35.873309 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:35.873430 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:35.873690 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:35.873693 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:35.873897 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:35.874030 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:35.874037 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:35.874845 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:35.874849 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:35.875612 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:35.875621 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:35.876042 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:35.876045 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:35.876112 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:35.876579 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:35.876589 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:35.876898 (+ 309us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:35.878593 (+ 1695us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:35.878596 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:35.878597 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:35.878802 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:35.879070 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:35.879072 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:35.879073 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:35.879158 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:35.879523 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:35.879526 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:35.879632 (+ 106us) client_negotiation.cc:769] Sending connection context
0923 17:14:35.879742 (+ 110us) client_negotiation.cc:240] Negotiation successful
0923 17:14:35.879864 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":124,"threads_started":1}
I20260923 17:14:35.880242 19769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:35.873039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:56725 (local address 127.11.229.190:38787)
0923 17:14:35.873155 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:35.873159 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:35.873386 (+ 227us) server_negotiation.cc:407] Connection header received
0923 17:14:35.873534 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:35.873537 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:35.873586 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:35.873676 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:35.874146 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:35.874719 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:35.875734 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:35.875940 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:35.876020 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:35.877023 (+ 1003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:35.877026 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:35.877028 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:35.877049 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:35.878496 (+ 1447us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:35.878886 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:35.878889 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:35.878890 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:35.878977 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:35.879273 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:35.879275 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:35.879276 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:35.879431 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:35.879505 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:35.879916 (+ 411us) server_negotiation.cc:299] Negotiation successful
0923 17:14:35.880039 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260923 17:14:35.881306 12182 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 23 17:14:35 dist-test-slave-1x1f krb5kdc[19675](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183675, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 23 17:14:35 dist-test-slave-1x1f krb5kdc[19675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:35 dist-test-slave-1x1f krb5kdc[19675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
W20260923 17:14:35.906014 19769 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:35.899531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44992 (local address 127.11.229.190:38787)
0923 17:14:35.899659 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:35.899663 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:35.899676 (+ 13us) server_negotiation.cc:407] Connection header received
0923 17:14:35.899725 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:35.899728 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:35.899765 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:35.899829 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:35.900583 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:35.901137 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:35.902044 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:35.902379 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:35.902463 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:35.905882 (+ 3419us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44992: BlockingRecv error: recv got EOF from 127.0.0.1:44992 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Sep 23 17:14:35 dist-test-slave-1x1f krb5kdc[19675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183675, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM
I20260923 17:14:35.915304 19769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:35.907495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44994 (local address 127.11.229.190:38787)
0923 17:14:35.907653 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:35.907657 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:35.907716 (+ 59us) server_negotiation.cc:407] Connection header received
0923 17:14:35.907829 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:35.907831 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:35.907870 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:35.907937 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:35.908495 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:35.909002 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:35.909722 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:35.909932 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:35.910007 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:35.912398 (+ 2391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:35.912401 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:35.912403 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:35.912424 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:35.913849 (+ 1425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:35.914212 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:35.914215 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:35.914216 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:35.914338 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:35.914547 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:35.914549 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:35.914550 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:35.914723 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:35.914833 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:35.915019 (+ 186us) server_negotiation.cc:299] Negotiation successful
0923 17:14:35.915107 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260923 17:14:35.918017 19720 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44994:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 17:14:35.921028 19720 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 17:14:35.936102 20229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:35.930744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43700 (local address 127.11.229.129:45629)
0923 17:14:35.931084 (+ 340us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:35.931090 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:35.931109 (+ 19us) server_negotiation.cc:407] Connection header received
0923 17:14:35.931173 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:35.931178 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:35.931367 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:35.931491 (+ 124us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:14:35.931731 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:35.932808 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:35.934396 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:35.935284 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:35.935406 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:35.935594 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:35.935796 (+ 202us) server_negotiation.cc:299] Negotiation successful
0923 17:14:35.935894 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":241,"thread_start_us":66,"threads_started":1}
I20260923 17:14:35.936096 20226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:35.929623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.130:38051 (local address 127.0.0.1:55992)
0923 17:14:35.930263 (+ 640us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:35.930276 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:35.930370 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:35.931569 (+ 1199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:35.931571 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:35.931584 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:14:35.931657 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:35.931664 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:35.932689 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:35.932694 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:35.934256 (+ 1562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:35.934266 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:35.935410 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:35.935413 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:35.935587 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:35.935635 (+ 48us) client_negotiation.cc:769] Sending connection context
0923 17:14:35.935709 (+ 74us) client_negotiation.cc:240] Negotiation successful
0923 17:14:35.935897 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":551,"mutex_wait_us":113,"thread_start_us":95,"threads_started":1}
I20260923 17:14:35.936096 20227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:35.929895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:45629 (local address 127.0.0.1:43700)
0923 17:14:35.930473 (+ 578us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:35.930486 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:35.930567 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:35.931483 (+ 916us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:35.931489 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:35.931511 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:14:35.931618 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:35.931623 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:35.932922 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:35.932925 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:35.934256 (+ 1331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:35.934266 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:35.935379 (+ 1113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:35.935383 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:35.935587 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:35.935630 (+ 43us) client_negotiation.cc:769] Sending connection context
0923 17:14:35.935751 (+ 121us) client_negotiation.cc:240] Negotiation successful
0923 17:14:35.935897 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":519,"mutex_wait_us":149,"thread_start_us":87,"threads_started":1}
I20260923 17:14:35.936291 20225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:35.929558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.131:42787 (local address 127.0.0.1:56074)
0923 17:14:35.929943 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:35.929997 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:35.930117 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:35.931111 (+ 994us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:35.931117 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:35.931143 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:14:35.931297 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:35.931303 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:35.932971 (+ 1668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:35.932973 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:35.934308 (+ 1335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:35.934318 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:35.935379 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:35.935383 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:35.935990 (+ 607us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:35.936011 (+ 21us) client_negotiation.cc:769] Sending connection context
0923 17:14:35.936080 (+ 69us) client_negotiation.cc:240] Negotiation successful
0923 17:14:35.936152 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"mutex_wait_us":503,"thread_start_us":93,"threads_started":1}
I20260923 17:14:35.936923 20230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:35.930723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55992 (local address 127.11.229.130:38051)
0923 17:14:35.931110 (+ 387us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:35.931122 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:35.931143 (+ 21us) server_negotiation.cc:407] Connection header received
0923 17:14:35.931214 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:35.931219 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:35.931424 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:35.931792 (+ 368us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:14:35.931888 (+ 96us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:35.932574 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:35.934396 (+ 1822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:35.935257 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:35.936494 (+ 1237us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:35.936646 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:35.936694 (+ 48us) server_negotiation.cc:299] Negotiation successful
0923 17:14:35.936789 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":296,"thread_start_us":94,"threads_started":1}
I20260923 17:14:35.936944 20228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:35.930261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56074 (local address 127.11.229.131:42787)
0923 17:14:35.930590 (+ 329us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:35.930605 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:35.930631 (+ 26us) server_negotiation.cc:407] Connection header received
0923 17:14:35.930721 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:35.930727 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:35.930932 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:35.931454 (+ 522us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:14:35.931598 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:35.932815 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:35.934445 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:35.935243 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:35.935565 (+ 322us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:35.935691 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:35.936756 (+ 1065us) server_negotiation.cc:299] Negotiation successful
0923 17:14:35.936837 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":227,"thread_start_us":116,"threads_started":1}
I20260923 17:14:35.939566 19997 tablet_service.cc:1467] Processing CreateTablet for tablet a0aa8184fccc4d96b6f064bd1033566b (DEFAULT_TABLE table=test-table [id=5b7c759ffa6e46fc90e6102507bad4b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:14:35.939566 19857 tablet_service.cc:1467] Processing CreateTablet for tablet a0aa8184fccc4d96b6f064bd1033566b (DEFAULT_TABLE table=test-table [id=5b7c759ffa6e46fc90e6102507bad4b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:14:35.939574 20137 tablet_service.cc:1467] Processing CreateTablet for tablet a0aa8184fccc4d96b6f064bd1033566b (DEFAULT_TABLE table=test-table [id=5b7c759ffa6e46fc90e6102507bad4b3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:14:35.940542 19997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0aa8184fccc4d96b6f064bd1033566b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:35.940569 20137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0aa8184fccc4d96b6f064bd1033566b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:35.940562 19857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a0aa8184fccc4d96b6f064bd1033566b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:35.947618 20231 tablet_bootstrap.cc:492] T a0aa8184fccc4d96b6f064bd1033566b P 50bfee15e69e45568301f1c244c3c22f: Bootstrap starting.
I20260923 17:14:35.948242 20232 tablet_bootstrap.cc:492] T a0aa8184fccc4d96b6f064bd1033566b P b476811982d34641b7b980144c756044: Bootstrap starting.
I20260923 17:14:35.949909 20231 tablet_bootstrap.cc:654] T a0aa8184fccc4d96b6f064bd1033566b P 50bfee15e69e45568301f1c244c3c22f: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:35.950037 20232 tablet_bootstrap.cc:654] T a0aa8184fccc4d96b6f064bd1033566b P b476811982d34641b7b980144c756044: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:35.950570 20233 tablet_bootstrap.cc:492] T a0aa8184fccc4d96b6f064bd1033566b P 8bfbc623d17f4a4ab8c94b8f466ed410: Bootstrap starting.
I20260923 17:14:35.950796 20231 log.cc:824] T a0aa8184fccc4d96b6f064bd1033566b P 50bfee15e69e45568301f1c244c3c22f: Log is configured to *not* fsync() on all Append() calls
I20260923 17:14:35.950937 20232 log.cc:824] T a0aa8184fccc4d96b6f064bd1033566b P b476811982d34641b7b980144c756044: Log is configured to *not* fsync() on all Append() calls
I20260923 17:14:35.952610 20233 tablet_bootstrap.cc:654] T a0aa8184fccc4d96b6f064bd1033566b P 8bfbc623d17f4a4ab8c94b8f466ed410: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:35.953047 20231 tablet_bootstrap.cc:492] T a0aa8184fccc4d96b6f064bd1033566b P 50bfee15e69e45568301f1c244c3c22f: No bootstrap required, opened a new log
I20260923 17:14:35.953254 20231 ts_tablet_manager.cc:1397] T a0aa8184fccc4d96b6f064bd1033566b P 50bfee15e69e45568301f1c244c3c22f: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260923 17:14:35.953401 20233 log.cc:824] T a0aa8184fccc4d96b6f064bd1033566b P 8bfbc623d17f4a4ab8c94b8f466ed410: Log is configured to *not* fsync() on all Append() calls
I20260923 17:14:35.955235 20232 tablet_bootstrap.cc:492] T a0aa8184fccc4d96b6f064bd1033566b P b476811982d34641b7b980144c756044: No bootstrap required, opened a new log
I20260923 17:14:35.955314 20233 tablet_bootstrap.cc:492] T a0aa8184fccc4d96b6f064bd1033566b P 8bfbc623d17f4a4ab8c94b8f466ed410: No bootstrap required, opened a new log
I20260923 17:14:35.955438 20232 ts_tablet_manager.cc:1397] T a0aa8184fccc4d96b6f064bd1033566b P b476811982d34641b7b980144c756044: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.003s
I20260923 17:14:35.955484 20233 ts_tablet_manager.cc:1397] T a0aa8184fccc4d96b6f064bd1033566b P 8bfbc623d17f4a4ab8c94b8f466ed410: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260923 17:14:35.957340 20231 raft_consensus.cc:348] T a0aa8184fccc4d96b6f064bd1033566b P 50bfee15e69e45568301f1c244c3c22f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } } peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } }
I20260923 17:14:35.957618 20231 raft_consensus.cc:374] T a0aa8184fccc4d96b6f064bd1033566b P 50bfee15e69e45568301f1c244c3c22f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:35.957679 20231 raft_consensus.cc:729] T a0aa8184fccc4d96b6f064bd1033566b P 50bfee15e69e45568301f1c244c3c22f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50bfee15e69e45568301f1c244c3c22f, State: Initialized, Role: FOLLOWER
I20260923 17:14:35.958150 20231 consensus_queue.cc:260] T a0aa8184fccc4d96b6f064bd1033566b P 50bfee15e69e45568301f1c244c3c22f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } } peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } }
I20260923 17:14:35.958873 20063 heartbeater.cc:503] Master 127.11.229.190:38787 was elected leader, sending a full tablet report...
I20260923 17:14:35.958841 20232 raft_consensus.cc:348] T a0aa8184fccc4d96b6f064bd1033566b P b476811982d34641b7b980144c756044 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } } peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } }
I20260923 17:14:35.959085 20232 raft_consensus.cc:374] T a0aa8184fccc4d96b6f064bd1033566b P b476811982d34641b7b980144c756044 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:35.959131 20232 raft_consensus.cc:729] T a0aa8184fccc4d96b6f064bd1033566b P b476811982d34641b7b980144c756044 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b476811982d34641b7b980144c756044, State: Initialized, Role: FOLLOWER
I20260923 17:14:35.959233 20231 ts_tablet_manager.cc:1428] T a0aa8184fccc4d96b6f064bd1033566b P 50bfee15e69e45568301f1c244c3c22f: Time spent starting tablet: real 0.006s user 0.003s sys 0.004s
I20260923 17:14:35.959313 20233 raft_consensus.cc:348] T a0aa8184fccc4d96b6f064bd1033566b P 8bfbc623d17f4a4ab8c94b8f466ed410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } } peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } }
I20260923 17:14:35.959563 20233 raft_consensus.cc:374] T a0aa8184fccc4d96b6f064bd1033566b P 8bfbc623d17f4a4ab8c94b8f466ed410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:35.959519 20232 consensus_queue.cc:260] T a0aa8184fccc4d96b6f064bd1033566b P b476811982d34641b7b980144c756044 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } } peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } }
I20260923 17:14:35.959621 20233 raft_consensus.cc:729] T a0aa8184fccc4d96b6f064bd1033566b P 8bfbc623d17f4a4ab8c94b8f466ed410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bfbc623d17f4a4ab8c94b8f466ed410, State: Initialized, Role: FOLLOWER
I20260923 17:14:35.959975 20233 consensus_queue.cc:260] T a0aa8184fccc4d96b6f064bd1033566b P 8bfbc623d17f4a4ab8c94b8f466ed410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } } peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } }
I20260923 17:14:35.960161 19923 heartbeater.cc:503] Master 127.11.229.190:38787 was elected leader, sending a full tablet report...
I20260923 17:14:35.960415 20232 ts_tablet_manager.cc:1428] T a0aa8184fccc4d96b6f064bd1033566b P b476811982d34641b7b980144c756044: Time spent starting tablet: real 0.005s user 0.004s sys 0.001s
I20260923 17:14:35.960843 20233 ts_tablet_manager.cc:1428] T a0aa8184fccc4d96b6f064bd1033566b P 8bfbc623d17f4a4ab8c94b8f466ed410: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260923 17:14:35.961129 20203 heartbeater.cc:503] Master 127.11.229.190:38787 was elected leader, sending a full tablet report...
W20260923 17:14:36.114923 20204 tablet.cc:2369] T a0aa8184fccc4d96b6f064bd1033566b P 8bfbc623d17f4a4ab8c94b8f466ed410: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 17:14:36.141978 20064 tablet.cc:2369] T a0aa8184fccc4d96b6f064bd1033566b P 50bfee15e69e45568301f1c244c3c22f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 17:14:36.171581 19924 tablet.cc:2369] T a0aa8184fccc4d96b6f064bd1033566b P b476811982d34641b7b980144c756044: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 17:14:36.272040 20239 raft_consensus.cc:482] T a0aa8184fccc4d96b6f064bd1033566b P 8bfbc623d17f4a4ab8c94b8f466ed410 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 17:14:36.272271 20239 raft_consensus.cc:504] T a0aa8184fccc4d96b6f064bd1033566b P 8bfbc623d17f4a4ab8c94b8f466ed410 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } } peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } }
I20260923 17:14:36.273360 20239 leader_election.cc:288] T a0aa8184fccc4d96b6f064bd1033566b P 8bfbc623d17f4a4ab8c94b8f466ed410 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50bfee15e69e45568301f1c244c3c22f (127.11.229.130:38051), b476811982d34641b7b980144c756044 (127.11.229.129:45629)
I20260923 17:14:36.277813 20230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:36.273858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:57133 (local address 127.11.229.130:38051)
0923 17:14:36.273987 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:36.273990 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:36.274004 (+ 14us) server_negotiation.cc:407] Connection header received
0923 17:14:36.274051 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:36.274053 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:36.274120 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:36.274242 (+ 122us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:14:36.274751 (+ 509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:36.275528 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:36.276680 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:36.277236 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:36.277326 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:36.277366 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:36.277613 (+ 247us) server_negotiation.cc:299] Negotiation successful
0923 17:14:36.277667 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260923 17:14:36.277829 20096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:36.273640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.130:38051 (local address 127.11.229.131:57133)
0923 17:14:36.273757 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:36.273772 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:36.273871 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:36.274467 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:36.274472 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:36.274492 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:14:36.274621 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:36.274627 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:36.275627 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:36.275631 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:36.276560 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:36.276569 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:36.277341 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:36.277344 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:36.277483 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:36.277509 (+ 26us) client_negotiation.cc:769] Sending connection context
0923 17:14:36.277579 (+ 70us) client_negotiation.cc:240] Negotiation successful
0923 17:14:36.277656 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260923 17:14:36.278419 20240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:36.273640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:45629 (local address 127.11.229.131:60601)
0923 17:14:36.274292 (+ 652us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:36.274306 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:36.274404 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:36.274641 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:36.274643 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:36.274656 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:14:36.275233 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:36.275243 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:36.276078 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:36.276080 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:36.276969 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:36.276978 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:36.277791 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:36.277795 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:36.278042 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:36.278070 (+ 28us) client_negotiation.cc:769] Sending connection context
0923 17:14:36.278145 (+ 75us) client_negotiation.cc:240] Negotiation successful
0923 17:14:36.278208 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":553,"mutex_wait_us":294,"thread_start_us":89,"threads_started":1}
I20260923 17:14:36.278425 20229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:36.273751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:60601 (local address 127.11.229.129:45629)
0923 17:14:36.273879 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:36.273884 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:36.274381 (+ 497us) server_negotiation.cc:407] Connection header received
0923 17:14:36.274496 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:36.274499 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:36.274543 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:36.274625 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:14:36.275347 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:36.275966 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:36.277085 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:36.277672 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:36.277778 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:36.277824 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:36.278188 (+ 364us) server_negotiation.cc:299] Negotiation successful
0923 17:14:36.278307 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260923 17:14:36.278594 20008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0aa8184fccc4d96b6f064bd1033566b" candidate_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50bfee15e69e45568301f1c244c3c22f" is_pre_election: true
I20260923 17:14:36.278903 20008 raft_consensus.cc:2454] T a0aa8184fccc4d96b6f064bd1033566b P 50bfee15e69e45568301f1c244c3c22f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bfbc623d17f4a4ab8c94b8f466ed410 in term 0.
I20260923 17:14:36.279279 19877 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0aa8184fccc4d96b6f064bd1033566b" candidate_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b476811982d34641b7b980144c756044" is_pre_election: true
I20260923 17:14:36.279443 20091 leader_election.cc:302] T a0aa8184fccc4d96b6f064bd1033566b P 8bfbc623d17f4a4ab8c94b8f466ed410 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50bfee15e69e45568301f1c244c3c22f, 8bfbc623d17f4a4ab8c94b8f466ed410; no voters:
I20260923 17:14:36.279551 19877 raft_consensus.cc:2454] T a0aa8184fccc4d96b6f064bd1033566b P b476811982d34641b7b980144c756044 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bfbc623d17f4a4ab8c94b8f466ed410 in term 0.
I20260923 17:14:36.279758 20239 raft_consensus.cc:2781] T a0aa8184fccc4d96b6f064bd1033566b P 8bfbc623d17f4a4ab8c94b8f466ed410 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 17:14:36.279865 20239 raft_consensus.cc:482] T a0aa8184fccc4d96b6f064bd1033566b P 8bfbc623d17f4a4ab8c94b8f466ed410 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 17:14:36.279920 20239 raft_consensus.cc:3037] T a0aa8184fccc4d96b6f064bd1033566b P 8bfbc623d17f4a4ab8c94b8f466ed410 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:36.280934 20239 raft_consensus.cc:504] T a0aa8184fccc4d96b6f064bd1033566b P 8bfbc623d17f4a4ab8c94b8f466ed410 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } } peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } }
I20260923 17:14:36.281282 20239 leader_election.cc:288] T a0aa8184fccc4d96b6f064bd1033566b P 8bfbc623d17f4a4ab8c94b8f466ed410 [CANDIDATE]: Term 1 election: Requested vote from peers 50bfee15e69e45568301f1c244c3c22f (127.11.229.130:38051), b476811982d34641b7b980144c756044 (127.11.229.129:45629)
I20260923 17:14:36.281616 19877 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0aa8184fccc4d96b6f064bd1033566b" candidate_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b476811982d34641b7b980144c756044"
I20260923 17:14:36.281641 20008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a0aa8184fccc4d96b6f064bd1033566b" candidate_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50bfee15e69e45568301f1c244c3c22f"
I20260923 17:14:36.281749 19877 raft_consensus.cc:3037] T a0aa8184fccc4d96b6f064bd1033566b P b476811982d34641b7b980144c756044 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:36.281790 20008 raft_consensus.cc:3037] T a0aa8184fccc4d96b6f064bd1033566b P 50bfee15e69e45568301f1c244c3c22f [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:36.282860 19877 raft_consensus.cc:2454] T a0aa8184fccc4d96b6f064bd1033566b P b476811982d34641b7b980144c756044 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bfbc623d17f4a4ab8c94b8f466ed410 in term 1.
I20260923 17:14:36.282867 20008 raft_consensus.cc:2454] T a0aa8184fccc4d96b6f064bd1033566b P 50bfee15e69e45568301f1c244c3c22f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bfbc623d17f4a4ab8c94b8f466ed410 in term 1.
I20260923 17:14:36.283180 20090 leader_election.cc:302] T a0aa8184fccc4d96b6f064bd1033566b P 8bfbc623d17f4a4ab8c94b8f466ed410 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bfbc623d17f4a4ab8c94b8f466ed410, b476811982d34641b7b980144c756044; no voters:
I20260923 17:14:36.283358 20239 raft_consensus.cc:2781] T a0aa8184fccc4d96b6f064bd1033566b P 8bfbc623d17f4a4ab8c94b8f466ed410 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:14:36.283576 20239 raft_consensus.cc:686] T a0aa8184fccc4d96b6f064bd1033566b P 8bfbc623d17f4a4ab8c94b8f466ed410 [term 1 LEADER]: Becoming Leader. State: Replica: 8bfbc623d17f4a4ab8c94b8f466ed410, State: Running, Role: LEADER
I20260923 17:14:36.283895 20239 consensus_queue.cc:237] T a0aa8184fccc4d96b6f064bd1033566b P 8bfbc623d17f4a4ab8c94b8f466ed410 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } } peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } }
I20260923 17:14:36.287120 19718 catalog_manager.cc:5495] T a0aa8184fccc4d96b6f064bd1033566b P 8bfbc623d17f4a4ab8c94b8f466ed410 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8bfbc623d17f4a4ab8c94b8f466ed410 (127.11.229.131). New cstate: current_term: 1 leader_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } health_report { overall_health: UNKNOWN } } }
I20260923 17:14:36.302570 20228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:36.298942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56088 (local address 127.11.229.131:42787)
0923 17:14:36.299090 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:36.299095 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:36.299109 (+ 14us) server_negotiation.cc:407] Connection header received
0923 17:14:36.299322 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:36.299325 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:36.299379 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:36.299492 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 17:14:36.299738 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:36.300236 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:36.301072 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:36.301301 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:36.301408 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:36.301691 (+ 283us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 17:14:36.302124 (+ 433us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 17:14:36.302283 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:36.302364 (+ 81us) server_negotiation.cc:299] Negotiation successful
0923 17:14:36.302420 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260923 17:14:36.308710 20008 raft_consensus.cc:1261] T a0aa8184fccc4d96b6f064bd1033566b P 50bfee15e69e45568301f1c244c3c22f [term 1 FOLLOWER]: Refusing update from remote peer 8bfbc623d17f4a4ab8c94b8f466ed410: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:14:36.308710 19877 raft_consensus.cc:1261] T a0aa8184fccc4d96b6f064bd1033566b P b476811982d34641b7b980144c756044 [term 1 FOLLOWER]: Refusing update from remote peer 8bfbc623d17f4a4ab8c94b8f466ed410: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:14:36.309456 20241 consensus_queue.cc:1035] T a0aa8184fccc4d96b6f064bd1033566b P 8bfbc623d17f4a4ab8c94b8f466ed410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:14:36.309707 20239 consensus_queue.cc:1035] T a0aa8184fccc4d96b6f064bd1033566b P 8bfbc623d17f4a4ab8c94b8f466ed410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:14:36.317698 20244 mvcc.cc:205] Tried to move back new op lower bound from 7332592338152284160 to 7332592338060972032. Current Snapshot: MvccSnapshot[applied={T|T < 7332592338152284160}]
I20260923 17:14:36.318912 20245 mvcc.cc:205] Tried to move back new op lower bound from 7332592338152284160 to 7332592338060972032. Current Snapshot: MvccSnapshot[applied={T|T < 7332592338152284160}]
I20260923 17:14:36.320935 20246 mvcc.cc:205] Tried to move back new op lower bound from 7332592338152284160 to 7332592338060972032. Current Snapshot: MvccSnapshot[applied={T|T < 7332592338152284160}]
I20260923 17:14:36.326045 19720 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44994:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:14:36.326246 19720 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44994:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:14:36.328725 19720 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ad4a043a0e6c49429daa823bd4a05146: Sending DeleteTablet for 3 replicas of tablet a0aa8184fccc4d96b6f064bd1033566b
I20260923 17:14:36.329530 20137 tablet_service.cc:1514] Processing DeleteTablet for tablet a0aa8184fccc4d96b6f064bd1033566b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:14:36 UTC) from {username='oryx', principal='oryx/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:56074
I20260923 17:14:36.329547 19997 tablet_service.cc:1514] Processing DeleteTablet for tablet a0aa8184fccc4d96b6f064bd1033566b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:14:36 UTC) from {username='oryx', principal='oryx/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:55992
I20260923 17:14:36.329968 20253 tablet_replica.cc:330] T a0aa8184fccc4d96b6f064bd1033566b P 8bfbc623d17f4a4ab8c94b8f466ed410: stopping tablet replica
I20260923 17:14:36.330147 19857 tablet_service.cc:1514] Processing DeleteTablet for tablet a0aa8184fccc4d96b6f064bd1033566b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:14:36 UTC) from {username='oryx', principal='oryx/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:43700
I20260923 17:14:36.330509 20254 tablet_replica.cc:330] T a0aa8184fccc4d96b6f064bd1033566b P 50bfee15e69e45568301f1c244c3c22f: stopping tablet replica
I20260923 17:14:36.330539 20253 raft_consensus.cc:2229] T a0aa8184fccc4d96b6f064bd1033566b P 8bfbc623d17f4a4ab8c94b8f466ed410 [term 1 LEADER]: Raft consensus shutting down.
I20260923 17:14:36.330796 20254 raft_consensus.cc:2229] T a0aa8184fccc4d96b6f064bd1033566b P 50bfee15e69e45568301f1c244c3c22f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:14:36.330741 19720 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44994:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 17:14:36.331112 20254 raft_consensus.cc:2258] T a0aa8184fccc4d96b6f064bd1033566b P 50bfee15e69e45568301f1c244c3c22f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260923 17:14:36.331161 19720 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 17:14:36.331323 20253 raft_consensus.cc:2258] T a0aa8184fccc4d96b6f064bd1033566b P 8bfbc623d17f4a4ab8c94b8f466ed410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:14:36.332636 20254 ts_tablet_manager.cc:1905] T a0aa8184fccc4d96b6f064bd1033566b P 50bfee15e69e45568301f1c244c3c22f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:14:36.332644 20253 ts_tablet_manager.cc:1905] T a0aa8184fccc4d96b6f064bd1033566b P 8bfbc623d17f4a4ab8c94b8f466ed410: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:14:36.335930 20253 ts_tablet_manager.cc:1918] T a0aa8184fccc4d96b6f064bd1033566b P 8bfbc623d17f4a4ab8c94b8f466ed410: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 17:14:36.336112 20253 log.cc:1196] T a0aa8184fccc4d96b6f064bd1033566b P 8bfbc623d17f4a4ab8c94b8f466ed410: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-2/wal/wals/a0aa8184fccc4d96b6f064bd1033566b
I20260923 17:14:36.336213 19997 tablet_service.cc:1467] Processing CreateTablet for tablet 91bfa2a8835e4cbea951840ecef1c269 (DEFAULT_TABLE table=test-table [id=4781682a5ce044469f2ab047af2984a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:14:36.336468 19997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91bfa2a8835e4cbea951840ecef1c269. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:36.336705 20253 ts_tablet_manager.cc:1939] T a0aa8184fccc4d96b6f064bd1033566b P 8bfbc623d17f4a4ab8c94b8f466ed410: Deleting consensus metadata
I20260923 17:14:36.336688 19857 tablet_service.cc:1467] Processing CreateTablet for tablet 91bfa2a8835e4cbea951840ecef1c269 (DEFAULT_TABLE table=test-table [id=4781682a5ce044469f2ab047af2984a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:14:36.336964 19857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91bfa2a8835e4cbea951840ecef1c269. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:36.338027 19705 catalog_manager.cc:4841] TS 8bfbc623d17f4a4ab8c94b8f466ed410 (127.11.229.131:42787): tablet a0aa8184fccc4d96b6f064bd1033566b (table test-table [id=5b7c759ffa6e46fc90e6102507bad4b3]) successfully deleted
I20260923 17:14:36.338658 20231 tablet_bootstrap.cc:492] T 91bfa2a8835e4cbea951840ecef1c269 P 50bfee15e69e45568301f1c244c3c22f: Bootstrap starting.
I20260923 17:14:36.338886 20254 ts_tablet_manager.cc:1918] T a0aa8184fccc4d96b6f064bd1033566b P 50bfee15e69e45568301f1c244c3c22f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 17:14:36.338976 20254 log.cc:1196] T a0aa8184fccc4d96b6f064bd1033566b P 50bfee15e69e45568301f1c244c3c22f: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-1/wal/wals/a0aa8184fccc4d96b6f064bd1033566b
I20260923 17:14:36.339279 20254 ts_tablet_manager.cc:1939] T a0aa8184fccc4d96b6f064bd1033566b P 50bfee15e69e45568301f1c244c3c22f: Deleting consensus metadata
I20260923 17:14:36.339418 20232 tablet_bootstrap.cc:492] T 91bfa2a8835e4cbea951840ecef1c269 P b476811982d34641b7b980144c756044: Bootstrap starting.
I20260923 17:14:36.339622 20137 tablet_service.cc:1467] Processing CreateTablet for tablet 91bfa2a8835e4cbea951840ecef1c269 (DEFAULT_TABLE table=test-table [id=4781682a5ce044469f2ab047af2984a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:14:36.339859 20137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91bfa2a8835e4cbea951840ecef1c269. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:36.340305 20232 tablet_bootstrap.cc:654] T 91bfa2a8835e4cbea951840ecef1c269 P b476811982d34641b7b980144c756044: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:36.339622 20231 tablet_bootstrap.cc:654] T 91bfa2a8835e4cbea951840ecef1c269 P 50bfee15e69e45568301f1c244c3c22f: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:36.341902 20233 tablet_bootstrap.cc:492] T 91bfa2a8835e4cbea951840ecef1c269 P 8bfbc623d17f4a4ab8c94b8f466ed410: Bootstrap starting.
I20260923 17:14:36.342092 20232 tablet_bootstrap.cc:492] T 91bfa2a8835e4cbea951840ecef1c269 P b476811982d34641b7b980144c756044: No bootstrap required, opened a new log
I20260923 17:14:36.342190 20232 ts_tablet_manager.cc:1397] T 91bfa2a8835e4cbea951840ecef1c269 P b476811982d34641b7b980144c756044: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260923 17:14:36.342651 20232 raft_consensus.cc:348] T 91bfa2a8835e4cbea951840ecef1c269 P b476811982d34641b7b980144c756044 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } } peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } }
I20260923 17:14:36.342768 20232 raft_consensus.cc:374] T 91bfa2a8835e4cbea951840ecef1c269 P b476811982d34641b7b980144c756044 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:36.342797 20233 tablet_bootstrap.cc:654] T 91bfa2a8835e4cbea951840ecef1c269 P 8bfbc623d17f4a4ab8c94b8f466ed410: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:36.342800 20232 raft_consensus.cc:729] T 91bfa2a8835e4cbea951840ecef1c269 P b476811982d34641b7b980144c756044 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b476811982d34641b7b980144c756044, State: Initialized, Role: FOLLOWER
I20260923 17:14:36.342926 20232 consensus_queue.cc:260] T 91bfa2a8835e4cbea951840ecef1c269 P b476811982d34641b7b980144c756044 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } } peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } }
I20260923 17:14:36.343181 20232 ts_tablet_manager.cc:1428] T 91bfa2a8835e4cbea951840ecef1c269 P b476811982d34641b7b980144c756044: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260923 17:14:36.343752 20231 tablet_bootstrap.cc:492] T 91bfa2a8835e4cbea951840ecef1c269 P 50bfee15e69e45568301f1c244c3c22f: No bootstrap required, opened a new log
I20260923 17:14:36.343842 20231 ts_tablet_manager.cc:1397] T 91bfa2a8835e4cbea951840ecef1c269 P 50bfee15e69e45568301f1c244c3c22f: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.001s
I20260923 17:14:36.344099 20233 tablet_bootstrap.cc:492] T 91bfa2a8835e4cbea951840ecef1c269 P 8bfbc623d17f4a4ab8c94b8f466ed410: No bootstrap required, opened a new log
I20260923 17:14:36.344202 20233 ts_tablet_manager.cc:1397] T 91bfa2a8835e4cbea951840ecef1c269 P 8bfbc623d17f4a4ab8c94b8f466ed410: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260923 17:14:36.344282 20231 raft_consensus.cc:348] T 91bfa2a8835e4cbea951840ecef1c269 P 50bfee15e69e45568301f1c244c3c22f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } } peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } }
I20260923 17:14:36.344411 20231 raft_consensus.cc:374] T 91bfa2a8835e4cbea951840ecef1c269 P 50bfee15e69e45568301f1c244c3c22f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:36.344686 20233 raft_consensus.cc:348] T 91bfa2a8835e4cbea951840ecef1c269 P 8bfbc623d17f4a4ab8c94b8f466ed410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } } peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } }
I20260923 17:14:36.344795 20233 raft_consensus.cc:374] T 91bfa2a8835e4cbea951840ecef1c269 P 8bfbc623d17f4a4ab8c94b8f466ed410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:36.344834 20233 raft_consensus.cc:729] T 91bfa2a8835e4cbea951840ecef1c269 P 8bfbc623d17f4a4ab8c94b8f466ed410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bfbc623d17f4a4ab8c94b8f466ed410, State: Initialized, Role: FOLLOWER
I20260923 17:14:36.344455 20231 raft_consensus.cc:729] T 91bfa2a8835e4cbea951840ecef1c269 P 50bfee15e69e45568301f1c244c3c22f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50bfee15e69e45568301f1c244c3c22f, State: Initialized, Role: FOLLOWER
I20260923 17:14:36.344957 20233 consensus_queue.cc:260] T 91bfa2a8835e4cbea951840ecef1c269 P 8bfbc623d17f4a4ab8c94b8f466ed410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } } peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } }
I20260923 17:14:36.345314 20233 ts_tablet_manager.cc:1428] T 91bfa2a8835e4cbea951840ecef1c269 P 8bfbc623d17f4a4ab8c94b8f466ed410: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260923 17:14:36.347596 20231 consensus_queue.cc:260] T 91bfa2a8835e4cbea951840ecef1c269 P 50bfee15e69e45568301f1c244c3c22f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } } peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } }
I20260923 17:14:36.348045 20231 ts_tablet_manager.cc:1428] T 91bfa2a8835e4cbea951840ecef1c269 P 50bfee15e69e45568301f1c244c3c22f: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s
I20260923 17:14:36.348054 20255 tablet_replica.cc:330] T a0aa8184fccc4d96b6f064bd1033566b P b476811982d34641b7b980144c756044: stopping tablet replica
I20260923 17:14:36.348421 20255 raft_consensus.cc:2229] T a0aa8184fccc4d96b6f064bd1033566b P b476811982d34641b7b980144c756044 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:14:36.348786 20255 raft_consensus.cc:2258] T a0aa8184fccc4d96b6f064bd1033566b P b476811982d34641b7b980144c756044 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:14:36.350524 20255 ts_tablet_manager.cc:1905] T a0aa8184fccc4d96b6f064bd1033566b P b476811982d34641b7b980144c756044: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:14:36.350529 19707 catalog_manager.cc:4841] TS 50bfee15e69e45568301f1c244c3c22f (127.11.229.130:38051): tablet a0aa8184fccc4d96b6f064bd1033566b (table test-table [id=5b7c759ffa6e46fc90e6102507bad4b3]) successfully deleted
I20260923 17:14:36.353502 20255 ts_tablet_manager.cc:1918] T a0aa8184fccc4d96b6f064bd1033566b P b476811982d34641b7b980144c756044: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 17:14:36.353636 20255 log.cc:1196] T a0aa8184fccc4d96b6f064bd1033566b P b476811982d34641b7b980144c756044: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-0/wal/wals/a0aa8184fccc4d96b6f064bd1033566b
I20260923 17:14:36.353971 20255 ts_tablet_manager.cc:1939] T a0aa8184fccc4d96b6f064bd1033566b P b476811982d34641b7b980144c756044: Deleting consensus metadata
I20260923 17:14:36.355211 19706 catalog_manager.cc:4841] TS b476811982d34641b7b980144c756044 (127.11.229.129:45629): tablet a0aa8184fccc4d96b6f064bd1033566b (table test-table [id=5b7c759ffa6e46fc90e6102507bad4b3]) successfully deleted
I20260923 17:14:36.441568 20241 raft_consensus.cc:482] T 91bfa2a8835e4cbea951840ecef1c269 P 8bfbc623d17f4a4ab8c94b8f466ed410 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 17:14:36.441807 20241 raft_consensus.cc:504] T 91bfa2a8835e4cbea951840ecef1c269 P 8bfbc623d17f4a4ab8c94b8f466ed410 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } } peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } }
I20260923 17:14:36.442436 20241 leader_election.cc:288] T 91bfa2a8835e4cbea951840ecef1c269 P 8bfbc623d17f4a4ab8c94b8f466ed410 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b476811982d34641b7b980144c756044 (127.11.229.129:45629), 50bfee15e69e45568301f1c244c3c22f (127.11.229.130:38051)
I20260923 17:14:36.442936 20008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91bfa2a8835e4cbea951840ecef1c269" candidate_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50bfee15e69e45568301f1c244c3c22f" is_pre_election: true
I20260923 17:14:36.442943 19877 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91bfa2a8835e4cbea951840ecef1c269" candidate_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b476811982d34641b7b980144c756044" is_pre_election: true
I20260923 17:14:36.443117 19877 raft_consensus.cc:2454] T 91bfa2a8835e4cbea951840ecef1c269 P b476811982d34641b7b980144c756044 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bfbc623d17f4a4ab8c94b8f466ed410 in term 0.
I20260923 17:14:36.443115 20008 raft_consensus.cc:2454] T 91bfa2a8835e4cbea951840ecef1c269 P 50bfee15e69e45568301f1c244c3c22f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bfbc623d17f4a4ab8c94b8f466ed410 in term 0.
I20260923 17:14:36.443486 20090 leader_election.cc:302] T 91bfa2a8835e4cbea951840ecef1c269 P 8bfbc623d17f4a4ab8c94b8f466ed410 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bfbc623d17f4a4ab8c94b8f466ed410, b476811982d34641b7b980144c756044; no voters:
I20260923 17:14:36.443710 20241 raft_consensus.cc:2781] T 91bfa2a8835e4cbea951840ecef1c269 P 8bfbc623d17f4a4ab8c94b8f466ed410 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 17:14:36.443799 20241 raft_consensus.cc:482] T 91bfa2a8835e4cbea951840ecef1c269 P 8bfbc623d17f4a4ab8c94b8f466ed410 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 17:14:36.443840 20241 raft_consensus.cc:3037] T 91bfa2a8835e4cbea951840ecef1c269 P 8bfbc623d17f4a4ab8c94b8f466ed410 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:36.445225 20241 raft_consensus.cc:504] T 91bfa2a8835e4cbea951840ecef1c269 P 8bfbc623d17f4a4ab8c94b8f466ed410 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } } peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } }
I20260923 17:14:36.445605 20241 leader_election.cc:288] T 91bfa2a8835e4cbea951840ecef1c269 P 8bfbc623d17f4a4ab8c94b8f466ed410 [CANDIDATE]: Term 1 election: Requested vote from peers b476811982d34641b7b980144c756044 (127.11.229.129:45629), 50bfee15e69e45568301f1c244c3c22f (127.11.229.130:38051)
I20260923 17:14:36.446089 20008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91bfa2a8835e4cbea951840ecef1c269" candidate_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50bfee15e69e45568301f1c244c3c22f"
I20260923 17:14:36.446118 19877 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91bfa2a8835e4cbea951840ecef1c269" candidate_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b476811982d34641b7b980144c756044"
I20260923 17:14:36.446254 20008 raft_consensus.cc:3037] T 91bfa2a8835e4cbea951840ecef1c269 P 50bfee15e69e45568301f1c244c3c22f [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:36.446311 19877 raft_consensus.cc:3037] T 91bfa2a8835e4cbea951840ecef1c269 P b476811982d34641b7b980144c756044 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:36.447371 19877 raft_consensus.cc:2454] T 91bfa2a8835e4cbea951840ecef1c269 P b476811982d34641b7b980144c756044 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bfbc623d17f4a4ab8c94b8f466ed410 in term 1.
I20260923 17:14:36.447536 20008 raft_consensus.cc:2454] T 91bfa2a8835e4cbea951840ecef1c269 P 50bfee15e69e45568301f1c244c3c22f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bfbc623d17f4a4ab8c94b8f466ed410 in term 1.
I20260923 17:14:36.447743 20090 leader_election.cc:302] T 91bfa2a8835e4cbea951840ecef1c269 P 8bfbc623d17f4a4ab8c94b8f466ed410 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bfbc623d17f4a4ab8c94b8f466ed410, b476811982d34641b7b980144c756044; no voters:
I20260923 17:14:36.447976 20241 raft_consensus.cc:2781] T 91bfa2a8835e4cbea951840ecef1c269 P 8bfbc623d17f4a4ab8c94b8f466ed410 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:14:36.448127 20241 raft_consensus.cc:686] T 91bfa2a8835e4cbea951840ecef1c269 P 8bfbc623d17f4a4ab8c94b8f466ed410 [term 1 LEADER]: Becoming Leader. State: Replica: 8bfbc623d17f4a4ab8c94b8f466ed410, State: Running, Role: LEADER
I20260923 17:14:36.448294 20241 consensus_queue.cc:237] T 91bfa2a8835e4cbea951840ecef1c269 P 8bfbc623d17f4a4ab8c94b8f466ed410 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } } peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } }
I20260923 17:14:36.450115 19720 catalog_manager.cc:5495] T 91bfa2a8835e4cbea951840ecef1c269 P 8bfbc623d17f4a4ab8c94b8f466ed410 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8bfbc623d17f4a4ab8c94b8f466ed410 (127.11.229.131). New cstate: current_term: 1 leader_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } health_report { overall_health: HEALTHY } } }
Sep 23 17:14:36 dist-test-slave-1x1f krb5kdc[19675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183675, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.229.190@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM
I20260923 17:14:36.512746 20266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:36.504110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45004 (local address 127.11.229.190:38787)
0923 17:14:36.504359 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:36.504365 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:36.504380 (+ 15us) server_negotiation.cc:407] Connection header received
0923 17:14:36.504504 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:36.504506 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:36.504546 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:36.504621 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:36.505349 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:36.505884 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:36.506794 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:36.507006 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:36.507093 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:36.509490 (+ 2397us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:36.509496 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:36.509503 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:36.509522 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:36.510906 (+ 1384us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:36.511412 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:36.511416 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:36.511418 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:36.511521 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:36.511782 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:36.511786 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:36.511788 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:36.511969 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:36.512075 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:36.512377 (+ 302us) server_negotiation.cc:299] Negotiation successful
0923 17:14:36.512605 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":120,"server-negotiator.queue_time_us":191,"thread_start_us":106,"threads_started":1}
I20260923 17:14:36.512746 20265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:36.503958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:38787 (local address 127.0.0.1:45004)
0923 17:14:36.504293 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:36.504317 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:36.504417 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:36.504666 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:36.504668 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:36.505052 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:36.505191 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:36.505198 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:36.505996 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:36.505998 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:36.506681 (+ 683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:36.506689 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:36.507114 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:36.507117 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:36.507243 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:36.507768 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:36.507779 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:36.509338 (+ 1559us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:36.511070 (+ 1732us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:36.511079 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:36.511085 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:36.511307 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:36.511610 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:36.511613 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:36.511615 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:36.511695 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:36.512105 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:36.512112 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:36.512218 (+ 106us) client_negotiation.cc:769] Sending connection context
0923 17:14:36.512335 (+ 117us) client_negotiation.cc:240] Negotiation successful
0923 17:14:36.512547 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228,"mutex_wait_us":4,"thread_start_us":84,"threads_started":1}
I20260923 17:14:36.516840 19720 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:45004:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260923 17:14:36.517550 19720 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 17:14:36.522255 19997 tablet_service.cc:1467] Processing CreateTablet for tablet 77033f988abb435db5db92b194a01100 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=7707d5f6882148069425fc404ef37106]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260923 17:14:36.522226 20137 tablet_service.cc:1467] Processing CreateTablet for tablet 77033f988abb435db5db92b194a01100 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=7707d5f6882148069425fc404ef37106]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260923 17:14:36.522403 19857 tablet_service.cc:1467] Processing CreateTablet for tablet 77033f988abb435db5db92b194a01100 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=7707d5f6882148069425fc404ef37106]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260923 17:14:36.522653 19997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77033f988abb435db5db92b194a01100. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:36.522652 20137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77033f988abb435db5db92b194a01100. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:36.522790 19857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77033f988abb435db5db92b194a01100. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:36.525290 20232 tablet_bootstrap.cc:492] T 77033f988abb435db5db92b194a01100 P b476811982d34641b7b980144c756044: Bootstrap starting.
I20260923 17:14:36.525444 20231 tablet_bootstrap.cc:492] T 77033f988abb435db5db92b194a01100 P 50bfee15e69e45568301f1c244c3c22f: Bootstrap starting.
I20260923 17:14:36.526319 20232 tablet_bootstrap.cc:654] T 77033f988abb435db5db92b194a01100 P b476811982d34641b7b980144c756044: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:36.526487 20231 tablet_bootstrap.cc:654] T 77033f988abb435db5db92b194a01100 P 50bfee15e69e45568301f1c244c3c22f: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:36.527262 20233 tablet_bootstrap.cc:492] T 77033f988abb435db5db92b194a01100 P 8bfbc623d17f4a4ab8c94b8f466ed410: Bootstrap starting.
I20260923 17:14:36.527648 20232 tablet_bootstrap.cc:492] T 77033f988abb435db5db92b194a01100 P b476811982d34641b7b980144c756044: No bootstrap required, opened a new log
I20260923 17:14:36.527648 20231 tablet_bootstrap.cc:492] T 77033f988abb435db5db92b194a01100 P 50bfee15e69e45568301f1c244c3c22f: No bootstrap required, opened a new log
I20260923 17:14:36.527735 20232 ts_tablet_manager.cc:1397] T 77033f988abb435db5db92b194a01100 P b476811982d34641b7b980144c756044: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260923 17:14:36.527745 20231 ts_tablet_manager.cc:1397] T 77033f988abb435db5db92b194a01100 P 50bfee15e69e45568301f1c244c3c22f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260923 17:14:36.528138 20233 tablet_bootstrap.cc:654] T 77033f988abb435db5db92b194a01100 P 8bfbc623d17f4a4ab8c94b8f466ed410: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:36.528172 20232 raft_consensus.cc:348] T 77033f988abb435db5db92b194a01100 P b476811982d34641b7b980144c756044 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } } peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } }
I20260923 17:14:36.528172 20231 raft_consensus.cc:348] T 77033f988abb435db5db92b194a01100 P 50bfee15e69e45568301f1c244c3c22f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } } peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } }
I20260923 17:14:36.528295 20232 raft_consensus.cc:374] T 77033f988abb435db5db92b194a01100 P b476811982d34641b7b980144c756044 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:36.528295 20231 raft_consensus.cc:374] T 77033f988abb435db5db92b194a01100 P 50bfee15e69e45568301f1c244c3c22f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:36.528335 20231 raft_consensus.cc:729] T 77033f988abb435db5db92b194a01100 P 50bfee15e69e45568301f1c244c3c22f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50bfee15e69e45568301f1c244c3c22f, State: Initialized, Role: FOLLOWER
I20260923 17:14:36.528335 20232 raft_consensus.cc:729] T 77033f988abb435db5db92b194a01100 P b476811982d34641b7b980144c756044 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b476811982d34641b7b980144c756044, State: Initialized, Role: FOLLOWER
I20260923 17:14:36.528455 20231 consensus_queue.cc:260] T 77033f988abb435db5db92b194a01100 P 50bfee15e69e45568301f1c244c3c22f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } } peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } }
I20260923 17:14:36.528455 20232 consensus_queue.cc:260] T 77033f988abb435db5db92b194a01100 P b476811982d34641b7b980144c756044 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } } peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } }
I20260923 17:14:36.528739 20231 ts_tablet_manager.cc:1428] T 77033f988abb435db5db92b194a01100 P 50bfee15e69e45568301f1c244c3c22f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260923 17:14:36.528687 20237 tablet_replica.cc:439] T 77033f988abb435db5db92b194a01100 P 50bfee15e69e45568301f1c244c3c22f: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } } peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } } }
I20260923 17:14:36.528818 20237 tablet_replica.cc:442] T 77033f988abb435db5db92b194a01100 P 50bfee15e69e45568301f1c244c3c22f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 17:14:36.529059 20238 tablet_replica.cc:439] T 77033f988abb435db5db92b194a01100 P b476811982d34641b7b980144c756044: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } } peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } } }
I20260923 17:14:36.529182 20238 tablet_replica.cc:442] T 77033f988abb435db5db92b194a01100 P b476811982d34641b7b980144c756044: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 17:14:36.529656 20233 tablet_bootstrap.cc:492] T 77033f988abb435db5db92b194a01100 P 8bfbc623d17f4a4ab8c94b8f466ed410: No bootstrap required, opened a new log
I20260923 17:14:36.529757 20233 ts_tablet_manager.cc:1397] T 77033f988abb435db5db92b194a01100 P 8bfbc623d17f4a4ab8c94b8f466ed410: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260923 17:14:36.530135 20233 raft_consensus.cc:348] T 77033f988abb435db5db92b194a01100 P 8bfbc623d17f4a4ab8c94b8f466ed410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } } peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } }
I20260923 17:14:36.530303 20233 raft_consensus.cc:374] T 77033f988abb435db5db92b194a01100 P 8bfbc623d17f4a4ab8c94b8f466ed410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:36.530344 20233 raft_consensus.cc:729] T 77033f988abb435db5db92b194a01100 P 8bfbc623d17f4a4ab8c94b8f466ed410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bfbc623d17f4a4ab8c94b8f466ed410, State: Initialized, Role: FOLLOWER
I20260923 17:14:36.530365 20232 ts_tablet_manager.cc:1428] T 77033f988abb435db5db92b194a01100 P b476811982d34641b7b980144c756044: Time spent starting tablet: real 0.003s user 0.000s sys 0.001s
I20260923 17:14:36.530462 20233 consensus_queue.cc:260] T 77033f988abb435db5db92b194a01100 P 8bfbc623d17f4a4ab8c94b8f466ed410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } } peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } }
I20260923 17:14:36.530741 20233 ts_tablet_manager.cc:1428] T 77033f988abb435db5db92b194a01100 P 8bfbc623d17f4a4ab8c94b8f466ed410: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260923 17:14:36.530682 20241 tablet_replica.cc:439] T 77033f988abb435db5db92b194a01100 P 8bfbc623d17f4a4ab8c94b8f466ed410: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } } peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } } }
I20260923 17:14:36.531147 20241 tablet_replica.cc:442] T 77033f988abb435db5db92b194a01100 P 8bfbc623d17f4a4ab8c94b8f466ed410: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 17:14:36.758919 20238 raft_consensus.cc:482] T 77033f988abb435db5db92b194a01100 P b476811982d34641b7b980144c756044 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 17:14:36.759090 20238 raft_consensus.cc:504] T 77033f988abb435db5db92b194a01100 P b476811982d34641b7b980144c756044 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } } peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } }
I20260923 17:14:36.760255 20238 leader_election.cc:288] T 77033f988abb435db5db92b194a01100 P b476811982d34641b7b980144c756044 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50bfee15e69e45568301f1c244c3c22f (127.11.229.130:38051), 8bfbc623d17f4a4ab8c94b8f466ed410 (127.11.229.131:42787)
I20260923 17:14:36.764518 20270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:36.760426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.130:38051 (local address 127.11.229.129:35525)
0923 17:14:36.760743 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:36.760759 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:36.760881 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:36.761179 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:36.761181 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:36.761197 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:14:36.761339 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:36.761346 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:36.762287 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:36.762290 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:36.763227 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:36.763237 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:36.764024 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:36.764028 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:36.764140 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:36.764167 (+ 27us) client_negotiation.cc:769] Sending connection context
0923 17:14:36.764288 (+ 121us) client_negotiation.cc:240] Negotiation successful
0923 17:14:36.764364 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":71,"threads_started":1}
I20260923 17:14:36.764600 20230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:36.760549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:35525 (local address 127.11.229.130:38051)
0923 17:14:36.760736 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:36.760742 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:36.760832 (+ 90us) server_negotiation.cc:407] Connection header received
0923 17:14:36.761009 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:36.761013 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:36.761066 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:36.761155 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:14:36.761470 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:36.762057 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:36.763371 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:36.763898 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:36.763993 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:36.764034 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:36.764368 (+ 334us) server_negotiation.cc:299] Negotiation successful
0923 17:14:36.764461 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260923 17:14:36.764945 20271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:36.760542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.131:42787 (local address 127.11.229.129:51465)
0923 17:14:36.760881 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:36.760901 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:36.761035 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:36.761375 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:36.761377 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:36.761431 (+ 54us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:14:36.761558 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:36.761565 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:36.762500 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:36.762503 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:36.763581 (+ 1078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:36.763591 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:36.764384 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:36.764388 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:36.764493 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:36.764515 (+ 22us) client_negotiation.cc:769] Sending connection context
0923 17:14:36.764600 (+ 85us) client_negotiation.cc:240] Negotiation successful
0923 17:14:36.764815 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"thread_start_us":145,"threads_started":1}
I20260923 17:14:36.764983 20228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:36.760672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:51465 (local address 127.11.229.131:42787)
0923 17:14:36.760791 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:36.760796 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:36.761015 (+ 219us) server_negotiation.cc:407] Connection header received
0923 17:14:36.761162 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:36.761165 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:36.761242 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:36.761327 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:14:36.761702 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:36.762366 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:36.763723 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:36.764229 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:36.764342 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:36.764388 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:36.764780 (+ 392us) server_negotiation.cc:299] Negotiation successful
0923 17:14:36.764860 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260923 17:14:36.765020 20008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77033f988abb435db5db92b194a01100" candidate_uuid: "b476811982d34641b7b980144c756044" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50bfee15e69e45568301f1c244c3c22f" is_pre_election: true
I20260923 17:14:36.765209 20008 raft_consensus.cc:2454] T 77033f988abb435db5db92b194a01100 P 50bfee15e69e45568301f1c244c3c22f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b476811982d34641b7b980144c756044 in term 0.
I20260923 17:14:36.765528 20157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77033f988abb435db5db92b194a01100" candidate_uuid: "b476811982d34641b7b980144c756044" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" is_pre_election: true
I20260923 17:14:36.765663 19811 leader_election.cc:302] T 77033f988abb435db5db92b194a01100 P b476811982d34641b7b980144c756044 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50bfee15e69e45568301f1c244c3c22f, b476811982d34641b7b980144c756044; no voters:
I20260923 17:14:36.765771 20157 raft_consensus.cc:2454] T 77033f988abb435db5db92b194a01100 P 8bfbc623d17f4a4ab8c94b8f466ed410 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b476811982d34641b7b980144c756044 in term 0.
I20260923 17:14:36.766023 20238 raft_consensus.cc:2781] T 77033f988abb435db5db92b194a01100 P b476811982d34641b7b980144c756044 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 17:14:36.766093 20238 raft_consensus.cc:482] T 77033f988abb435db5db92b194a01100 P b476811982d34641b7b980144c756044 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 17:14:36.766132 20238 raft_consensus.cc:3037] T 77033f988abb435db5db92b194a01100 P b476811982d34641b7b980144c756044 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:36.767167 20238 raft_consensus.cc:504] T 77033f988abb435db5db92b194a01100 P b476811982d34641b7b980144c756044 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } } peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } }
I20260923 17:14:36.767495 20238 leader_election.cc:288] T 77033f988abb435db5db92b194a01100 P b476811982d34641b7b980144c756044 [CANDIDATE]: Term 1 election: Requested vote from peers 50bfee15e69e45568301f1c244c3c22f (127.11.229.130:38051), 8bfbc623d17f4a4ab8c94b8f466ed410 (127.11.229.131:42787)
I20260923 17:14:36.767851 20008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77033f988abb435db5db92b194a01100" candidate_uuid: "b476811982d34641b7b980144c756044" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50bfee15e69e45568301f1c244c3c22f"
I20260923 17:14:36.767868 20157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77033f988abb435db5db92b194a01100" candidate_uuid: "b476811982d34641b7b980144c756044" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410"
I20260923 17:14:36.767985 20008 raft_consensus.cc:3037] T 77033f988abb435db5db92b194a01100 P 50bfee15e69e45568301f1c244c3c22f [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:36.768000 20157 raft_consensus.cc:3037] T 77033f988abb435db5db92b194a01100 P 8bfbc623d17f4a4ab8c94b8f466ed410 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:36.768880 20157 raft_consensus.cc:2454] T 77033f988abb435db5db92b194a01100 P 8bfbc623d17f4a4ab8c94b8f466ed410 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b476811982d34641b7b980144c756044 in term 1.
I20260923 17:14:36.768854 20008 raft_consensus.cc:2454] T 77033f988abb435db5db92b194a01100 P 50bfee15e69e45568301f1c244c3c22f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b476811982d34641b7b980144c756044 in term 1.
I20260923 17:14:36.769559 19809 leader_election.cc:302] T 77033f988abb435db5db92b194a01100 P b476811982d34641b7b980144c756044 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bfbc623d17f4a4ab8c94b8f466ed410, b476811982d34641b7b980144c756044; no voters:
I20260923 17:14:36.769793 20238 raft_consensus.cc:2781] T 77033f988abb435db5db92b194a01100 P b476811982d34641b7b980144c756044 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:14:36.770040 20238 raft_consensus.cc:686] T 77033f988abb435db5db92b194a01100 P b476811982d34641b7b980144c756044 [term 1 LEADER]: Becoming Leader. State: Replica: b476811982d34641b7b980144c756044, State: Running, Role: LEADER
I20260923 17:14:36.770455 20238 consensus_queue.cc:237] T 77033f988abb435db5db92b194a01100 P b476811982d34641b7b980144c756044 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } } peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } }
I20260923 17:14:36.771808 20272 tablet_replica.cc:439] T 77033f988abb435db5db92b194a01100 P b476811982d34641b7b980144c756044: TxnStatusTablet state changed. Reason: New leader b476811982d34641b7b980144c756044. Latest consensus state: current_term: 1 leader_uuid: "b476811982d34641b7b980144c756044" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } } peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } } }
I20260923 17:14:36.771941 20272 tablet_replica.cc:442] T 77033f988abb435db5db92b194a01100 P b476811982d34641b7b980144c756044: This TxnStatusTablet replica's current role is: LEADER
I20260923 17:14:36.772202 20274 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260923 17:14:36.772360 20274 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260923 17:14:36.773293 19720 catalog_manager.cc:5495] T 77033f988abb435db5db92b194a01100 P b476811982d34641b7b980144c756044 reported cstate change: term changed from 0 to 1, leader changed from <none> to b476811982d34641b7b980144c756044 (127.11.229.129). New cstate: current_term: 1 leader_uuid: "b476811982d34641b7b980144c756044" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } health_report { overall_health: HEALTHY } } }
I20260923 17:14:36.824242 20265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:36.820252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:45629 (local address 127.0.0.1:43704)
0923 17:14:36.820417 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:36.820429 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:36.820514 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:36.820960 (+ 446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:36.820963 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:36.820973 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0923 17:14:36.821088 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:36.821093 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:36.821844 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:36.821849 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:36.822526 (+ 677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:36.822534 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:36.823038 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:36.823042 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:36.823130 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:36.823172 (+ 42us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0923 17:14:36.823862 (+ 690us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0923 17:14:36.823877 (+ 15us) client_negotiation.cc:769] Sending connection context
0923 17:14:36.823970 (+ 93us) client_negotiation.cc:240] Negotiation successful
0923 17:14:36.824069 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260923 17:14:36.824285 20277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:36.820471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43704 (local address 127.11.229.129:45629)
0923 17:14:36.820703 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:36.820706 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:36.820717 (+ 11us) server_negotiation.cc:407] Connection header received
0923 17:14:36.820779 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:36.820781 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:36.820830 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:36.820938 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 17:14:36.821194 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:36.821735 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:36.822638 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:36.822932 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:36.823041 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:36.823340 (+ 299us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 17:14:36.823760 (+ 420us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 17:14:36.823878 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:36.824022 (+ 144us) server_negotiation.cc:299] Negotiation successful
0923 17:14:36.824113 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":65,"threads_started":1}
I20260923 17:14:36.827191 20008 raft_consensus.cc:1261] T 77033f988abb435db5db92b194a01100 P 50bfee15e69e45568301f1c244c3c22f [term 1 FOLLOWER]: Refusing update from remote peer b476811982d34641b7b980144c756044: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:14:36.827481 20157 raft_consensus.cc:1261] T 77033f988abb435db5db92b194a01100 P 8bfbc623d17f4a4ab8c94b8f466ed410 [term 1 FOLLOWER]: Refusing update from remote peer b476811982d34641b7b980144c756044: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:14:36.827718 20272 consensus_queue.cc:1035] T 77033f988abb435db5db92b194a01100 P b476811982d34641b7b980144c756044 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:14:36.827978 20238 consensus_queue.cc:1035] T 77033f988abb435db5db92b194a01100 P b476811982d34641b7b980144c756044 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:14:36.829241 20237 tablet_replica.cc:439] T 77033f988abb435db5db92b194a01100 P 50bfee15e69e45568301f1c244c3c22f: TxnStatusTablet state changed. Reason: New leader b476811982d34641b7b980144c756044. Latest consensus state: current_term: 1 leader_uuid: "b476811982d34641b7b980144c756044" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } } peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } } }
I20260923 17:14:36.829348 20237 tablet_replica.cc:442] T 77033f988abb435db5db92b194a01100 P 50bfee15e69e45568301f1c244c3c22f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 17:14:36.829646 20241 tablet_replica.cc:439] T 77033f988abb435db5db92b194a01100 P 8bfbc623d17f4a4ab8c94b8f466ed410: TxnStatusTablet state changed. Reason: New leader b476811982d34641b7b980144c756044. Latest consensus state: current_term: 1 leader_uuid: "b476811982d34641b7b980144c756044" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } } peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } } }
I20260923 17:14:36.829752 20241 tablet_replica.cc:442] T 77033f988abb435db5db92b194a01100 P 8bfbc623d17f4a4ab8c94b8f466ed410: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 17:14:36.831874 20272 tablet_replica.cc:439] T 77033f988abb435db5db92b194a01100 P b476811982d34641b7b980144c756044: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b476811982d34641b7b980144c756044" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } } peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } } }
I20260923 17:14:36.831990 20272 tablet_replica.cc:442] T 77033f988abb435db5db92b194a01100 P b476811982d34641b7b980144c756044: This TxnStatusTablet replica's current role is: LEADER
I20260923 17:14:36.832314 20272 tablet_replica.cc:439] T 77033f988abb435db5db92b194a01100 P b476811982d34641b7b980144c756044: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b476811982d34641b7b980144c756044" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } } peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } } }
I20260923 17:14:36.832415 20272 tablet_replica.cc:442] T 77033f988abb435db5db92b194a01100 P b476811982d34641b7b980144c756044: This TxnStatusTablet replica's current role is: LEADER
I20260923 17:14:36.832576 20241 tablet_replica.cc:439] T 77033f988abb435db5db92b194a01100 P 8bfbc623d17f4a4ab8c94b8f466ed410: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b476811982d34641b7b980144c756044" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } } peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } } }
I20260923 17:14:36.832669 20241 tablet_replica.cc:442] T 77033f988abb435db5db92b194a01100 P 8bfbc623d17f4a4ab8c94b8f466ed410: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 17:14:36.834362 20237 tablet_replica.cc:439] T 77033f988abb435db5db92b194a01100 P 50bfee15e69e45568301f1c244c3c22f: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b476811982d34641b7b980144c756044" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } } peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } } }
I20260923 17:14:36.834486 20237 tablet_replica.cc:442] T 77033f988abb435db5db92b194a01100 P 50bfee15e69e45568301f1c244c3c22f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260923 17:14:36.846683 20288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:36.842796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:45629 (local address 127.11.229.131:35691)
0923 17:14:36.843164 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:36.843175 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:36.843309 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:36.843562 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:36.843564 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:36.843570 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0923 17:14:36.843656 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:36.843660 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:36.844671 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:36.844673 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:36.845378 (+ 705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:36.845387 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:36.845980 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:36.845989 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:36.846049 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:36.846090 (+ 41us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0923 17:14:36.846414 (+ 324us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0923 17:14:36.846423 (+ 9us) client_negotiation.cc:769] Sending connection context
0923 17:14:36.846493 (+ 70us) client_negotiation.cc:240] Negotiation successful
0923 17:14:36.846563 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":103,"threads_started":1}
I20260923 17:14:36.846698 20277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:36.842895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:35691 (local address 127.11.229.129:45629)
0923 17:14:36.843027 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:36.843031 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:36.843253 (+ 222us) server_negotiation.cc:407] Connection header received
0923 17:14:36.843406 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:36.843410 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:36.843467 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:36.843548 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 17:14:36.843780 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:36.844572 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:36.845486 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:36.845858 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:36.845975 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:36.846217 (+ 242us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 17:14:36.846325 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 17:14:36.846396 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:36.846501 (+ 105us) server_negotiation.cc:299] Negotiation successful
0923 17:14:36.846553 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260923 17:14:36.850581 20241 consensus_queue.cc:1035] T 91bfa2a8835e4cbea951840ecef1c269 P 8bfbc623d17f4a4ab8c94b8f466ed410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:14:36.854297 20239 consensus_queue.cc:1035] T 91bfa2a8835e4cbea951840ecef1c269 P 8bfbc623d17f4a4ab8c94b8f466ed410 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:14:36.879557 20228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:36.875485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:33123 (local address 127.11.229.131:42787)
0923 17:14:36.875607 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:36.875612 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:36.875625 (+ 13us) server_negotiation.cc:407] Connection header received
0923 17:14:36.875670 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:36.875673 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:36.875758 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:36.875827 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 17:14:36.876140 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:36.876908 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:36.878156 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:36.878518 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:36.878596 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:36.879006 (+ 410us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 17:14:36.879108 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 17:14:36.879154 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:36.879364 (+ 210us) server_negotiation.cc:299] Negotiation successful
0923 17:14:36.879423 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260923 17:14:36.880141 20294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:36.875097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.131:42787 (local address 127.11.229.129:33123)
0923 17:14:36.875468 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:36.875484 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:36.875576 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:36.875847 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:36.875850 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:36.875859 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0923 17:14:36.876018 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:36.876026 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:36.877049 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:36.877055 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:36.877976 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:36.878034 (+ 58us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:36.878707 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:36.878710 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:36.878802 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:36.878854 (+ 52us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0923 17:14:36.879259 (+ 405us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0923 17:14:36.879265 (+ 6us) client_negotiation.cc:769] Sending connection context
0923 17:14:36.879914 (+ 649us) client_negotiation.cc:240] Negotiation successful
0923 17:14:36.880002 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":134,"threads_started":1}
I20260923 17:14:36.907137 19719 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44994:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:14:36.907315 19719 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44994:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:14:36.909413 19719 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ad4a043a0e6c49429daa823bd4a05146: Sending DeleteTablet for 3 replicas of tablet 91bfa2a8835e4cbea951840ecef1c269
I20260923 17:14:36.910073 19997 tablet_service.cc:1514] Processing DeleteTablet for tablet 91bfa2a8835e4cbea951840ecef1c269 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:14:36 UTC) from {username='oryx', principal='oryx/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:55992
I20260923 17:14:36.910070 20137 tablet_service.cc:1514] Processing DeleteTablet for tablet 91bfa2a8835e4cbea951840ecef1c269 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:14:36 UTC) from {username='oryx', principal='oryx/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:56074
I20260923 17:14:36.910427 20296 tablet_replica.cc:330] T 91bfa2a8835e4cbea951840ecef1c269 P 50bfee15e69e45568301f1c244c3c22f: stopping tablet replica
I20260923 17:14:36.910573 20296 raft_consensus.cc:2229] T 91bfa2a8835e4cbea951840ecef1c269 P 50bfee15e69e45568301f1c244c3c22f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:14:36.910699 20296 raft_consensus.cc:2258] T 91bfa2a8835e4cbea951840ecef1c269 P 50bfee15e69e45568301f1c244c3c22f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:14:36.911579 20296 ts_tablet_manager.cc:1905] T 91bfa2a8835e4cbea951840ecef1c269 P 50bfee15e69e45568301f1c244c3c22f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:14:36.913187 19857 tablet_service.cc:1514] Processing DeleteTablet for tablet 91bfa2a8835e4cbea951840ecef1c269 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:14:36 UTC) from {username='oryx', principal='oryx/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:43700
I20260923 17:14:36.914443 20299 tablet_replica.cc:330] T 91bfa2a8835e4cbea951840ecef1c269 P b476811982d34641b7b980144c756044: stopping tablet replica
I20260923 17:14:36.914629 20299 raft_consensus.cc:2229] T 91bfa2a8835e4cbea951840ecef1c269 P b476811982d34641b7b980144c756044 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:14:36.914808 20299 raft_consensus.cc:2258] T 91bfa2a8835e4cbea951840ecef1c269 P b476811982d34641b7b980144c756044 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:14:36.915457 20296 ts_tablet_manager.cc:1918] T 91bfa2a8835e4cbea951840ecef1c269 P 50bfee15e69e45568301f1c244c3c22f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 17:14:36.915547 20296 log.cc:1196] T 91bfa2a8835e4cbea951840ecef1c269 P 50bfee15e69e45568301f1c244c3c22f: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-1/wal/wals/91bfa2a8835e4cbea951840ecef1c269
I20260923 17:14:36.915691 20299 ts_tablet_manager.cc:1905] T 91bfa2a8835e4cbea951840ecef1c269 P b476811982d34641b7b980144c756044: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:14:36.915834 20296 ts_tablet_manager.cc:1939] T 91bfa2a8835e4cbea951840ecef1c269 P 50bfee15e69e45568301f1c244c3c22f: Deleting consensus metadata
I20260923 17:14:36.916652 20297 tablet_replica.cc:330] T 91bfa2a8835e4cbea951840ecef1c269 P 8bfbc623d17f4a4ab8c94b8f466ed410: stopping tablet replica
I20260923 17:14:36.916805 20297 raft_consensus.cc:2229] T 91bfa2a8835e4cbea951840ecef1c269 P 8bfbc623d17f4a4ab8c94b8f466ed410 [term 1 LEADER]: Raft consensus shutting down.
I20260923 17:14:36.916833 19707 catalog_manager.cc:4841] TS 50bfee15e69e45568301f1c244c3c22f (127.11.229.130:38051): tablet 91bfa2a8835e4cbea951840ecef1c269 (table test-table [id=4781682a5ce044469f2ab047af2984a8]) successfully deleted
I20260923 17:14:36.917028 20297 raft_consensus.cc:2258] T 91bfa2a8835e4cbea951840ecef1c269 P 8bfbc623d17f4a4ab8c94b8f466ed410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:14:36.917928 20297 ts_tablet_manager.cc:1905] T 91bfa2a8835e4cbea951840ecef1c269 P 8bfbc623d17f4a4ab8c94b8f466ed410: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:14:36.918974 20299 ts_tablet_manager.cc:1918] T 91bfa2a8835e4cbea951840ecef1c269 P b476811982d34641b7b980144c756044: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 17:14:36.919056 20299 log.cc:1196] T 91bfa2a8835e4cbea951840ecef1c269 P b476811982d34641b7b980144c756044: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-0/wal/wals/91bfa2a8835e4cbea951840ecef1c269
I20260923 17:14:36.919335 20299 ts_tablet_manager.cc:1939] T 91bfa2a8835e4cbea951840ecef1c269 P b476811982d34641b7b980144c756044: Deleting consensus metadata
I20260923 17:14:36.920077 19706 catalog_manager.cc:4841] TS b476811982d34641b7b980144c756044 (127.11.229.129:45629): tablet 91bfa2a8835e4cbea951840ecef1c269 (table test-table [id=4781682a5ce044469f2ab047af2984a8]) successfully deleted
I20260923 17:14:36.920452 20297 ts_tablet_manager.cc:1918] T 91bfa2a8835e4cbea951840ecef1c269 P 8bfbc623d17f4a4ab8c94b8f466ed410: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 17:14:36.920545 20297 log.cc:1196] T 91bfa2a8835e4cbea951840ecef1c269 P 8bfbc623d17f4a4ab8c94b8f466ed410: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-2/wal/wals/91bfa2a8835e4cbea951840ecef1c269
I20260923 17:14:36.920821 20297 ts_tablet_manager.cc:1939] T 91bfa2a8835e4cbea951840ecef1c269 P 8bfbc623d17f4a4ab8c94b8f466ed410: Deleting consensus metadata
I20260923 17:14:36.921756 19705 catalog_manager.cc:4841] TS 8bfbc623d17f4a4ab8c94b8f466ed410 (127.11.229.131:42787): tablet 91bfa2a8835e4cbea951840ecef1c269 (table test-table [id=4781682a5ce044469f2ab047af2984a8]) successfully deleted
Sep 23 17:14:36 dist-test-slave-1x1f krb5kdc[19675](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183676, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 23 17:14:36 dist-test-slave-1x1f krb5kdc[19675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:36 dist-test-slave-1x1f krb5kdc[19675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
W20260923 17:14:36.942154 20266 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:36.935146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45016 (local address 127.11.229.190:38787)
0923 17:14:36.935302 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:36.935332 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:36.935594 (+ 262us) server_negotiation.cc:407] Connection header received
0923 17:14:36.935723 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:36.935727 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:36.935800 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:36.935917 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:36.936594 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:36.937457 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:36.938387 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:36.938628 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:36.938746 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:36.942023 (+ 3277us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:45016: BlockingRecv error: recv got EOF from 127.0.0.1:45016 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Sep 23 17:14:36 dist-test-slave-1x1f krb5kdc[19675](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183676, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM
I20260923 17:14:36.953029 20266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:36.943996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45018 (local address 127.11.229.190:38787)
0923 17:14:36.944106 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:36.944111 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:36.944192 (+ 81us) server_negotiation.cc:407] Connection header received
0923 17:14:36.944317 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:36.944320 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:36.944370 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:36.944462 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:36.945016 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:36.945724 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:36.946615 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:36.946954 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:36.947081 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:36.949676 (+ 2595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:36.949680 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:36.949683 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:36.949715 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:36.951496 (+ 1781us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:36.951907 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:36.951909 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:36.951910 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:36.951984 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:36.952306 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:36.952308 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:36.952309 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:36.952491 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:36.952590 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:36.952802 (+ 212us) server_negotiation.cc:299] Negotiation successful
0923 17:14:36.952908 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260923 17:14:36.955713 19719 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45018:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 17:14:36.956238 19719 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 17:14:36.960940 19857 tablet_service.cc:1467] Processing CreateTablet for tablet 183cbbbdbe3f4cc8aaf9b615e1fa8127 (DEFAULT_TABLE table=test-table [id=b34be04b4793486c91821e20409a9e0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:14:36.961170 20137 tablet_service.cc:1467] Processing CreateTablet for tablet 183cbbbdbe3f4cc8aaf9b615e1fa8127 (DEFAULT_TABLE table=test-table [id=b34be04b4793486c91821e20409a9e0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:14:36.961292 19857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 183cbbbdbe3f4cc8aaf9b615e1fa8127. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:36.961474 20137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 183cbbbdbe3f4cc8aaf9b615e1fa8127. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:36.962532 19997 tablet_service.cc:1467] Processing CreateTablet for tablet 183cbbbdbe3f4cc8aaf9b615e1fa8127 (DEFAULT_TABLE table=test-table [id=b34be04b4793486c91821e20409a9e0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:14:36.962817 19997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 183cbbbdbe3f4cc8aaf9b615e1fa8127. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:36.963564 20232 tablet_bootstrap.cc:492] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P b476811982d34641b7b980144c756044: Bootstrap starting.
I20260923 17:14:36.964394 20232 tablet_bootstrap.cc:654] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P b476811982d34641b7b980144c756044: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:36.964876 20233 tablet_bootstrap.cc:492] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P 8bfbc623d17f4a4ab8c94b8f466ed410: Bootstrap starting.
I20260923 17:14:36.964941 20231 tablet_bootstrap.cc:492] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P 50bfee15e69e45568301f1c244c3c22f: Bootstrap starting.
I20260923 17:14:36.965670 20233 tablet_bootstrap.cc:654] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P 8bfbc623d17f4a4ab8c94b8f466ed410: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:36.965854 20231 tablet_bootstrap.cc:654] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P 50bfee15e69e45568301f1c244c3c22f: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:36.965924 20232 tablet_bootstrap.cc:492] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P b476811982d34641b7b980144c756044: No bootstrap required, opened a new log
I20260923 17:14:36.966012 20232 ts_tablet_manager.cc:1397] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P b476811982d34641b7b980144c756044: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260923 17:14:36.966522 20232 raft_consensus.cc:348] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P b476811982d34641b7b980144c756044 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } } peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } }
I20260923 17:14:36.966658 20232 raft_consensus.cc:374] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P b476811982d34641b7b980144c756044 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:36.966697 20232 raft_consensus.cc:729] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P b476811982d34641b7b980144c756044 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b476811982d34641b7b980144c756044, State: Initialized, Role: FOLLOWER
I20260923 17:14:36.966830 20232 consensus_queue.cc:260] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P b476811982d34641b7b980144c756044 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } } peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } }
I20260923 17:14:36.966976 20233 tablet_bootstrap.cc:492] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P 8bfbc623d17f4a4ab8c94b8f466ed410: No bootstrap required, opened a new log
I20260923 17:14:36.967073 20233 ts_tablet_manager.cc:1397] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P 8bfbc623d17f4a4ab8c94b8f466ed410: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260923 17:14:36.967099 20231 tablet_bootstrap.cc:492] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P 50bfee15e69e45568301f1c244c3c22f: No bootstrap required, opened a new log
I20260923 17:14:36.967123 20232 ts_tablet_manager.cc:1428] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P b476811982d34641b7b980144c756044: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260923 17:14:36.967175 20231 ts_tablet_manager.cc:1397] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P 50bfee15e69e45568301f1c244c3c22f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260923 17:14:36.967478 20233 raft_consensus.cc:348] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P 8bfbc623d17f4a4ab8c94b8f466ed410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } } peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } }
I20260923 17:14:36.967600 20233 raft_consensus.cc:374] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P 8bfbc623d17f4a4ab8c94b8f466ed410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:36.967562 20231 raft_consensus.cc:348] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P 50bfee15e69e45568301f1c244c3c22f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } } peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } }
I20260923 17:14:36.967648 20233 raft_consensus.cc:729] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P 8bfbc623d17f4a4ab8c94b8f466ed410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bfbc623d17f4a4ab8c94b8f466ed410, State: Initialized, Role: FOLLOWER
I20260923 17:14:36.967666 20231 raft_consensus.cc:374] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P 50bfee15e69e45568301f1c244c3c22f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:36.967700 20231 raft_consensus.cc:729] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P 50bfee15e69e45568301f1c244c3c22f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50bfee15e69e45568301f1c244c3c22f, State: Initialized, Role: FOLLOWER
I20260923 17:14:36.967788 20233 consensus_queue.cc:260] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P 8bfbc623d17f4a4ab8c94b8f466ed410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } } peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } }
I20260923 17:14:36.967845 20231 consensus_queue.cc:260] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P 50bfee15e69e45568301f1c244c3c22f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } } peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } }
I20260923 17:14:36.968078 20233 ts_tablet_manager.cc:1428] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P 8bfbc623d17f4a4ab8c94b8f466ed410: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260923 17:14:36.968114 20231 ts_tablet_manager.cc:1428] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P 50bfee15e69e45568301f1c244c3c22f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260923 17:14:37.160058 20292 raft_consensus.cc:482] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P b476811982d34641b7b980144c756044 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 17:14:37.160238 20292 raft_consensus.cc:504] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P b476811982d34641b7b980144c756044 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } } peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } }
I20260923 17:14:37.160778 20292 leader_election.cc:288] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P b476811982d34641b7b980144c756044 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 50bfee15e69e45568301f1c244c3c22f (127.11.229.130:38051), 8bfbc623d17f4a4ab8c94b8f466ed410 (127.11.229.131:42787)
I20260923 17:14:37.161290 20157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "183cbbbdbe3f4cc8aaf9b615e1fa8127" candidate_uuid: "b476811982d34641b7b980144c756044" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" is_pre_election: true
I20260923 17:14:37.161319 20012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "183cbbbdbe3f4cc8aaf9b615e1fa8127" candidate_uuid: "b476811982d34641b7b980144c756044" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50bfee15e69e45568301f1c244c3c22f" is_pre_election: true
I20260923 17:14:37.161465 20157 raft_consensus.cc:2454] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P 8bfbc623d17f4a4ab8c94b8f466ed410 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b476811982d34641b7b980144c756044 in term 0.
I20260923 17:14:37.161465 20012 raft_consensus.cc:2454] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P 50bfee15e69e45568301f1c244c3c22f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b476811982d34641b7b980144c756044 in term 0.
I20260923 17:14:37.161836 19809 leader_election.cc:302] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P b476811982d34641b7b980144c756044 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bfbc623d17f4a4ab8c94b8f466ed410, b476811982d34641b7b980144c756044; no voters:
I20260923 17:14:37.162042 20292 raft_consensus.cc:2781] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P b476811982d34641b7b980144c756044 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 17:14:37.162117 20292 raft_consensus.cc:482] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P b476811982d34641b7b980144c756044 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 17:14:37.162147 20292 raft_consensus.cc:3037] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P b476811982d34641b7b980144c756044 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:37.163203 20292 raft_consensus.cc:504] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P b476811982d34641b7b980144c756044 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } } peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } }
I20260923 17:14:37.163532 20292 leader_election.cc:288] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P b476811982d34641b7b980144c756044 [CANDIDATE]: Term 1 election: Requested vote from peers 50bfee15e69e45568301f1c244c3c22f (127.11.229.130:38051), 8bfbc623d17f4a4ab8c94b8f466ed410 (127.11.229.131:42787)
I20260923 17:14:37.163921 20012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "183cbbbdbe3f4cc8aaf9b615e1fa8127" candidate_uuid: "b476811982d34641b7b980144c756044" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "50bfee15e69e45568301f1c244c3c22f"
I20260923 17:14:37.163921 20157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "183cbbbdbe3f4cc8aaf9b615e1fa8127" candidate_uuid: "b476811982d34641b7b980144c756044" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410"
I20260923 17:14:37.164060 20157 raft_consensus.cc:3037] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P 8bfbc623d17f4a4ab8c94b8f466ed410 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:37.164060 20012 raft_consensus.cc:3037] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P 50bfee15e69e45568301f1c244c3c22f [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:37.165295 20157 raft_consensus.cc:2454] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P 8bfbc623d17f4a4ab8c94b8f466ed410 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b476811982d34641b7b980144c756044 in term 1.
I20260923 17:14:37.165619 19809 leader_election.cc:302] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P b476811982d34641b7b980144c756044 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8bfbc623d17f4a4ab8c94b8f466ed410, b476811982d34641b7b980144c756044; no voters:
I20260923 17:14:37.165678 20012 raft_consensus.cc:2454] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P 50bfee15e69e45568301f1c244c3c22f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b476811982d34641b7b980144c756044 in term 1.
I20260923 17:14:37.165848 20292 raft_consensus.cc:2781] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P b476811982d34641b7b980144c756044 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:14:37.165944 20292 raft_consensus.cc:686] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P b476811982d34641b7b980144c756044 [term 1 LEADER]: Becoming Leader. State: Replica: b476811982d34641b7b980144c756044, State: Running, Role: LEADER
I20260923 17:14:37.166087 20292 consensus_queue.cc:237] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P b476811982d34641b7b980144c756044 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } } peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } }
I20260923 17:14:37.167860 19720 catalog_manager.cc:5495] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P b476811982d34641b7b980144c756044 reported cstate change: term changed from 0 to 1, leader changed from <none> to b476811982d34641b7b980144c756044 (127.11.229.129). New cstate: current_term: 1 leader_uuid: "b476811982d34641b7b980144c756044" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } health_report { overall_health: UNKNOWN } } }
I20260923 17:14:37.204092 20277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:37.200804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43708 (local address 127.11.229.129:45629)
0923 17:14:37.200966 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:37.200971 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:37.200985 (+ 14us) server_negotiation.cc:407] Connection header received
0923 17:14:37.201118 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:37.201121 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:37.201177 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:37.201324 (+ 147us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 17:14:37.201598 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:37.202118 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:37.203022 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:37.203260 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:37.203368 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:37.203622 (+ 254us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 17:14:37.203688 (+ 66us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 17:14:37.203769 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:37.203893 (+ 124us) server_negotiation.cc:299] Negotiation successful
0923 17:14:37.203945 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260923 17:14:37.206522 20157 raft_consensus.cc:1261] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P 8bfbc623d17f4a4ab8c94b8f466ed410 [term 1 FOLLOWER]: Refusing update from remote peer b476811982d34641b7b980144c756044: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:14:37.206594 20012 raft_consensus.cc:1261] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P 50bfee15e69e45568301f1c244c3c22f [term 1 FOLLOWER]: Refusing update from remote peer b476811982d34641b7b980144c756044: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:14:37.206943 20238 consensus_queue.cc:1035] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P b476811982d34641b7b980144c756044 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:14:37.207208 20292 consensus_queue.cc:1035] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P b476811982d34641b7b980144c756044 [LEADER]: Connected to new peer: Peer: permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:14:37.216558 19720 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45018:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:14:37.216717 19720 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45018:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:14:37.218972 19720 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ad4a043a0e6c49429daa823bd4a05146: Sending DeleteTablet for 3 replicas of tablet 183cbbbdbe3f4cc8aaf9b615e1fa8127
I20260923 17:14:37.219616 19997 tablet_service.cc:1514] Processing DeleteTablet for tablet 183cbbbdbe3f4cc8aaf9b615e1fa8127 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:14:37 UTC) from {username='oryx', principal='oryx/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:55992
I20260923 17:14:37.219627 20137 tablet_service.cc:1514] Processing DeleteTablet for tablet 183cbbbdbe3f4cc8aaf9b615e1fa8127 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:14:37 UTC) from {username='oryx', principal='oryx/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:56074
I20260923 17:14:37.219800 20296 tablet_replica.cc:330] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P 50bfee15e69e45568301f1c244c3c22f: stopping tablet replica
I20260923 17:14:37.219805 20297 tablet_replica.cc:330] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P 8bfbc623d17f4a4ab8c94b8f466ed410: stopping tablet replica
I20260923 17:14:37.219909 20297 raft_consensus.cc:2229] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P 8bfbc623d17f4a4ab8c94b8f466ed410 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:14:37.219910 20296 raft_consensus.cc:2229] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P 50bfee15e69e45568301f1c244c3c22f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:14:37.220031 20297 raft_consensus.cc:2258] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P 8bfbc623d17f4a4ab8c94b8f466ed410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:14:37.220052 20296 raft_consensus.cc:2258] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P 50bfee15e69e45568301f1c244c3c22f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:14:37.220333 19857 tablet_service.cc:1514] Processing DeleteTablet for tablet 183cbbbdbe3f4cc8aaf9b615e1fa8127 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:14:37 UTC) from {username='oryx', principal='oryx/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:43700
I20260923 17:14:37.220263 19720 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45018:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260923 17:14:37.220515 20299 tablet_replica.cc:330] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P b476811982d34641b7b980144c756044: stopping tablet replica
I20260923 17:14:37.220768 20299 raft_consensus.cc:2229] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P b476811982d34641b7b980144c756044 [term 1 LEADER]: Raft consensus shutting down.
W20260923 17:14:37.220858 19720 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 17:14:37.221107 20299 raft_consensus.cc:2258] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P b476811982d34641b7b980144c756044 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:14:37.221232 20296 ts_tablet_manager.cc:1905] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P 50bfee15e69e45568301f1c244c3c22f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:14:37.221957 20299 ts_tablet_manager.cc:1905] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P b476811982d34641b7b980144c756044: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:14:37.223838 20296 ts_tablet_manager.cc:1918] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P 50bfee15e69e45568301f1c244c3c22f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 17:14:37.223908 20296 log.cc:1196] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P 50bfee15e69e45568301f1c244c3c22f: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-1/wal/wals/183cbbbdbe3f4cc8aaf9b615e1fa8127
I20260923 17:14:37.224169 20296 ts_tablet_manager.cc:1939] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P 50bfee15e69e45568301f1c244c3c22f: Deleting consensus metadata
I20260923 17:14:37.224301 20299 ts_tablet_manager.cc:1918] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P b476811982d34641b7b980144c756044: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 17:14:37.224366 20299 log.cc:1196] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P b476811982d34641b7b980144c756044: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-0/wal/wals/183cbbbdbe3f4cc8aaf9b615e1fa8127
I20260923 17:14:37.224601 20299 ts_tablet_manager.cc:1939] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P b476811982d34641b7b980144c756044: Deleting consensus metadata
I20260923 17:14:37.224905 19707 catalog_manager.cc:4841] TS 50bfee15e69e45568301f1c244c3c22f (127.11.229.130:38051): tablet 183cbbbdbe3f4cc8aaf9b615e1fa8127 (table test-table [id=b34be04b4793486c91821e20409a9e0c]) successfully deleted
I20260923 17:14:37.225363 20297 ts_tablet_manager.cc:1905] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P 8bfbc623d17f4a4ab8c94b8f466ed410: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:14:37.226080 19997 tablet_service.cc:1467] Processing CreateTablet for tablet 72c501200310403ca0739978a919b357 (DEFAULT_TABLE table=test-table [id=d503f8f4d12f47adbfa4cd85dc2f2143]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:14:37.226378 19997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72c501200310403ca0739978a919b357. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:37.226469 20137 tablet_service.cc:1467] Processing CreateTablet for tablet 72c501200310403ca0739978a919b357 (DEFAULT_TABLE table=test-table [id=d503f8f4d12f47adbfa4cd85dc2f2143]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:14:37.226691 20137 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72c501200310403ca0739978a919b357. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:37.228215 20231 tablet_bootstrap.cc:492] T 72c501200310403ca0739978a919b357 P 50bfee15e69e45568301f1c244c3c22f: Bootstrap starting.
I20260923 17:14:37.228778 20233 tablet_bootstrap.cc:492] T 72c501200310403ca0739978a919b357 P 8bfbc623d17f4a4ab8c94b8f466ed410: Bootstrap starting.
I20260923 17:14:37.229200 20231 tablet_bootstrap.cc:654] T 72c501200310403ca0739978a919b357 P 50bfee15e69e45568301f1c244c3c22f: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:37.229141 19857 tablet_service.cc:1467] Processing CreateTablet for tablet 72c501200310403ca0739978a919b357 (DEFAULT_TABLE table=test-table [id=d503f8f4d12f47adbfa4cd85dc2f2143]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:14:37.229373 19857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72c501200310403ca0739978a919b357. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:37.229666 20233 tablet_bootstrap.cc:654] T 72c501200310403ca0739978a919b357 P 8bfbc623d17f4a4ab8c94b8f466ed410: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:37.229991 19706 catalog_manager.cc:4841] TS b476811982d34641b7b980144c756044 (127.11.229.129:45629): tablet 183cbbbdbe3f4cc8aaf9b615e1fa8127 (table test-table [id=b34be04b4793486c91821e20409a9e0c]) successfully deleted
I20260923 17:14:37.230872 20231 tablet_bootstrap.cc:492] T 72c501200310403ca0739978a919b357 P 50bfee15e69e45568301f1c244c3c22f: No bootstrap required, opened a new log
I20260923 17:14:37.230959 20231 ts_tablet_manager.cc:1397] T 72c501200310403ca0739978a919b357 P 50bfee15e69e45568301f1c244c3c22f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260923 17:14:37.231510 20232 tablet_bootstrap.cc:492] T 72c501200310403ca0739978a919b357 P b476811982d34641b7b980144c756044: Bootstrap starting.
I20260923 17:14:37.231460 20231 raft_consensus.cc:348] T 72c501200310403ca0739978a919b357 P 50bfee15e69e45568301f1c244c3c22f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } } peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } }
I20260923 17:14:37.231536 20233 tablet_bootstrap.cc:492] T 72c501200310403ca0739978a919b357 P 8bfbc623d17f4a4ab8c94b8f466ed410: No bootstrap required, opened a new log
I20260923 17:14:37.231565 20231 raft_consensus.cc:374] T 72c501200310403ca0739978a919b357 P 50bfee15e69e45568301f1c244c3c22f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:37.231596 20231 raft_consensus.cc:729] T 72c501200310403ca0739978a919b357 P 50bfee15e69e45568301f1c244c3c22f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 50bfee15e69e45568301f1c244c3c22f, State: Initialized, Role: FOLLOWER
I20260923 17:14:37.231608 20233 ts_tablet_manager.cc:1397] T 72c501200310403ca0739978a919b357 P 8bfbc623d17f4a4ab8c94b8f466ed410: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260923 17:14:37.231747 20231 consensus_queue.cc:260] T 72c501200310403ca0739978a919b357 P 50bfee15e69e45568301f1c244c3c22f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } } peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } }
I20260923 17:14:37.232174 20231 ts_tablet_manager.cc:1428] T 72c501200310403ca0739978a919b357 P 50bfee15e69e45568301f1c244c3c22f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260923 17:14:37.232257 20232 tablet_bootstrap.cc:654] T 72c501200310403ca0739978a919b357 P b476811982d34641b7b980144c756044: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:37.232213 20233 raft_consensus.cc:348] T 72c501200310403ca0739978a919b357 P 8bfbc623d17f4a4ab8c94b8f466ed410 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } } peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } }
I20260923 17:14:37.232338 20233 raft_consensus.cc:374] T 72c501200310403ca0739978a919b357 P 8bfbc623d17f4a4ab8c94b8f466ed410 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:37.232379 20233 raft_consensus.cc:729] T 72c501200310403ca0739978a919b357 P 8bfbc623d17f4a4ab8c94b8f466ed410 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bfbc623d17f4a4ab8c94b8f466ed410, State: Initialized, Role: FOLLOWER
I20260923 17:14:37.232527 20233 consensus_queue.cc:260] T 72c501200310403ca0739978a919b357 P 8bfbc623d17f4a4ab8c94b8f466ed410 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } } peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } }
I20260923 17:14:37.232810 20233 ts_tablet_manager.cc:1428] T 72c501200310403ca0739978a919b357 P 8bfbc623d17f4a4ab8c94b8f466ed410: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260923 17:14:37.232997 20237 raft_consensus.cc:482] T 72c501200310403ca0739978a919b357 P 50bfee15e69e45568301f1c244c3c22f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 17:14:37.233085 20237 raft_consensus.cc:504] T 72c501200310403ca0739978a919b357 P 50bfee15e69e45568301f1c244c3c22f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } } peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } }
I20260923 17:14:37.234059 20232 tablet_bootstrap.cc:492] T 72c501200310403ca0739978a919b357 P b476811982d34641b7b980144c756044: No bootstrap required, opened a new log
I20260923 17:14:37.234153 20232 ts_tablet_manager.cc:1397] T 72c501200310403ca0739978a919b357 P b476811982d34641b7b980144c756044: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260923 17:14:37.234409 20297 ts_tablet_manager.cc:1918] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P 8bfbc623d17f4a4ab8c94b8f466ed410: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 17:14:37.234478 20297 log.cc:1196] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P 8bfbc623d17f4a4ab8c94b8f466ed410: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-2/wal/wals/183cbbbdbe3f4cc8aaf9b615e1fa8127
I20260923 17:14:37.234473 20237 leader_election.cc:288] T 72c501200310403ca0739978a919b357 P 50bfee15e69e45568301f1c244c3c22f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b476811982d34641b7b980144c756044 (127.11.229.129:45629), 8bfbc623d17f4a4ab8c94b8f466ed410 (127.11.229.131:42787)
I20260923 17:14:37.234714 20297 ts_tablet_manager.cc:1939] T 183cbbbdbe3f4cc8aaf9b615e1fa8127 P 8bfbc623d17f4a4ab8c94b8f466ed410: Deleting consensus metadata
I20260923 17:14:37.234755 20232 raft_consensus.cc:348] T 72c501200310403ca0739978a919b357 P b476811982d34641b7b980144c756044 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } } peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } }
I20260923 17:14:37.234876 20232 raft_consensus.cc:374] T 72c501200310403ca0739978a919b357 P b476811982d34641b7b980144c756044 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:37.234915 20232 raft_consensus.cc:729] T 72c501200310403ca0739978a919b357 P b476811982d34641b7b980144c756044 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b476811982d34641b7b980144c756044, State: Initialized, Role: FOLLOWER
I20260923 17:14:37.235059 20232 consensus_queue.cc:260] T 72c501200310403ca0739978a919b357 P b476811982d34641b7b980144c756044 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } } peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } }
I20260923 17:14:37.235347 20232 ts_tablet_manager.cc:1428] T 72c501200310403ca0739978a919b357 P b476811982d34641b7b980144c756044: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260923 17:14:37.236617 19705 catalog_manager.cc:4841] TS 8bfbc623d17f4a4ab8c94b8f466ed410 (127.11.229.131:42787): tablet 183cbbbdbe3f4cc8aaf9b615e1fa8127 (table test-table [id=b34be04b4793486c91821e20409a9e0c]) successfully deleted
I20260923 17:14:37.241009 20277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:37.236086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:43057 (local address 127.11.229.129:45629)
0923 17:14:37.236214 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:37.236219 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:37.236429 (+ 210us) server_negotiation.cc:407] Connection header received
0923 17:14:37.236602 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:37.236605 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:37.236645 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:37.236688 (+ 43us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:14:37.237062 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:37.237829 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:37.239500 (+ 1671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:37.240205 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:37.240336 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:37.240398 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:37.240781 (+ 383us) server_negotiation.cc:299] Negotiation successful
0923 17:14:37.240876 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260923 17:14:37.241595 20323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:37.236029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:45629 (local address 127.11.229.130:43057)
0923 17:14:37.236352 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:37.236366 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:37.236493 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:37.236816 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:37.236819 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:37.236834 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:14:37.236951 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:37.236957 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:37.237980 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:37.237983 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:37.239346 (+ 1363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:37.239357 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:37.240468 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:37.240472 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:37.240605 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:37.240642 (+ 37us) client_negotiation.cc:769] Sending connection context
0923 17:14:37.241341 (+ 699us) client_negotiation.cc:240] Negotiation successful
0923 17:14:37.241433 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":136,"threads_started":1}
I20260923 17:14:37.242274 19877 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72c501200310403ca0739978a919b357" candidate_uuid: "50bfee15e69e45568301f1c244c3c22f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b476811982d34641b7b980144c756044" is_pre_election: true
I20260923 17:14:37.242449 19877 raft_consensus.cc:2454] T 72c501200310403ca0739978a919b357 P b476811982d34641b7b980144c756044 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50bfee15e69e45568301f1c244c3c22f in term 0.
I20260923 17:14:37.242827 19950 leader_election.cc:302] T 72c501200310403ca0739978a919b357 P 50bfee15e69e45568301f1c244c3c22f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 50bfee15e69e45568301f1c244c3c22f, b476811982d34641b7b980144c756044; no voters:
I20260923 17:14:37.243148 20321 raft_consensus.cc:2781] T 72c501200310403ca0739978a919b357 P 50bfee15e69e45568301f1c244c3c22f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 17:14:37.243228 20321 raft_consensus.cc:482] T 72c501200310403ca0739978a919b357 P 50bfee15e69e45568301f1c244c3c22f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 17:14:37.243269 20321 raft_consensus.cc:3037] T 72c501200310403ca0739978a919b357 P 50bfee15e69e45568301f1c244c3c22f [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:37.244491 20321 raft_consensus.cc:504] T 72c501200310403ca0739978a919b357 P 50bfee15e69e45568301f1c244c3c22f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } } peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } }
I20260923 17:14:37.244936 20321 leader_election.cc:288] T 72c501200310403ca0739978a919b357 P 50bfee15e69e45568301f1c244c3c22f [CANDIDATE]: Term 1 election: Requested vote from peers b476811982d34641b7b980144c756044 (127.11.229.129:45629), 8bfbc623d17f4a4ab8c94b8f466ed410 (127.11.229.131:42787)
I20260923 17:14:37.245273 19877 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72c501200310403ca0739978a919b357" candidate_uuid: "50bfee15e69e45568301f1c244c3c22f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b476811982d34641b7b980144c756044"
I20260923 17:14:37.245402 19877 raft_consensus.cc:3037] T 72c501200310403ca0739978a919b357 P b476811982d34641b7b980144c756044 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:37.245527 20324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:37.239930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.131:42787 (local address 127.11.229.130:38773)
0923 17:14:37.240216 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:37.240231 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:37.240315 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:37.240627 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:37.240629 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:37.240644 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:14:37.240763 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:37.240768 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:37.241759 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:37.241762 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:37.242976 (+ 1214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:37.242986 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:37.245092 (+ 2106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:37.245096 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:37.245207 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:37.245231 (+ 24us) client_negotiation.cc:769] Sending connection context
0923 17:14:37.245311 (+ 80us) client_negotiation.cc:240] Negotiation successful
0923 17:14:37.245379 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":116,"threads_started":1}
I20260923 17:14:37.245554 20228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:37.240295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:38773 (local address 127.11.229.131:42787)
0923 17:14:37.240405 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:37.240412 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:37.240426 (+ 14us) server_negotiation.cc:407] Connection header received
0923 17:14:37.240471 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:37.240474 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:37.240523 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:37.240611 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:14:37.240887 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:37.241624 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:37.243090 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:37.243783 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:37.243875 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:37.243914 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:37.245341 (+ 1427us) server_negotiation.cc:299] Negotiation successful
0923 17:14:37.245431 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260923 17:14:37.245952 20157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72c501200310403ca0739978a919b357" candidate_uuid: "50bfee15e69e45568301f1c244c3c22f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" is_pre_election: true
I20260923 17:14:37.245975 20155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72c501200310403ca0739978a919b357" candidate_uuid: "50bfee15e69e45568301f1c244c3c22f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410"
I20260923 17:14:37.246070 20157 raft_consensus.cc:2454] T 72c501200310403ca0739978a919b357 P 8bfbc623d17f4a4ab8c94b8f466ed410 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 50bfee15e69e45568301f1c244c3c22f in term 0.
I20260923 17:14:37.246670 19877 raft_consensus.cc:2454] T 72c501200310403ca0739978a919b357 P b476811982d34641b7b980144c756044 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 50bfee15e69e45568301f1c244c3c22f in term 1.
I20260923 17:14:37.246932 19950 leader_election.cc:302] T 72c501200310403ca0739978a919b357 P 50bfee15e69e45568301f1c244c3c22f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 50bfee15e69e45568301f1c244c3c22f, b476811982d34641b7b980144c756044; no voters: 8bfbc623d17f4a4ab8c94b8f466ed410
I20260923 17:14:37.247190 20321 raft_consensus.cc:2781] T 72c501200310403ca0739978a919b357 P 50bfee15e69e45568301f1c244c3c22f [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:14:37.247287 20321 raft_consensus.cc:686] T 72c501200310403ca0739978a919b357 P 50bfee15e69e45568301f1c244c3c22f [term 1 LEADER]: Becoming Leader. State: Replica: 50bfee15e69e45568301f1c244c3c22f, State: Running, Role: LEADER
I20260923 17:14:37.247509 20321 consensus_queue.cc:237] T 72c501200310403ca0739978a919b357 P 50bfee15e69e45568301f1c244c3c22f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } } peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } } peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } }
I20260923 17:14:37.249809 19720 catalog_manager.cc:5495] T 72c501200310403ca0739978a919b357 P 50bfee15e69e45568301f1c244c3c22f reported cstate change: term changed from 0 to 1, leader changed from <none> to 50bfee15e69e45568301f1c244c3c22f (127.11.229.130). New cstate: current_term: 1 leader_uuid: "50bfee15e69e45568301f1c244c3c22f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "50bfee15e69e45568301f1c244c3c22f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 38051 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 } health_report { overall_health: UNKNOWN } } }
I20260923 17:14:37.265252 20230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:37.261325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56008 (local address 127.11.229.130:38051)
0923 17:14:37.261439 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:37.261442 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:37.261455 (+ 13us) server_negotiation.cc:407] Connection header received
0923 17:14:37.261573 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:37.261576 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:37.261650 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:37.261744 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 17:14:37.261980 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:37.262592 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:37.263786 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:37.264009 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:37.264090 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:37.264373 (+ 283us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 17:14:37.264839 (+ 466us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 17:14:37.264979 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:37.265043 (+ 64us) server_negotiation.cc:299] Negotiation successful
0923 17:14:37.265099 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260923 17:14:37.275859 20277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:37.272302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:60153 (local address 127.11.229.129:45629)
0923 17:14:37.272431 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:37.272436 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:37.272572 (+ 136us) server_negotiation.cc:407] Connection header received
0923 17:14:37.272702 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:37.272705 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:37.272752 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:37.272816 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 17:14:37.273075 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:37.273575 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:37.274778 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:37.275025 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:37.275121 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:37.275427 (+ 306us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 17:14:37.275491 (+ 64us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 17:14:37.275545 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:37.275688 (+ 143us) server_negotiation.cc:299] Negotiation successful
0923 17:14:37.275754 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260923 17:14:37.275919 20328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:37.272155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:45629 (local address 127.11.229.130:60153)
0923 17:14:37.272483 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:37.272497 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:37.272604 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:37.272846 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:37.272849 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:37.272856 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0923 17:14:37.272978 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:37.272984 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:37.273673 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:37.273677 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:37.274671 (+ 994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:37.274681 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:37.275141 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:37.275145 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:37.275248 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:37.275300 (+ 52us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0923 17:14:37.275569 (+ 269us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0923 17:14:37.275575 (+ 6us) client_negotiation.cc:769] Sending connection context
0923 17:14:37.275659 (+ 84us) client_negotiation.cc:240] Negotiation successful
0923 17:14:37.275731 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":123,"threads_started":1}
I20260923 17:14:37.282810 20157 raft_consensus.cc:3037] T 72c501200310403ca0739978a919b357 P 8bfbc623d17f4a4ab8c94b8f466ed410 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:37.282900 19877 raft_consensus.cc:1261] T 72c501200310403ca0739978a919b357 P b476811982d34641b7b980144c756044 [term 1 FOLLOWER]: Refusing update from remote peer 50bfee15e69e45568301f1c244c3c22f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:14:37.283390 20237 consensus_queue.cc:1035] T 72c501200310403ca0739978a919b357 P 50bfee15e69e45568301f1c244c3c22f [LEADER]: Connected to new peer: Peer: permanent_uuid: "b476811982d34641b7b980144c756044" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 45629 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:14:37.284303 20157 raft_consensus.cc:1261] T 72c501200310403ca0739978a919b357 P 8bfbc623d17f4a4ab8c94b8f466ed410 [term 1 FOLLOWER]: Refusing update from remote peer 50bfee15e69e45568301f1c244c3c22f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:14:37.284716 20237 consensus_queue.cc:1035] T 72c501200310403ca0739978a919b357 P 50bfee15e69e45568301f1c244c3c22f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bfbc623d17f4a4ab8c94b8f466ed410" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:14:37.305151 20294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:37.301086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.130:38051 (local address 127.11.229.129:53097)
0923 17:14:37.301296 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:37.301311 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:37.301438 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:37.301700 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:37.301703 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:37.301712 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0923 17:14:37.301819 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:37.301825 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:37.302890 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:37.302893 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:37.303670 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:37.303679 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:37.304332 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:37.304336 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:37.304427 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:37.304462 (+ 35us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0923 17:14:37.304825 (+ 363us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0923 17:14:37.304834 (+ 9us) client_negotiation.cc:769] Sending connection context
0923 17:14:37.304905 (+ 71us) client_negotiation.cc:240] Negotiation successful
0923 17:14:37.304999 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":86}
I20260923 17:14:37.305544 20230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:37.301119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:53097 (local address 127.11.229.130:38051)
0923 17:14:37.301233 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:37.301238 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:37.301388 (+ 150us) server_negotiation.cc:407] Connection header received
0923 17:14:37.301555 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:37.301558 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:37.301611 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:37.301688 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 17:14:37.301943 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:37.302766 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:37.303797 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:37.304212 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:37.304326 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:37.304584 (+ 258us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 17:14:37.304702 (+ 118us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 17:14:37.304781 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:37.305358 (+ 577us) server_negotiation.cc:299] Negotiation successful
0923 17:14:37.305411 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260923 17:14:37.328444 19719 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45018:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:14:37.328620 19719 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45018:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:14:37.330943 19719 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ad4a043a0e6c49429daa823bd4a05146: Sending DeleteTablet for 3 replicas of tablet 72c501200310403ca0739978a919b357
I20260923 17:14:37.331667 19857 tablet_service.cc:1514] Processing DeleteTablet for tablet 72c501200310403ca0739978a919b357 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:14:37 UTC) from {username='oryx', principal='oryx/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:43700
I20260923 17:14:37.331866 20137 tablet_service.cc:1514] Processing DeleteTablet for tablet 72c501200310403ca0739978a919b357 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:14:37 UTC) from {username='oryx', principal='oryx/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:56074
I20260923 17:14:37.331924 19997 tablet_service.cc:1514] Processing DeleteTablet for tablet 72c501200310403ca0739978a919b357 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:14:37 UTC) from {username='oryx', principal='oryx/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:55992
I20260923 17:14:37.332038 20297 tablet_replica.cc:330] T 72c501200310403ca0739978a919b357 P 8bfbc623d17f4a4ab8c94b8f466ed410: stopping tablet replica
I20260923 17:14:37.332046 20299 tablet_replica.cc:330] T 72c501200310403ca0739978a919b357 P b476811982d34641b7b980144c756044: stopping tablet replica
I20260923 17:14:37.332111 20296 tablet_replica.cc:330] T 72c501200310403ca0739978a919b357 P 50bfee15e69e45568301f1c244c3c22f: stopping tablet replica
I20260923 17:14:37.332155 20297 raft_consensus.cc:2229] T 72c501200310403ca0739978a919b357 P 8bfbc623d17f4a4ab8c94b8f466ed410 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:14:37.332155 20299 raft_consensus.cc:2229] T 72c501200310403ca0739978a919b357 P b476811982d34641b7b980144c756044 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:14:37.332222 20296 raft_consensus.cc:2229] T 72c501200310403ca0739978a919b357 P 50bfee15e69e45568301f1c244c3c22f [term 1 LEADER]: Raft consensus shutting down.
I20260923 17:14:37.332275 20299 raft_consensus.cc:2258] T 72c501200310403ca0739978a919b357 P b476811982d34641b7b980144c756044 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:14:37.332276 20297 raft_consensus.cc:2258] T 72c501200310403ca0739978a919b357 P 8bfbc623d17f4a4ab8c94b8f466ed410 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:14:37.332512 20296 raft_consensus.cc:2258] T 72c501200310403ca0739978a919b357 P 50bfee15e69e45568301f1c244c3c22f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:14:37.333487 20299 ts_tablet_manager.cc:1905] T 72c501200310403ca0739978a919b357 P b476811982d34641b7b980144c756044: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:14:37.336576 20299 ts_tablet_manager.cc:1918] T 72c501200310403ca0739978a919b357 P b476811982d34641b7b980144c756044: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 17:14:37.336673 20299 log.cc:1196] T 72c501200310403ca0739978a919b357 P b476811982d34641b7b980144c756044: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-0/wal/wals/72c501200310403ca0739978a919b357
I20260923 17:14:37.336937 20299 ts_tablet_manager.cc:1939] T 72c501200310403ca0739978a919b357 P b476811982d34641b7b980144c756044: Deleting consensus metadata
I20260923 17:14:37.337574 20296 ts_tablet_manager.cc:1905] T 72c501200310403ca0739978a919b357 P 50bfee15e69e45568301f1c244c3c22f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:14:37.337949 19706 catalog_manager.cc:4841] TS b476811982d34641b7b980144c756044 (127.11.229.129:45629): tablet 72c501200310403ca0739978a919b357 (table test-table [id=d503f8f4d12f47adbfa4cd85dc2f2143]) successfully deleted
I20260923 17:14:37.338900 20297 ts_tablet_manager.cc:1905] T 72c501200310403ca0739978a919b357 P 8bfbc623d17f4a4ab8c94b8f466ed410: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:14:37.340333 20296 ts_tablet_manager.cc:1918] T 72c501200310403ca0739978a919b357 P 50bfee15e69e45568301f1c244c3c22f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 17:14:37.340406 20296 log.cc:1196] T 72c501200310403ca0739978a919b357 P 50bfee15e69e45568301f1c244c3c22f: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-1/wal/wals/72c501200310403ca0739978a919b357
I20260923 17:14:37.340654 20296 ts_tablet_manager.cc:1939] T 72c501200310403ca0739978a919b357 P 50bfee15e69e45568301f1c244c3c22f: Deleting consensus metadata
I20260923 17:14:37.341342 20297 ts_tablet_manager.cc:1918] T 72c501200310403ca0739978a919b357 P 8bfbc623d17f4a4ab8c94b8f466ed410: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260923 17:14:37.341418 20297 log.cc:1196] T 72c501200310403ca0739978a919b357 P 8bfbc623d17f4a4ab8c94b8f466ed410: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790183633736342-12182-0/minicluster-data/ts-2/wal/wals/72c501200310403ca0739978a919b357
I20260923 17:14:37.341653 20297 ts_tablet_manager.cc:1939] T 72c501200310403ca0739978a919b357 P 8bfbc623d17f4a4ab8c94b8f466ed410: Deleting consensus metadata
I20260923 17:14:37.341786 19707 catalog_manager.cc:4841] TS 50bfee15e69e45568301f1c244c3c22f (127.11.229.130:38051): tablet 72c501200310403ca0739978a919b357 (table test-table [id=d503f8f4d12f47adbfa4cd85dc2f2143]) successfully deleted
I20260923 17:14:37.342098 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 19792
I20260923 17:14:37.344165 19705 catalog_manager.cc:4841] TS 8bfbc623d17f4a4ab8c94b8f466ed410 (127.11.229.131:42787): tablet 72c501200310403ca0739978a919b357 (table test-table [id=d503f8f4d12f47adbfa4cd85dc2f2143]) successfully deleted
I20260923 17:14:37.351029 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 19932
I20260923 17:14:37.357790 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 20072
I20260923 17:14:37.364486 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 19688
2026-09-23T17:14:37Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3702 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790183633736342-12182-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 17:14:37 dist-test-slave-1x1f krb5kdc[20335](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 17:14:37 dist-test-slave-1x1f krb5kdc[20335](info): set up 2 sockets
Sep 23 17:14:37 dist-test-slave-1x1f krb5kdc[20335](info): commencing operation
krb5kdc: starting...
W20260923 17:14:38.447618 12182 mini_kdc.cc:121] Time spent starting KDC: real 1.059s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Sep 23 17:14:38 dist-test-slave-1x1f krb5kdc[20335](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183678, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T17:14:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:14:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.229.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
I20260923 17:14:38.582926 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:34323
--webserver_interface=127.11.229.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:40019
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:34323
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:14:38.695642 20348 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:38.695925 20348 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:38.695966 20348 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:38.700112 20348 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:14:38.700181 20348 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:38.700199 20348 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:38.700217 20348 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:14:38.700232 20348 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:14:38.706099 20348 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:40019
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:34323
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:34323
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.229.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20348
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:38.707291 20348 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:38.708724 20348 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260923 17:14:38.717583 20348 server_base.cc:1034] running on GCE node
W20260923 17:14:38.717536 20353 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:38.717520 20356 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:38.717531 20354 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:38.718439 20348 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:38.719624 20348 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:38.720865 20348 hybrid_clock.cc:648] HybridClock initialized: now 1790183678720846 us; error 32 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-09-23T17:14:38Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1375 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 17:14:38 dist-test-slave-1x1f krb5kdc[20361](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 17:14:38 dist-test-slave-1x1f krb5kdc[20361](info): set up 2 sockets
Sep 23 17:14:38 dist-test-slave-1x1f krb5kdc[20361](info): commencing operation
krb5kdc: starting...
W20260923 17:14:39.795580 12182 mini_kdc.cc:121] Time spent starting KDC: real 1.031s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Sep 23 17:14:39 dist-test-slave-1x1f krb5kdc[20361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183679, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T17:14:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:14:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.229.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
I20260923 17:14:39.930485 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:34469
--webserver_interface=127.11.229.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:33021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:34469
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:14:40.044564 20374 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:40.044886 20374 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:40.044930 20374 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:40.049257 20374 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:14:40.049340 20374 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:40.049360 20374 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:40.049377 20374 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:14:40.049393 20374 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:14:40.055066 20374 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:33021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:34469
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:34469
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.229.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20374
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:40.056192 20374 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:40.057298 20374 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:40.066725 20379 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:40.066818 20374 server_base.cc:1034] running on GCE node
W20260923 17:14:40.066730 20380 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:40.066730 20382 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:40.067642 20374 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:40.068818 20374 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:40.070010 20374 hybrid_clock.cc:648] HybridClock initialized: now 1790183680069987 us; error 40 us; skew 500 ppm
Sep 23 17:14:40 dist-test-slave-1x1f krb5kdc[20361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183680, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:40.073087 20374 init.cc:377] Logged in from keytab as kudu/127.11.229.190@KRBTEST.COM (short username kudu)
I20260923 17:14:40.073945 20374 webserver.cc:460] Webserver started at http://127.11.229.190:43399/ using document root <none> and password file <none>
I20260923 17:14:40.074549 20374 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:40.074613 20374 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:40.074795 20374 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:40.076840 20374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "7c011b2c26b149fa90710a349880dda0"
format_stamp: "Formatted at 2026-09-23 17:14:40 on dist-test-slave-1x1f"
server_key: "75a8b9335ee4b1dd926434dc9b23b29f"
server_key_iv: "bba2700b32106d4dfd9090d706b5c94f"
server_key_version: "encryptionkey@0"
I20260923 17:14:40.077358 20374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "7c011b2c26b149fa90710a349880dda0"
format_stamp: "Formatted at 2026-09-23 17:14:40 on dist-test-slave-1x1f"
server_key: "75a8b9335ee4b1dd926434dc9b23b29f"
server_key_iv: "bba2700b32106d4dfd9090d706b5c94f"
server_key_version: "encryptionkey@0"
I20260923 17:14:40.081270 20374 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260923 17:14:40.083905 20389 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:40.085309 20374 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260923 17:14:40.085465 20374 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "7c011b2c26b149fa90710a349880dda0"
format_stamp: "Formatted at 2026-09-23 17:14:40 on dist-test-slave-1x1f"
server_key: "75a8b9335ee4b1dd926434dc9b23b29f"
server_key_iv: "bba2700b32106d4dfd9090d706b5c94f"
server_key_version: "encryptionkey@0"
I20260923 17:14:40.085593 20374 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:40.104583 20374 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:40.107923 20374 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:40.108148 20374 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:40.115558 20374 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.190:34469
I20260923 17:14:40.115566 20441 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.190:34469 every 8 connection(s)
I20260923 17:14:40.116549 20374 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:14:40.117523 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 20374
I20260923 17:14:40.117657 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:14:40.117944 12182 external_mini_cluster.cc:1428] Setting key 5f82931974ce9bf7b84e1ef6b10998b5
I20260923 17:14:40.119953 20442 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:40.125557 20442 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c011b2c26b149fa90710a349880dda0: Bootstrap starting.
Sep 23 17:14:40 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183679, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:14:40.128059 20442 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7c011b2c26b149fa90710a349880dda0: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:40.128922 20442 log.cc:824] T 00000000000000000000000000000000 P 7c011b2c26b149fa90710a349880dda0: Log is configured to *not* fsync() on all Append() calls
I20260923 17:14:40.131275 20442 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c011b2c26b149fa90710a349880dda0: No bootstrap required, opened a new log
I20260923 17:14:40.132663 20445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:40.119563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36208 (local address 127.11.229.190:34469)
0923 17:14:40.120059 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:40.120079 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:40.120127 (+ 48us) server_negotiation.cc:407] Connection header received
0923 17:14:40.120925 (+ 798us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:40.120943 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:40.121295 (+ 352us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:40.121633 (+ 338us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:40.122528 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:40.123517 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:40.124387 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:40.124867 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:40.125039 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:40.127675 (+ 2636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:40.127680 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:40.127693 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:40.127722 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:40.129486 (+ 1764us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:40.129975 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:40.129980 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:40.129987 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:40.130116 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:40.130448 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:40.130454 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:40.130456 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:40.130950 (+ 494us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:40.131158 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:40.131393 (+ 235us) server_negotiation.cc:299] Negotiation successful
0923 17:14:40.131705 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":330,"thread_start_us":146,"threads_started":1}
I20260923 17:14:40.135716 20442 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7c011b2c26b149fa90710a349880dda0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c011b2c26b149fa90710a349880dda0" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 34469 } }
I20260923 17:14:40.136077 20442 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7c011b2c26b149fa90710a349880dda0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:40.136130 20442 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7c011b2c26b149fa90710a349880dda0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c011b2c26b149fa90710a349880dda0, State: Initialized, Role: FOLLOWER
I20260923 17:14:40.136596 20442 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7c011b2c26b149fa90710a349880dda0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c011b2c26b149fa90710a349880dda0" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 34469 } }
I20260923 17:14:40.136729 20442 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7c011b2c26b149fa90710a349880dda0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:14:40.136776 20442 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7c011b2c26b149fa90710a349880dda0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:14:40.136849 20442 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7c011b2c26b149fa90710a349880dda0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:40.137770 20442 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7c011b2c26b149fa90710a349880dda0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c011b2c26b149fa90710a349880dda0" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 34469 } }
I20260923 17:14:40.138188 20442 leader_election.cc:302] T 00000000000000000000000000000000 P 7c011b2c26b149fa90710a349880dda0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7c011b2c26b149fa90710a349880dda0; no voters:
I20260923 17:14:40.138558 20442 leader_election.cc:288] T 00000000000000000000000000000000 P 7c011b2c26b149fa90710a349880dda0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 17:14:40.138796 20447 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7c011b2c26b149fa90710a349880dda0 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:14:40.139211 20447 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7c011b2c26b149fa90710a349880dda0 [term 1 LEADER]: Becoming Leader. State: Replica: 7c011b2c26b149fa90710a349880dda0, State: Running, Role: LEADER
I20260923 17:14:40.139515 20447 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7c011b2c26b149fa90710a349880dda0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c011b2c26b149fa90710a349880dda0" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 34469 } }
I20260923 17:14:40.139853 20442 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7c011b2c26b149fa90710a349880dda0 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:14:40.141171 20449 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c011b2c26b149fa90710a349880dda0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7c011b2c26b149fa90710a349880dda0. Latest consensus state: current_term: 1 leader_uuid: "7c011b2c26b149fa90710a349880dda0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c011b2c26b149fa90710a349880dda0" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 34469 } } }
I20260923 17:14:40.141311 20449 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c011b2c26b149fa90710a349880dda0 [sys.catalog]: This master's current role is: LEADER
I20260923 17:14:40.141651 20448 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c011b2c26b149fa90710a349880dda0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7c011b2c26b149fa90710a349880dda0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c011b2c26b149fa90710a349880dda0" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 34469 } } }
I20260923 17:14:40.141749 20448 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c011b2c26b149fa90710a349880dda0 [sys.catalog]: This master's current role is: LEADER
I20260923 17:14:40.141793 20457 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:14:40.144456 20457 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:14:40.150460 20457 catalog_manager.cc:1347] Generated new cluster ID: 76ff98e6d13a4aa0af05c922f2008f3c
I20260923 17:14:40.150552 20457 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:14:40.163874 20457 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:14:40.165175 20457 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:14:40.173457 20457 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7c011b2c26b149fa90710a349880dda0: Generated new TSK 0
I20260923 17:14:40.174347 20457 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.229.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab.
Entry for principal kudu/127.11.229.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab.
I20260923 17:14:40.206596 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.129:0
--local_ip_for_outbound_sockets=127.11.229.129
--webserver_interface=127.11.229.129
--webserver_port=0
--tserver_master_addrs=127.11.229.190:34469
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab
--principal=kudu/127.11.229.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:33021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:14:40.322161 20468 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:40.322500 20468 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:40.322546 20468 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:40.326718 20468 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:40.326781 20468 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:40.326841 20468 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.129
I20260923 17:14:40.332242 20468 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:33021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab
--principal=kudu/127.11.229.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.229.129
--webserver_port=0
--tserver_master_addrs=127.11.229.190:34469
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20468
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.129
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:40.333267 20468 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:40.334286 20468 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:40.344468 20474 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:40.344504 20468 server_base.cc:1034] running on GCE node
W20260923 17:14:40.344468 20473 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:40.344516 20476 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:40.345165 20468 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:40.345754 20468 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:40.346974 20468 hybrid_clock.cc:648] HybridClock initialized: now 1790183680346937 us; error 46 us; skew 500 ppm
Sep 23 17:14:40 dist-test-slave-1x1f krb5kdc[20361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183680, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:40.350068 20468 init.cc:377] Logged in from keytab as kudu/127.11.229.129@KRBTEST.COM (short username kudu)
I20260923 17:14:40.351111 20468 webserver.cc:460] Webserver started at http://127.11.229.129:44979/ using document root <none> and password file <none>
I20260923 17:14:40.351693 20468 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:40.351792 20468 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:40.352029 20468 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:40.354086 20468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-0/data/instance:
uuid: "0750888fda3147d3bdc1d71809441a71"
format_stamp: "Formatted at 2026-09-23 17:14:40 on dist-test-slave-1x1f"
server_key: "5503caa8779560b94cc2d3184703d0c7"
server_key_iv: "7777ed869cffcef3eb9a6462b2f7bd4c"
server_key_version: "encryptionkey@0"
I20260923 17:14:40.354712 20468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance:
uuid: "0750888fda3147d3bdc1d71809441a71"
format_stamp: "Formatted at 2026-09-23 17:14:40 on dist-test-slave-1x1f"
server_key: "5503caa8779560b94cc2d3184703d0c7"
server_key_iv: "7777ed869cffcef3eb9a6462b2f7bd4c"
server_key_version: "encryptionkey@0"
I20260923 17:14:40.358491 20468 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260923 17:14:40.361321 20483 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:40.362758 20468 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 17:14:40.362923 20468 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-0/wal
uuid: "0750888fda3147d3bdc1d71809441a71"
format_stamp: "Formatted at 2026-09-23 17:14:40 on dist-test-slave-1x1f"
server_key: "5503caa8779560b94cc2d3184703d0c7"
server_key_iv: "7777ed869cffcef3eb9a6462b2f7bd4c"
server_key_version: "encryptionkey@0"
I20260923 17:14:40.363063 20468 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:40.375703 20468 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:40.379555 20468 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:40.379799 20468 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:40.380416 20468 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:14:40.381295 20468 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:14:40.381371 20468 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:40.381440 20468 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:14:40.381474 20468 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:40.391260 20468 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.129:40899
I20260923 17:14:40.391287 20596 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.129:40899 every 8 connection(s)
I20260923 17:14:40.392169 20468 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
I20260923 17:14:40.393270 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 20468
I20260923 17:14:40.393414 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance
I20260923 17:14:40.393795 12182 external_mini_cluster.cc:1428] Setting key 7f29e0825dbf4a9366e8f9326d29faed
Sep 23 17:14:40 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183680, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.129@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.229.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.130@KRBTEST.COM" created.
I20260923 17:14:40.406656 20445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:40.394203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:45741 (local address 127.11.229.190:34469)
0923 17:14:40.394369 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:40.394373 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:40.395649 (+ 1276us) server_negotiation.cc:407] Connection header received
0923 17:14:40.396638 (+ 989us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:40.396642 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:40.396692 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:40.396805 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:40.397962 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:40.398574 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:40.399791 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:40.400022 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:40.400136 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:40.402655 (+ 2519us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:40.402664 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:40.402666 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:40.402689 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:40.404198 (+ 1509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:40.404910 (+ 712us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:40.404912 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:40.404914 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:40.404987 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:40.405332 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:40.405335 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:40.405337 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:40.405659 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:40.405774 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:40.406420 (+ 646us) server_negotiation.cc:299] Negotiation successful
0923 17:14:40.406531 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260923 17:14:40.407819 20599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:40.394699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.129:45741)
0923 17:14:40.395506 (+ 807us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:40.395546 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:40.396435 (+ 889us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:40.396978 (+ 543us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:40.396985 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:40.397345 (+ 360us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:40.397811 (+ 466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:40.397824 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:40.398700 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:40.398704 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:40.399660 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:40.399669 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:40.400177 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:40.400181 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:40.400349 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:40.400977 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:40.400993 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:40.402485 (+ 1492us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:40.404361 (+ 1876us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:40.404366 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:40.404377 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:40.404802 (+ 425us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:40.405079 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:40.405081 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:40.405083 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:40.405212 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:40.405776 (+ 564us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:40.405781 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:40.406124 (+ 343us) client_negotiation.cc:769] Sending connection context
0923 17:14:40.406373 (+ 249us) client_negotiation.cc:240] Negotiation successful
0923 17:14:40.406742 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":615,"thread_start_us":121,"threads_started":1}
I20260923 17:14:40.409914 20597 heartbeater.cc:347] Connected to a master server at 127.11.229.190:34469
I20260923 17:14:40.410207 20597 heartbeater.cc:464] Registering TS with master...
I20260923 17:14:40.410779 20597 heartbeater.cc:511] Master 127.11.229.190:34469 requested a full tablet report, sending...
I20260923 17:14:40.412343 20406 ts_manager.cc:194] Registered new tserver with Master: 0750888fda3147d3bdc1d71809441a71 (127.11.229.129:40899)
I20260923 17:14:40.413465 20406 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.129@KRBTEST.COM'} at 127.11.229.129:45741
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab.
Entry for principal kudu/127.11.229.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab.
I20260923 17:14:40.425583 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.130:0
--local_ip_for_outbound_sockets=127.11.229.130
--webserver_interface=127.11.229.130
--webserver_port=0
--tserver_master_addrs=127.11.229.190:34469
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab
--principal=kudu/127.11.229.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:33021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:14:40.538908 20602 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:40.539198 20602 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:40.539242 20602 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:40.543780 20602 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:40.543849 20602 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:40.543912 20602 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.130
I20260923 17:14:40.549341 20602 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:33021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab
--principal=kudu/127.11.229.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.229.130
--webserver_port=0
--tserver_master_addrs=127.11.229.190:34469
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20602
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.130
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:40.550499 20602 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:40.551556 20602 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:40.561434 20607 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:40.561424 20610 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:40.561523 20602 server_base.cc:1034] running on GCE node
W20260923 17:14:40.561721 20608 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:40.562134 20602 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:40.562820 20602 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:40.563988 20602 hybrid_clock.cc:648] HybridClock initialized: now 1790183680563973 us; error 28 us; skew 500 ppm
Sep 23 17:14:40 dist-test-slave-1x1f krb5kdc[20361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183680, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:40.566946 20602 init.cc:377] Logged in from keytab as kudu/127.11.229.130@KRBTEST.COM (short username kudu)
I20260923 17:14:40.567883 20602 webserver.cc:460] Webserver started at http://127.11.229.130:39185/ using document root <none> and password file <none>
I20260923 17:14:40.568459 20602 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:40.568549 20602 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:40.568782 20602 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:40.570894 20602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-1/data/instance:
uuid: "3790241b854440a89d050a79afe75513"
format_stamp: "Formatted at 2026-09-23 17:14:40 on dist-test-slave-1x1f"
server_key: "f76eb3ca99cf417da9ff64b03123d96f"
server_key_iv: "c493704b72948258723c4046dd0fbccb"
server_key_version: "encryptionkey@0"
I20260923 17:14:40.571543 20602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance:
uuid: "3790241b854440a89d050a79afe75513"
format_stamp: "Formatted at 2026-09-23 17:14:40 on dist-test-slave-1x1f"
server_key: "f76eb3ca99cf417da9ff64b03123d96f"
server_key_iv: "c493704b72948258723c4046dd0fbccb"
server_key_version: "encryptionkey@0"
I20260923 17:14:40.575448 20602 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260923 17:14:40.578079 20617 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:40.579407 20602 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 17:14:40.579555 20602 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-1/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-1/wal
uuid: "3790241b854440a89d050a79afe75513"
format_stamp: "Formatted at 2026-09-23 17:14:40 on dist-test-slave-1x1f"
server_key: "f76eb3ca99cf417da9ff64b03123d96f"
server_key_iv: "c493704b72948258723c4046dd0fbccb"
server_key_version: "encryptionkey@0"
I20260923 17:14:40.579674 20602 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:40.609547 20602 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:40.613211 20602 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:40.613447 20602 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:40.614087 20602 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:14:40.615000 20602 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:14:40.615075 20602 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:40.615154 20602 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:14:40.615199 20602 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:40.624655 20602 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.130:36305
I20260923 17:14:40.624681 20730 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.130:36305 every 8 connection(s)
I20260923 17:14:40.625605 20602 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
I20260923 17:14:40.632929 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 20602
I20260923 17:14:40.633088 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance
I20260923 17:14:40.633431 12182 external_mini_cluster.cc:1428] Setting key dd4499e0b3e56b5783d54e9a1b09f345
Sep 23 17:14:40 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183680, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.130@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:14:40.641012 20445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:40.627642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:60329 (local address 127.11.229.190:34469)
0923 17:14:40.627819 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:40.627824 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:40.629108 (+ 1284us) server_negotiation.cc:407] Connection header received
0923 17:14:40.629995 (+ 887us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:40.629997 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:40.630046 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:40.630128 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:40.631345 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:40.631906 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:40.633177 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:40.633512 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:40.633635 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:40.636739 (+ 3104us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:40.636748 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:40.636751 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:40.636773 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:40.638434 (+ 1661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:40.639042 (+ 608us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:40.639047 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:40.639049 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:40.639140 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:40.639554 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:40.639559 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:40.639561 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:40.639855 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:40.639995 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:40.640687 (+ 692us) server_negotiation.cc:299] Negotiation successful
0923 17:14:40.640831 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260923 17:14:40.642127 20733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:40.628013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.130:60329)
0923 17:14:40.628925 (+ 912us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:40.628971 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:40.629775 (+ 804us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:40.630337 (+ 562us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:40.630343 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:40.630715 (+ 372us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:40.631204 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:40.631218 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:40.632050 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:40.632054 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:40.633009 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:40.633018 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:40.633694 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:40.633697 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:40.633970 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:40.634791 (+ 821us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:40.634813 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:40.636547 (+ 1734us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:40.638578 (+ 2031us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:40.638585 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:40.638608 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:40.638916 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:40.639259 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:40.639262 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:40.639265 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:40.639438 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:40.640006 (+ 568us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:40.640015 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:40.640411 (+ 396us) client_negotiation.cc:769] Sending connection context
0923 17:14:40.640629 (+ 218us) client_negotiation.cc:240] Negotiation successful
0923 17:14:40.641134 (+ 505us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":717,"thread_start_us":534,"threads_started":1}
WARNING: no policy specified for kudu/127.11.229.131@KRBTEST.COM; defaulting to no policy
I20260923 17:14:40.643536 20731 heartbeater.cc:347] Connected to a master server at 127.11.229.190:34469
I20260923 17:14:40.643817 20731 heartbeater.cc:464] Registering TS with master...
I20260923 17:14:40.644366 20731 heartbeater.cc:511] Master 127.11.229.190:34469 requested a full tablet report, sending...
I20260923 17:14:40.645542 20406 ts_manager.cc:194] Registered new tserver with Master: 3790241b854440a89d050a79afe75513 (127.11.229.130:36305)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.131@KRBTEST.COM" created.
I20260923 17:14:40.646291 20406 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.130@KRBTEST.COM'} at 127.11.229.130:60329
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab.
Entry for principal kudu/127.11.229.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab.
I20260923 17:14:40.665607 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.131:0
--local_ip_for_outbound_sockets=127.11.229.131
--webserver_interface=127.11.229.131
--webserver_port=0
--tserver_master_addrs=127.11.229.190:34469
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab
--principal=kudu/127.11.229.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:33021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:14:40.781013 20736 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:40.781311 20736 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:40.781354 20736 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:40.785758 20736 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:40.785828 20736 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:40.785914 20736 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.131
I20260923 17:14:40.791558 20736 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:33021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab
--principal=kudu/127.11.229.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.229.131
--webserver_port=0
--tserver_master_addrs=127.11.229.190:34469
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20736
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.131
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:40.792680 20736 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:40.793709 20736 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:40.803767 20741 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:40.803767 20742 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:40.803758 20744 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:40.803802 20736 server_base.cc:1034] running on GCE node
I20260923 17:14:40.804435 20736 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:40.805106 20736 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:40.806299 20736 hybrid_clock.cc:648] HybridClock initialized: now 1790183680806291 us; error 33 us; skew 500 ppm
Sep 23 17:14:40 dist-test-slave-1x1f krb5kdc[20361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183680, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:40.808940 20736 init.cc:377] Logged in from keytab as kudu/127.11.229.131@KRBTEST.COM (short username kudu)
I20260923 17:14:40.809777 20736 webserver.cc:460] Webserver started at http://127.11.229.131:34509/ using document root <none> and password file <none>
I20260923 17:14:40.810424 20736 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:40.810518 20736 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:40.810734 20736 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:40.812784 20736 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-2/data/instance:
uuid: "27800ddda24641b79b6fdc65594bdb9f"
format_stamp: "Formatted at 2026-09-23 17:14:40 on dist-test-slave-1x1f"
server_key: "173a1fc5b39a644d4df74355cc256a72"
server_key_iv: "aa4129d4c0e53be7fc38d51445b2d1d3"
server_key_version: "encryptionkey@0"
I20260923 17:14:40.813349 20736 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance:
uuid: "27800ddda24641b79b6fdc65594bdb9f"
format_stamp: "Formatted at 2026-09-23 17:14:40 on dist-test-slave-1x1f"
server_key: "173a1fc5b39a644d4df74355cc256a72"
server_key_iv: "aa4129d4c0e53be7fc38d51445b2d1d3"
server_key_version: "encryptionkey@0"
I20260923 17:14:40.816951 20736 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.003s
I20260923 17:14:40.819372 20751 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:40.820586 20736 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260923 17:14:40.820720 20736 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-2/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-2/wal
uuid: "27800ddda24641b79b6fdc65594bdb9f"
format_stamp: "Formatted at 2026-09-23 17:14:40 on dist-test-slave-1x1f"
server_key: "173a1fc5b39a644d4df74355cc256a72"
server_key_iv: "aa4129d4c0e53be7fc38d51445b2d1d3"
server_key_version: "encryptionkey@0"
I20260923 17:14:40.820832 20736 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:40.844480 20736 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:40.847867 20736 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:40.848078 20736 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:40.848717 20736 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:14:40.849591 20736 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:14:40.849675 20736 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:40.849771 20736 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:14:40.849825 20736 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:40.859227 20736 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.131:38551
I20260923 17:14:40.859251 20864 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.131:38551 every 8 connection(s)
I20260923 17:14:40.860146 20736 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
I20260923 17:14:40.863169 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 20736
I20260923 17:14:40.863325 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance
I20260923 17:14:40.863690 12182 external_mini_cluster.cc:1428] Setting key 3d1035ef99b04e6767dd697fe60f4058
Sep 23 17:14:40 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183680, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.131@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:14:40.877457 20445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:40.862122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:47245 (local address 127.11.229.190:34469)
0923 17:14:40.862333 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:40.862336 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:40.863682 (+ 1346us) server_negotiation.cc:407] Connection header received
0923 17:14:40.864709 (+ 1027us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:40.864711 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:40.864757 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:40.864821 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:40.866350 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:40.866914 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:40.868557 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:40.868868 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:40.868989 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:40.872776 (+ 3787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:40.872781 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:40.872784 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:40.872819 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:40.874809 (+ 1990us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:40.875496 (+ 687us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:40.875500 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:40.875502 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:40.875590 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:40.876039 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:40.876046 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:40.876050 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:40.876352 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:40.876458 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:40.877125 (+ 667us) server_negotiation.cc:299] Negotiation successful
0923 17:14:40.877280 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260923 17:14:40.878531 20867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:40.862565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.131:47245)
0923 17:14:40.863461 (+ 896us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:40.863543 (+ 82us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:40.864416 (+ 873us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:40.865044 (+ 628us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:40.865051 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:40.865538 (+ 487us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:40.866148 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:40.866169 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:40.867047 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:40.867049 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:40.868437 (+ 1388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:40.868447 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:40.869026 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:40.869030 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:40.869278 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:40.870026 (+ 748us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:40.870046 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:40.872559 (+ 2513us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:40.874951 (+ 2392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:40.874960 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:40.874979 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:40.875346 (+ 367us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:40.875700 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:14:40.875706 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:14:40.875710 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:14:40.875917 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:14:40.876458 (+ 541us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:40.876466 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:40.876828 (+ 362us) client_negotiation.cc:769] Sending connection context
0923 17:14:40.877042 (+ 214us) client_negotiation.cc:240] Negotiation successful
0923 17:14:40.877415 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":664,"thread_start_us":114,"threads_started":1}
I20260923 17:14:40.879669 20865 heartbeater.cc:347] Connected to a master server at 127.11.229.190:34469
I20260923 17:14:40.879906 20865 heartbeater.cc:464] Registering TS with master...
I20260923 17:14:40.880419 20865 heartbeater.cc:511] Master 127.11.229.190:34469 requested a full tablet report, sending...
I20260923 17:14:40.881654 20406 ts_manager.cc:194] Registered new tserver with Master: 27800ddda24641b79b6fdc65594bdb9f (127.11.229.131:38551)
I20260923 17:14:40.882344 20406 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.131@KRBTEST.COM'} at 127.11.229.131:47245
I20260923 17:14:40.890000 12182 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.11.229.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.229.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.229.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.129.keytab.
Entry for principal oryx/127.11.229.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.129.keytab.
WARNING: no policy specified for oryx/127.11.229.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.229.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.229.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.130.keytab.
Entry for principal oryx/127.11.229.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.130.keytab.
WARNING: no policy specified for oryx/127.11.229.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.229.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.229.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.131.keytab.
Entry for principal oryx/127.11.229.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.131.keytab.
I20260923 17:14:40.974152 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 20468
I20260923 17:14:40.981235 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 20602
I20260923 17:14:40.986996 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 20736
I20260923 17:14:40.993939 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 20374
I20260923 17:14:41.001010 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:34469
--webserver_interface=127.11.229.190
--webserver_port=43399
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:33021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:34469
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:14:41.113305 20874 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:41.113662 20874 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:41.113749 20874 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:41.117885 20874 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:14:41.117996 20874 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:41.118034 20874 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:41.118073 20874 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:14:41.118106 20874 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:14:41.123574 20874 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:33021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:34469
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:34469
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.229.190
--webserver_port=43399
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20874
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:41.124730 20874 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:41.125779 20874 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:41.134388 20880 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:41.134388 20882 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:41.134552 20874 server_base.cc:1034] running on GCE node
W20260923 17:14:41.134701 20879 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:41.135265 20874 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:41.136441 20874 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:41.137619 20874 hybrid_clock.cc:648] HybridClock initialized: now 1790183681137584 us; error 52 us; skew 500 ppm
Sep 23 17:14:41 dist-test-slave-1x1f krb5kdc[20361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183681, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:41.141577 20874 init.cc:377] Logged in from keytab as kudu/127.11.229.190@KRBTEST.COM (short username kudu)
I20260923 17:14:41.142657 20874 webserver.cc:460] Webserver started at http://127.11.229.190:43399/ using document root <none> and password file <none>
I20260923 17:14:41.143252 20874 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:41.143332 20874 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:41.147531 20874 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.004s
I20260923 17:14:41.150393 20889 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:41.151863 20874 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260923 17:14:41.152033 20874 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "7c011b2c26b149fa90710a349880dda0"
format_stamp: "Formatted at 2026-09-23 17:14:40 on dist-test-slave-1x1f"
server_key: "75a8b9335ee4b1dd926434dc9b23b29f"
server_key_iv: "bba2700b32106d4dfd9090d706b5c94f"
server_key_version: "encryptionkey@0"
I20260923 17:14:41.152686 20874 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:41.168780 20874 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:41.172667 20874 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:41.172927 20874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:41.181162 20874 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.190:34469
I20260923 17:14:41.181185 20941 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.190:34469 every 8 connection(s)
I20260923 17:14:41.182396 20874 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:14:41.186815 20942 sys_catalog.cc:263] Verifying existing consensus state
I20260923 17:14:41.188014 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 20874
I20260923 17:14:41.188560 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.129:40899
--local_ip_for_outbound_sockets=127.11.229.129
--tserver_master_addrs=127.11.229.190:34469
--webserver_port=44979
--webserver_interface=127.11.229.129
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab
--principal=kudu/127.11.229.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:33021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.11.229.129
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.129.keytab with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 17:14:41.189109 20942 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c011b2c26b149fa90710a349880dda0: Bootstrap starting.
I20260923 17:14:41.208199 20942 log.cc:824] T 00000000000000000000000000000000 P 7c011b2c26b149fa90710a349880dda0: Log is configured to *not* fsync() on all Append() calls
I20260923 17:14:41.215613 20942 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c011b2c26b149fa90710a349880dda0: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260923 17:14:41.216058 20942 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7c011b2c26b149fa90710a349880dda0: Bootstrap complete.
I20260923 17:14:41.220813 20942 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7c011b2c26b149fa90710a349880dda0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c011b2c26b149fa90710a349880dda0" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 34469 } }
I20260923 17:14:41.221280 20942 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7c011b2c26b149fa90710a349880dda0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7c011b2c26b149fa90710a349880dda0, State: Initialized, Role: FOLLOWER
I20260923 17:14:41.221827 20942 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7c011b2c26b149fa90710a349880dda0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c011b2c26b149fa90710a349880dda0" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 34469 } }
I20260923 17:14:41.221951 20942 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7c011b2c26b149fa90710a349880dda0 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:14:41.222049 20942 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7c011b2c26b149fa90710a349880dda0 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:14:41.222186 20942 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7c011b2c26b149fa90710a349880dda0 [term 1 FOLLOWER]: Advancing to term 2
I20260923 17:14:41.224551 20942 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7c011b2c26b149fa90710a349880dda0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c011b2c26b149fa90710a349880dda0" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 34469 } }
I20260923 17:14:41.224922 20942 leader_election.cc:302] T 00000000000000000000000000000000 P 7c011b2c26b149fa90710a349880dda0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7c011b2c26b149fa90710a349880dda0; no voters:
I20260923 17:14:41.225291 20942 leader_election.cc:288] T 00000000000000000000000000000000 P 7c011b2c26b149fa90710a349880dda0 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260923 17:14:41.225387 20946 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7c011b2c26b149fa90710a349880dda0 [term 2 FOLLOWER]: Leader election won for term 2
I20260923 17:14:41.225663 20946 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7c011b2c26b149fa90710a349880dda0 [term 2 LEADER]: Becoming Leader. State: Replica: 7c011b2c26b149fa90710a349880dda0, State: Running, Role: LEADER
I20260923 17:14:41.226086 20946 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7c011b2c26b149fa90710a349880dda0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c011b2c26b149fa90710a349880dda0" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 34469 } }
I20260923 17:14:41.226714 20942 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7c011b2c26b149fa90710a349880dda0 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:14:41.227715 20948 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c011b2c26b149fa90710a349880dda0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7c011b2c26b149fa90710a349880dda0. Latest consensus state: current_term: 2 leader_uuid: "7c011b2c26b149fa90710a349880dda0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c011b2c26b149fa90710a349880dda0" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 34469 } } }
I20260923 17:14:41.227844 20948 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c011b2c26b149fa90710a349880dda0 [sys.catalog]: This master's current role is: LEADER
I20260923 17:14:41.227779 20947 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7c011b2c26b149fa90710a349880dda0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "7c011b2c26b149fa90710a349880dda0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7c011b2c26b149fa90710a349880dda0" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 34469 } } }
I20260923 17:14:41.227905 20947 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7c011b2c26b149fa90710a349880dda0 [sys.catalog]: This master's current role is: LEADER
I20260923 17:14:41.232034 20962 catalog_manager.cc:1259] Loaded cluster ID: 76ff98e6d13a4aa0af05c922f2008f3c
I20260923 17:14:41.232133 20962 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7c011b2c26b149fa90710a349880dda0: loading cluster ID for follower catalog manager: success
I20260923 17:14:41.234196 20962 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7c011b2c26b149fa90710a349880dda0: acquiring CA information for follower catalog manager: success
I20260923 17:14:41.235492 20962 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7c011b2c26b149fa90710a349880dda0: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260923 17:14:41.235671 20955 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:14:41.236460 20955 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:14:41.236917 20955 catalog_manager.cc:1259] Loaded cluster ID: 76ff98e6d13a4aa0af05c922f2008f3c
I20260923 17:14:41.237001 20955 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:14:41.237571 20955 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:14:41.238009 20955 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 7c011b2c26b149fa90710a349880dda0: Loaded TSK: 0
I20260923 17:14:41.238756 20955 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260923 17:14:41.330797 20944 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:41.331104 20944 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:41.331192 20944 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:41.335515 20944 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:41.335614 20944 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:41.335727 20944 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.129
I20260923 17:14:41.341359 20944 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:33021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.129.keytab
--principal=oryx/127.11.229.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.129:40899
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.229.129
--webserver_port=44979
--tserver_master_addrs=127.11.229.190:34469
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20944
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.129
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:41.342599 20944 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:41.343750 20944 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:41.354019 20969 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:41.354050 20968 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:41.354326 20944 server_base.cc:1034] running on GCE node
W20260923 17:14:41.354346 20971 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:41.354835 20944 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:41.355562 20944 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:41.356782 20944 hybrid_clock.cc:648] HybridClock initialized: now 1790183681356769 us; error 30 us; skew 500 ppm
Sep 23 17:14:41 dist-test-slave-1x1f krb5kdc[20361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183681, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.229.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:41.359848 20944 init.cc:377] Logged in from keytab as oryx/127.11.229.129@KRBTEST.COM (short username oryx)
I20260923 17:14:41.360888 20944 webserver.cc:460] Webserver started at http://127.11.229.129:44979/ using document root <none> and password file <none>
I20260923 17:14:41.361501 20944 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:41.361574 20944 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:41.365756 20944 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260923 17:14:41.368042 20978 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:41.369802 20944 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 17:14:41.369927 20944 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-0/wal
uuid: "0750888fda3147d3bdc1d71809441a71"
format_stamp: "Formatted at 2026-09-23 17:14:40 on dist-test-slave-1x1f"
server_key: "5503caa8779560b94cc2d3184703d0c7"
server_key_iv: "7777ed869cffcef3eb9a6462b2f7bd4c"
server_key_version: "encryptionkey@0"
I20260923 17:14:41.370693 20944 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:41.411633 20944 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:41.415179 20944 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:41.415395 20944 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:41.416034 20944 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:14:41.416941 20944 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:14:41.416988 20944 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:41.417057 20944 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:14:41.417097 20944 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:41.427119 20944 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.129:40899
I20260923 17:14:41.427203 21091 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.129:40899 every 8 connection(s)
I20260923 17:14:41.428326 20944 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
I20260923 17:14:41.437436 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 20944
I20260923 17:14:41.438021 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.130:36305
--local_ip_for_outbound_sockets=127.11.229.130
--tserver_master_addrs=127.11.229.190:34469
--webserver_port=39185
--webserver_interface=127.11.229.130
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab
--principal=kudu/127.11.229.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:33021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.11.229.130
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.130.keytab with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 23 17:14:41 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.129@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:41 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.129@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:41.442010 21095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:41.430790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.129:60835)
0923 17:14:41.431507 (+ 717us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:41.431546 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:41.432324 (+ 778us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:41.433405 (+ 1081us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:41.433413 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:41.433779 (+ 366us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:41.434391 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:41.434409 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:41.435814 (+ 1405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:41.435817 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:41.436717 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:41.436728 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:41.437782 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:41.437785 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:41.437923 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:41.438682 (+ 759us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:41.438700 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:41.441154 (+ 2454us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":541,"thread_start_us":164,"threads_started":1}
W20260923 17:14:41.442492 21094 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:41.430614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:60835 (local address 127.11.229.190:34469)
0923 17:14:41.431096 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:41.431118 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:41.431683 (+ 565us) server_negotiation.cc:407] Connection header received
0923 17:14:41.432683 (+ 1000us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:41.432694 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:41.433007 (+ 313us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:41.433284 (+ 277us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:41.434569 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:41.435666 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:41.436859 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:41.437596 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:41.437804 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:41.441479 (+ 3675us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.129:60835: BlockingRecv error: recv got EOF from 127.11.229.129:60835 (error 108)
Metrics: {"server-negotiator.queue_time_us":298,"thread_start_us":97,"threads_started":1}
W20260923 17:14:41.442829 21092 heartbeater.cc:644] Failed to heartbeat to 127.11.229.190:34469 (0 consecutive failures): Not authorized: Failed to ping master at 127.11.229.190:34469: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Sep 23 17:14:41 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.129@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:41 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.129@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:41.449714 21095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:41.443311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.129:45057)
0923 17:14:41.443437 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:41.443451 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:41.443531 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:41.443839 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:41.443841 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:41.443973 (+ 132us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:41.444065 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:41.444069 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:41.445343 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:41.445346 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:41.445921 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:41.445930 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:41.446706 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:41.446709 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:41.446780 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:41.447374 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:41.447386 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:41.449598 (+ 2212us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":54}
W20260923 17:14:41.450006 21094 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:41.443390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:45057 (local address 127.11.229.190:34469)
0923 17:14:41.443540 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:41.443548 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:41.443568 (+ 20us) server_negotiation.cc:407] Connection header received
0923 17:14:41.443636 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:41.443642 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:41.443708 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:41.443822 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:41.444194 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:41.445209 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:41.446056 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:41.446548 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:41.446705 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:41.449838 (+ 3133us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.129:45057: BlockingRecv error: recv got EOF from 127.11.229.129:45057 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Sep 23 17:14:41 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.129@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:41 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.129@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:41.456841 21097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:41.450385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.129:46591)
0923 17:14:41.450742 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:41.450759 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:41.450858 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:41.451088 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:41.451090 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:41.451319 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:41.451414 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:41.451419 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:41.452570 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:41.452572 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:41.453184 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:41.453192 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:41.453874 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:41.453878 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:41.453958 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:41.454535 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:41.454546 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:41.456689 (+ 2143us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":129,"threads_started":1}
W20260923 17:14:41.456938 21094 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:41.450475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:46591 (local address 127.11.229.190:34469)
0923 17:14:41.450618 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:41.450622 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:41.450851 (+ 229us) server_negotiation.cc:407] Connection header received
0923 17:14:41.450926 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:41.450930 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:41.450977 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:41.451065 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:41.451525 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:41.452406 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:41.453311 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:41.453697 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:41.453804 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:41.456806 (+ 3002us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.129:46591: BlockingRecv error: recv got EOF from 127.11.229.129:46591 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260923 17:14:41.457269 21092 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260923 17:14:41.566737 21096 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:41.567080 21096 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:41.567164 21096 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:41.571908 21096 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:41.571990 21096 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:41.572089 21096 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.130
I20260923 17:14:41.578187 21096 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:33021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.130.keytab
--principal=oryx/127.11.229.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.130:36305
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.229.130
--webserver_port=39185
--tserver_master_addrs=127.11.229.190:34469
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21096
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.130
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:41.579413 21096 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:41.580471 21096 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:41.592036 21102 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:41.592039 21105 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:41.592515 21096 server_base.cc:1034] running on GCE node
W20260923 17:14:41.592036 21103 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:41.593225 21096 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:41.593943 21096 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:41.595127 21096 hybrid_clock.cc:648] HybridClock initialized: now 1790183681595110 us; error 54 us; skew 500 ppm
Sep 23 17:14:41 dist-test-slave-1x1f krb5kdc[20361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183681, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.229.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:41.598083 21096 init.cc:377] Logged in from keytab as oryx/127.11.229.130@KRBTEST.COM (short username oryx)
I20260923 17:14:41.599200 21096 webserver.cc:460] Webserver started at http://127.11.229.130:39185/ using document root <none> and password file <none>
I20260923 17:14:41.599790 21096 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:41.599905 21096 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:41.603974 21096 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260923 17:14:41.606380 21112 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:41.607743 21096 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 17:14:41.607915 21096 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-1/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-1/wal
uuid: "3790241b854440a89d050a79afe75513"
format_stamp: "Formatted at 2026-09-23 17:14:40 on dist-test-slave-1x1f"
server_key: "f76eb3ca99cf417da9ff64b03123d96f"
server_key_iv: "c493704b72948258723c4046dd0fbccb"
server_key_version: "encryptionkey@0"
I20260923 17:14:41.608481 21096 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:41.623791 21096 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:41.627755 21096 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:41.628005 21096 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:41.628691 21096 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:14:41.629552 21096 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:14:41.629631 21096 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:41.629701 21096 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:14:41.629755 21096 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:41.639559 21096 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.130:36305
I20260923 17:14:41.639580 21225 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.130:36305 every 8 connection(s)
I20260923 17:14:41.640671 21096 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
I20260923 17:14:41.645737 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 21096
I20260923 17:14:41.646204 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.131:38551
--local_ip_for_outbound_sockets=127.11.229.131
--tserver_master_addrs=127.11.229.190:34469
--webserver_port=34509
--webserver_interface=127.11.229.131
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab
--principal=kudu/127.11.229.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:33021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.11.229.131
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.131.keytab with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 23 17:14:41 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.130@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:41 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.130@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
W20260923 17:14:41.652885 21094 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:41.642770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:39269 (local address 127.11.229.190:34469)
0923 17:14:41.642917 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:41.642922 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:41.644164 (+ 1242us) server_negotiation.cc:407] Connection header received
0923 17:14:41.645136 (+ 972us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:41.645140 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:41.645202 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:41.645330 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:41.647133 (+ 1803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:41.647678 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:41.648868 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:41.649095 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:41.649210 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:41.652755 (+ 3545us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.130:39269: BlockingRecv error: recv got EOF from 127.11.229.130:39269 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
I20260923 17:14:41.653568 21228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:41.643175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.130:39269)
0923 17:14:41.643965 (+ 790us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:41.644007 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:41.644914 (+ 907us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:41.645515 (+ 601us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:41.645522 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:41.645967 (+ 445us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:41.646928 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:41.646944 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:41.647813 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:41.647817 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:41.648726 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:41.648735 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:41.649266 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:41.649270 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:41.649444 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:41.650103 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:41.650119 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:41.652625 (+ 2506us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":603,"thread_start_us":116,"threads_started":1}
W20260923 17:14:41.654161 21226 heartbeater.cc:644] Failed to heartbeat to 127.11.229.190:34469 (0 consecutive failures): Not authorized: Failed to ping master at 127.11.229.190:34469: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Sep 23 17:14:41 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.130@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:41 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.130@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:41.662038 21228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:41.654719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.130:46847)
0923 17:14:41.654944 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:41.654962 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:41.655058 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:41.655423 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:41.655428 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:41.655841 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:41.656193 (+ 352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:41.656206 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:41.657384 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:41.657390 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:41.658353 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:41.658364 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:41.658978 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:41.658981 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:41.659093 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:41.659665 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:41.659682 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:41.661893 (+ 2211us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":133}
W20260923 17:14:41.662495 21094 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:41.654857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:46847 (local address 127.11.229.190:34469)
0923 17:14:41.654993 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:41.654996 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:41.655012 (+ 16us) server_negotiation.cc:407] Connection header received
0923 17:14:41.655210 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:41.655212 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:41.655286 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:41.655370 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:41.656419 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:41.657250 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:41.658526 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:41.658806 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:41.658955 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:41.662083 (+ 3128us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.130:46847: BlockingRecv error: recv got EOF from 127.11.229.130:46847 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Sep 23 17:14:41 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.130@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:41 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.130@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:41.668829 21228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:41.662629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.130:42191)
0923 17:14:41.662785 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:41.662798 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:41.662869 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:41.663166 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:41.663169 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:41.663330 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:41.663425 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:41.663431 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:41.664227 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:41.664231 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:41.665093 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:41.665106 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:41.665948 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:41.665951 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:41.666040 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:41.666619 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:41.666634 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:41.668684 (+ 2050us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":93}
W20260923 17:14:41.669037 21094 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:41.662842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:42191 (local address 127.11.229.190:34469)
0923 17:14:41.662957 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:41.662961 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:41.662973 (+ 12us) server_negotiation.cc:407] Connection header received
0923 17:14:41.663013 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:41.663015 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:41.663055 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:41.663167 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:41.663574 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:41.664104 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:41.665222 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:41.665740 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:41.665897 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:41.668855 (+ 2958us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.130:42191: BlockingRecv error: recv got EOF from 127.11.229.130:42191 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
W20260923 17:14:41.669088 21226 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260923 17:14:41.765337 21229 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:41.765655 21229 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:41.765740 21229 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:41.769879 21229 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:41.769985 21229 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:41.770082 21229 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.131
I20260923 17:14:41.775604 21229 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:33021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/krb5kdc/oryx_127.11.229.131.keytab
--principal=oryx/127.11.229.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.131:38551
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.229.131
--webserver_port=34509
--tserver_master_addrs=127.11.229.190:34469
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21229
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.131
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:41.776762 21229 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:41.777815 21229 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:41.787716 21237 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:41.787870 21229 server_base.cc:1034] running on GCE node
W20260923 17:14:41.787719 21234 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:41.788125 21235 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:41.788544 21229 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:41.789147 21229 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:41.790297 21229 hybrid_clock.cc:648] HybridClock initialized: now 1790183681790274 us; error 31 us; skew 500 ppm
Sep 23 17:14:41 dist-test-slave-1x1f krb5kdc[20361](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183681, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.229.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:41.793129 21229 init.cc:377] Logged in from keytab as oryx/127.11.229.131@KRBTEST.COM (short username oryx)
I20260923 17:14:41.793987 21229 webserver.cc:460] Webserver started at http://127.11.229.131:34509/ using document root <none> and password file <none>
I20260923 17:14:41.794595 21229 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:41.794669 21229 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:41.798602 21229 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260923 17:14:41.800843 21244 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:41.802337 21229 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 17:14:41.802454 21229 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-2/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-2/wal
uuid: "27800ddda24641b79b6fdc65594bdb9f"
format_stamp: "Formatted at 2026-09-23 17:14:40 on dist-test-slave-1x1f"
server_key: "173a1fc5b39a644d4df74355cc256a72"
server_key_iv: "aa4129d4c0e53be7fc38d51445b2d1d3"
server_key_version: "encryptionkey@0"
I20260923 17:14:41.803041 21229 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:41.824805 21229 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:41.829007 21229 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:41.829259 21229 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:41.829972 21229 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:14:41.831032 21229 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:14:41.831120 21229 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:41.831194 21229 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:14:41.831255 21229 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:41.841354 21229 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.131:38551
I20260923 17:14:41.841378 21357 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.131:38551 every 8 connection(s)
I20260923 17:14:41.842504 21229 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
I20260923 17:14:41.843645 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 21229
Sep 23 17:14:41 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.131@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:41 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.131@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:41.855497 21094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:41.844691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36224 (local address 127.11.229.190:34469)
0923 17:14:41.844852 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:41.844857 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:41.845305 (+ 448us) server_negotiation.cc:407] Connection header received
0923 17:14:41.845697 (+ 392us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:41.845700 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:41.845763 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:41.845863 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:41.847005 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:41.847873 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:41.848784 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:41.849141 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:41.849259 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:41.850999 (+ 1740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:41.851005 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:41.851020 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:41.851051 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:41.853318 (+ 2267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:41.853801 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:41.853812 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:41.853817 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:41.853928 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:41.854244 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:41.854249 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:41.854251 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:41.854583 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:41.854790 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:41.855085 (+ 295us) server_negotiation.cc:299] Negotiation successful
0923 17:14:41.855363 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
W20260923 17:14:41.856462 21361 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:41.845503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:38419 (local address 127.11.229.190:34469)
0923 17:14:41.845724 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:41.845728 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:41.847143 (+ 1415us) server_negotiation.cc:407] Connection header received
0923 17:14:41.848352 (+ 1209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:41.848355 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:41.848409 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:41.848498 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:41.850133 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:41.850786 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:41.852343 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:41.852706 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:41.852837 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:41.856311 (+ 3474us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.131:38419: BlockingRecv error: recv got EOF from 127.11.229.131:38419 (error 108)
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":88,"threads_started":1}
I20260923 17:14:41.857254 21362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:41.845964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.131:38419)
0923 17:14:41.846907 (+ 943us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:41.846996 (+ 89us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:41.848117 (+ 1121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:41.848686 (+ 569us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:41.848695 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:41.849249 (+ 554us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:41.849977 (+ 728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:41.849995 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:41.850924 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:41.850927 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:41.852184 (+ 1257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:41.852198 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:41.852890 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:41.852893 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:41.853037 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:41.853642 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:41.853659 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:41.856197 (+ 2538us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":720,"thread_start_us":220,"threads_started":1}
W20260923 17:14:41.857987 21358 heartbeater.cc:644] Failed to heartbeat to 127.11.229.190:34469 (0 consecutive failures): Not authorized: Failed to ping master at 127.11.229.190:34469: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Sep 23 17:14:41 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.131@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:41 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.131@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:41.863731 21362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:41.858496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.131:42403)
0923 17:14:41.858606 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:41.858629 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:41.858712 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:41.858953 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:41.858955 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:41.859123 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:41.859217 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:41.859222 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:41.859944 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:41.859950 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:41.860499 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:41.860506 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:41.860982 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:41.860986 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:41.861078 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:41.861559 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:41.861570 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:41.863562 (+ 1992us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":32}
W20260923 17:14:41.863860 21361 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:41.858531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:42403 (local address 127.11.229.190:34469)
0923 17:14:41.858631 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:41.858635 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:41.858670 (+ 35us) server_negotiation.cc:407] Connection header received
0923 17:14:41.858804 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:41.858807 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:41.858847 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:41.858939 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:41.859329 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:41.859835 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:41.860617 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:41.860856 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:41.860962 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:41.863705 (+ 2743us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.131:42403: BlockingRecv error: recv got EOF from 127.11.229.131:42403 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Sep 23 17:14:41 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.131@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:41 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.131@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:41.869678 21362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:41.864316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.131:45471)
0923 17:14:41.864465 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:41.864479 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:41.864550 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:41.864865 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:41.864867 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:41.865005 (+ 138us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:41.865091 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:41.865096 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:41.865840 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:41.865842 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:41.866498 (+ 656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:41.866507 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:41.866942 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:41.866945 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:41.867010 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:41.867572 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:41.867584 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:41.869536 (+ 1952us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":63}
W20260923 17:14:41.869897 21358 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260923 17:14:41.869947 21361 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:41.864496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:45471 (local address 127.11.229.190:34469)
0923 17:14:41.864648 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:41.864652 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:41.864664 (+ 12us) server_negotiation.cc:407] Connection header received
0923 17:14:41.864697 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:41.864699 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:41.864736 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:41.864812 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:41.865226 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:41.865718 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:41.866599 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:41.866813 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:41.866904 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:41.869688 (+ 2784us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.131:45471: BlockingRecv error: recv got EOF from 127.11.229.131:45471 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Sep 23 17:14:42 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.129@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:42 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.129@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:42.463641 21363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:42.458052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.129:44299)
0923 17:14:42.458414 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:42.458428 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:42.458521 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:42.458760 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:42.458762 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:42.458933 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:42.459028 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:42.459033 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:42.459768 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:42.459771 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:42.460323 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:42.460331 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:42.460825 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:42.460828 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:42.460906 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:42.461377 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:42.461389 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:42.463476 (+ 2087us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":85,"threads_started":1}
W20260923 17:14:42.463752 21364 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:42.458249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:44299 (local address 127.11.229.190:34469)
0923 17:14:42.458455 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:42.458459 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:42.458475 (+ 16us) server_negotiation.cc:407] Connection header received
0923 17:14:42.458617 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:42.458619 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:42.458674 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:42.458749 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:42.459123 (+ 374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:42.459651 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:42.460469 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:42.460714 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:42.460803 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:42.463591 (+ 2788us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.129:44299: BlockingRecv error: recv got EOF from 127.11.229.129:44299 (error 108)
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":64,"threads_started":1}
Sep 23 17:14:42 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.130@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:42 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.130@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:42.675832 21365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:42.669837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.130:35369)
0923 17:14:42.670191 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:42.670206 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:42.670356 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:42.670690 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:42.670693 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:42.670919 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:42.671014 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:42.671019 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:42.671862 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:42.671868 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:42.672507 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:42.672515 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:42.673023 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:42.673027 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:42.673127 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:42.673623 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:42.673634 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:42.675616 (+ 1982us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":98,"threads_started":1}
W20260923 17:14:42.675900 21364 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:42.670003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:35369 (local address 127.11.229.190:34469)
0923 17:14:42.670156 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:42.670161 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:42.670328 (+ 167us) server_negotiation.cc:407] Connection header received
0923 17:14:42.670474 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:42.670478 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:42.670538 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:42.670668 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:42.671154 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:42.671737 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:42.672644 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:42.672897 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:42.673022 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:42.675781 (+ 2759us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.130:35369: BlockingRecv error: recv got EOF from 127.11.229.130:35369 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Sep 23 17:14:42 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.131@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:42 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.131@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:42.876400 21366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:42.870689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.131:43773)
0923 17:14:42.871013 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:42.871029 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:42.871184 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:42.871498 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:42.871501 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:42.871704 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:42.871795 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:42.871801 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:42.872536 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:42.872542 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:42.873106 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:42.873114 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:42.873565 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:42.873569 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:42.873651 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:42.874294 (+ 643us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:42.874305 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:42.876216 (+ 1911us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":81,"threads_started":1}
W20260923 17:14:42.876433 21364 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:42.870841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:43773 (local address 127.11.229.190:34469)
0923 17:14:42.871005 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:42.871010 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:42.871120 (+ 110us) server_negotiation.cc:407] Connection header received
0923 17:14:42.871328 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:42.871331 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:42.871386 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:42.871482 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:42.871909 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:42.872429 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:42.873228 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:42.873448 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:42.873563 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:42.876331 (+ 2768us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.131:43773: BlockingRecv error: recv got EOF from 127.11.229.131:43773 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Sep 23 17:14:43 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.129@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:43 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.129@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:43.469588 21367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:43.464371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.129:60995)
0923 17:14:43.464624 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:43.464638 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:43.464720 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:43.464942 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:43.464944 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:43.465115 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:43.465210 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:43.465214 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:43.465915 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:43.465917 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:43.466504 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:43.466512 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:43.466913 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:43.466916 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:43.466972 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:43.467447 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:43.467458 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:43.469461 (+ 2003us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":93,"threads_started":1}
W20260923 17:14:43.469815 21368 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:43.464466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:60995 (local address 127.11.229.190:34469)
0923 17:14:43.464687 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:43.464691 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:43.464703 (+ 12us) server_negotiation.cc:407] Connection header received
0923 17:14:43.464798 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:43.464800 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:43.464840 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:43.464916 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:43.465309 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:43.465826 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:43.466604 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:43.466818 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:43.466894 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:43.469657 (+ 2763us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.129:60995: BlockingRecv error: recv got EOF from 127.11.229.129:60995 (error 108)
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":81,"threads_started":1}
Sep 23 17:14:43 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.130@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:43 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.130@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:43.682152 21369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:43.676554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.130:51797)
0923 17:14:43.676860 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:43.676882 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:43.677012 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:43.677273 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:43.677276 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:43.677489 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:43.677575 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:43.677580 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:43.678520 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:43.678525 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:43.679104 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:43.679111 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:43.679564 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:43.679567 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:43.679655 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:43.680164 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:43.680175 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:43.681976 (+ 1801us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":90,"threads_started":1}
W20260923 17:14:43.682219 21368 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:43.676673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:51797 (local address 127.11.229.190:34469)
0923 17:14:43.676828 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:43.676832 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:43.676956 (+ 124us) server_negotiation.cc:407] Connection header received
0923 17:14:43.677110 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:43.677113 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:43.677171 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:43.677255 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:43.677695 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:43.678410 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:43.679227 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:43.679451 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:43.679561 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:43.682100 (+ 2539us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.130:51797: BlockingRecv error: recv got EOF from 127.11.229.130:51797 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Sep 23 17:14:43 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.131@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:43 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.131@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:43.893959 21370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:43.877474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.131:33863)
0923 17:14:43.877837 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:43.877855 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:43.878001 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:43.878444 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:43.878447 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:43.878697 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:43.878825 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:43.878833 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:43.879619 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:43.879622 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:43.880231 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:43.880240 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:43.880661 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:43.880664 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:43.880722 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:43.891515 (+ 10793us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:43.891529 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:43.893811 (+ 2282us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":82,"threads_started":1}
W20260923 17:14:43.894165 21368 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:43.877615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:33863 (local address 127.11.229.190:34469)
0923 17:14:43.877778 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:43.877786 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:43.878000 (+ 214us) server_negotiation.cc:407] Connection header received
0923 17:14:43.878118 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:43.878121 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:43.878207 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:43.878378 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:43.878958 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:43.879499 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:43.880354 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:43.880562 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:43.880640 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:43.893975 (+ 13335us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.131:33863: BlockingRecv error: recv got EOF from 127.11.229.131:33863 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Sep 23 17:14:44 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.129@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:44 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.129@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:44.476678 21371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:44.470542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.129:33171)
0923 17:14:44.470867 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:44.470888 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:44.470991 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:44.471267 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:44.471269 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:44.471459 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:44.471604 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:44.471612 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:44.472554 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:44.472562 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:44.473371 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:44.473380 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:44.473843 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:44.473846 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:44.473944 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:44.474550 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:44.474562 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:44.476551 (+ 1989us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":122,"threads_started":1}
W20260923 17:14:44.476908 21372 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:44.470769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:33171 (local address 127.11.229.190:34469)
0923 17:14:44.471031 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:44.471034 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:44.471048 (+ 14us) server_negotiation.cc:407] Connection header received
0923 17:14:44.471088 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:44.471090 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:44.471130 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:44.471216 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:44.471728 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:44.472460 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:44.473483 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:44.473708 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:44.473800 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:44.476743 (+ 2943us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.129:33171: BlockingRecv error: recv got EOF from 127.11.229.129:33171 (error 108)
Metrics: {"server-negotiator.queue_time_us":200,"thread_start_us":119,"threads_started":1}
Sep 23 17:14:44 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.130@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:44 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.130@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:44.688524 21373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:44.682942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.130:40715)
0923 17:14:44.683276 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:44.683288 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:44.683383 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:44.683632 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:44.683634 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:44.683868 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:44.683984 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:44.683995 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:44.684886 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:44.684892 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:44.685438 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:44.685445 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:44.685887 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:44.685890 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:44.685972 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:44.686567 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:44.686579 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:44.688332 (+ 1753us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":87,"threads_started":1}
W20260923 17:14:44.688560 21372 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:44.683068 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:40715 (local address 127.11.229.190:34469)
0923 17:14:44.683197 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:44.683200 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:44.683355 (+ 155us) server_negotiation.cc:407] Connection header received
0923 17:14:44.683471 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:44.683473 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:44.683519 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:44.683592 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:44.684120 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:44.684775 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:44.685554 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:44.685777 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:44.685883 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:44.688457 (+ 2574us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.130:40715: BlockingRecv error: recv got EOF from 127.11.229.130:40715 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Sep 23 17:14:44 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.131@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:44 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.131@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:44.900475 21374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:44.894746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.131:39665)
0923 17:14:44.895139 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:44.895153 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:44.895306 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:44.895585 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:44.895588 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:44.895795 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:44.895882 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:44.895888 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:44.896659 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:44.896664 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:44.897326 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:44.897335 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:44.897779 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:44.897783 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:44.897868 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:44.898451 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:44.898463 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:44.900302 (+ 1839us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":98,"threads_started":1}
W20260923 17:14:44.900540 21372 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:44.894863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:39665 (local address 127.11.229.190:34469)
0923 17:14:44.895059 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:44.895064 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:44.895241 (+ 177us) server_negotiation.cc:407] Connection header received
0923 17:14:44.895413 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:44.895416 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:44.895471 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:44.895571 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:44.896004 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:44.896537 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:44.897439 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:44.897661 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:44.897765 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:44.900433 (+ 2668us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.131:39665: BlockingRecv error: recv got EOF from 127.11.229.131:39665 (error 108)
Metrics: {"server-negotiator.queue_time_us":97}
Sep 23 17:14:45 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.129@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:45 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.129@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:45.483103 21375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:45.477552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.129:42953)
0923 17:14:45.477820 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:45.477834 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:45.477927 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:45.478299 (+ 372us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:45.478302 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:45.478487 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:45.478595 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:45.478601 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:45.479431 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:45.479434 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:45.480006 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:45.480014 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:45.480451 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:45.480454 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:45.480516 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:45.481056 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:45.481068 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:45.482978 (+ 1910us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":92,"threads_started":1}
W20260923 17:14:45.483268 21376 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:45.477610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:42953 (local address 127.11.229.190:34469)
0923 17:14:45.477912 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:45.477916 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:45.477939 (+ 23us) server_negotiation.cc:407] Connection header received
0923 17:14:45.477996 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:45.477998 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:45.478041 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:45.478121 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:45.478729 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:45.479301 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:45.480126 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:45.480347 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:45.480428 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:45.483128 (+ 2700us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.129:42953: BlockingRecv error: recv got EOF from 127.11.229.129:42953 (error 108)
Metrics: {"server-negotiator.queue_time_us":231,"thread_start_us":137,"threads_started":1}
Sep 23 17:14:45 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.130@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:45 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.130@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:45.694813 21377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:45.689363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.130:35013)
0923 17:14:45.689638 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:45.689650 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:45.689757 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:45.690024 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:45.690027 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:45.690316 (+ 289us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:45.690415 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:45.690421 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:45.691182 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:45.691184 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:45.691738 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:45.691746 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:45.692220 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:45.692224 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:45.692308 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:45.692771 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:45.692782 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:45.694700 (+ 1918us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":107,"threads_started":1}
W20260923 17:14:45.695151 21376 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:45.689466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:35013 (local address 127.11.229.190:34469)
0923 17:14:45.689619 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:45.689622 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:45.689702 (+ 80us) server_negotiation.cc:407] Connection header received
0923 17:14:45.689824 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:45.689826 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:45.689868 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:45.689937 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:45.690528 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:45.691052 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:45.691871 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:45.692109 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:45.692219 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:45.695051 (+ 2832us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.130:35013: BlockingRecv error: recv got EOF from 127.11.229.130:35013 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Sep 23 17:14:45 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.131@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:45 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.131@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:45.906703 21378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:45.901280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.131:42021)
0923 17:14:45.901546 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:45.901559 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:45.901690 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:45.901958 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:45.901961 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:45.902161 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:45.902332 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:45.902340 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:45.903089 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:45.903094 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:45.903644 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:45.903652 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:45.904099 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:45.904103 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:45.904185 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:45.904720 (+ 535us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:45.904741 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:45.906538 (+ 1797us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":84,"threads_started":1}
W20260923 17:14:45.906755 21376 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:45.901318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:42021 (local address 127.11.229.190:34469)
0923 17:14:45.901482 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:45.901487 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:45.901628 (+ 141us) server_negotiation.cc:407] Connection header received
0923 17:14:45.901799 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:45.901804 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:45.901854 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:45.901939 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:45.902444 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:45.902977 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:45.903766 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:45.903988 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:45.904096 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:45.906651 (+ 2555us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.131:42021: BlockingRecv error: recv got EOF from 127.11.229.131:42021 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Sep 23 17:14:46 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.129@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:46 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.129@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:46.489089 21379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:46.483952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.129:54731)
0923 17:14:46.484201 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:46.484217 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:46.484305 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:46.484554 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:46.484556 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:46.484743 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:46.484838 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:46.484843 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:46.485550 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:46.485553 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:46.486127 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:46.486134 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:46.486545 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:46.486547 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:46.486615 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:46.487173 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:46.487188 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:46.488961 (+ 1773us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":95,"threads_started":1}
W20260923 17:14:46.489224 21380 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:46.484032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:54731 (local address 127.11.229.190:34469)
0923 17:14:46.484264 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:46.484267 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:46.484281 (+ 14us) server_negotiation.cc:407] Connection header received
0923 17:14:46.484387 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:46.484390 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:46.484434 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:46.484521 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:46.484937 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:46.485461 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:46.486246 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:46.486453 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:46.486525 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:46.489094 (+ 2569us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.129:54731: BlockingRecv error: recv got EOF from 127.11.229.129:54731 (error 108)
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":91,"threads_started":1}
Sep 23 17:14:46 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.130@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:46 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.130@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:46.701002 21381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:46.695598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.130:56249)
0923 17:14:46.695906 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:46.695922 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:46.696024 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:46.696349 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:46.696352 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:46.696558 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:46.696651 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:46.696656 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:46.697385 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:46.697391 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:46.697957 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:46.697964 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:46.698479 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:46.698482 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:46.698564 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:46.699106 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:46.699127 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:46.700889 (+ 1762us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":97,"threads_started":1}
W20260923 17:14:46.701134 21380 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:46.695765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:56249 (local address 127.11.229.190:34469)
0923 17:14:46.695907 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:46.695913 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:46.695977 (+ 64us) server_negotiation.cc:407] Connection header received
0923 17:14:46.696188 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:46.696190 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:46.696234 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:46.696325 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:46.696761 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:46.697280 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:46.698072 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:46.698368 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:46.698478 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:46.701022 (+ 2544us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.130:56249: BlockingRecv error: recv got EOF from 127.11.229.130:56249 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Sep 23 17:14:46 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.131@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:46 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.131@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:46.913626 21382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:46.907634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.131:42379)
0923 17:14:46.907888 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:46.907901 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:46.907988 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:46.908264 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:46.908266 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:46.908445 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:46.908534 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:46.908539 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:46.909288 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:46.909290 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:46.909845 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:46.909853 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:46.910410 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:46.910414 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:46.910482 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:46.911244 (+ 762us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:46.911260 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:46.913450 (+ 2190us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":76,"threads_started":1}
W20260923 17:14:46.913666 21380 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:46.907726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:42379 (local address 127.11.229.190:34469)
0923 17:14:46.907978 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:46.907983 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:46.908004 (+ 21us) server_negotiation.cc:407] Connection header received
0923 17:14:46.908059 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:46.908062 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:46.908106 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:46.908206 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:46.908645 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:46.909188 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:46.909976 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:46.910256 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:46.910394 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:46.913567 (+ 3173us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.131:42379: BlockingRecv error: recv got EOF from 127.11.229.131:42379 (error 108)
Metrics: {"server-negotiator.queue_time_us":166}
Sep 23 17:14:47 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.129@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:47 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.129@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:47.495620 21384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:47.490029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.129:58813)
0923 17:14:47.490426 (+ 397us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:47.490439 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:47.490541 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:47.490803 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:47.490805 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:47.490981 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:47.491074 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:47.491079 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:47.491830 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:47.491833 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:47.492394 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:47.492402 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:47.492822 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:47.492825 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:47.492883 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:47.493479 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:47.493490 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:47.495450 (+ 1960us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":116,"threads_started":1}
W20260923 17:14:47.495677 21383 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:47.490088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:58813 (local address 127.11.229.190:34469)
0923 17:14:47.490387 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:47.490392 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:47.490560 (+ 168us) server_negotiation.cc:407] Connection header received
0923 17:14:47.490606 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:47.490608 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:47.490656 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:47.490747 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:47.491206 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:47.491729 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:47.492507 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:47.492724 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:47.492804 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:47.495563 (+ 2759us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.129:58813: BlockingRecv error: recv got EOF from 127.11.229.129:58813 (error 108)
Metrics: {"server-negotiator.queue_time_us":214,"thread_start_us":72,"threads_started":1}
Sep 23 17:14:47 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.130@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:47 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.130@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:47.708705 21385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:47.701946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.130:52093)
0923 17:14:47.702373 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:47.702386 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:47.702518 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:47.702845 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:47.702849 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:47.703072 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:47.703171 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:47.703178 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:47.704008 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:47.704015 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:47.704625 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:47.704634 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:47.705150 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:47.705154 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:47.705259 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:47.705855 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:47.705878 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:47.708518 (+ 2640us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":100,"threads_started":1}
W20260923 17:14:47.708756 21383 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:47.702052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:52093 (local address 127.11.229.190:34469)
0923 17:14:47.702201 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:47.702209 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:47.702465 (+ 256us) server_negotiation.cc:407] Connection header received
0923 17:14:47.702667 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:47.702670 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:47.702729 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:47.702822 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:47.703299 (+ 477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:47.703890 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:47.704751 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:47.705008 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:47.705125 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:47.708645 (+ 3520us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.130:52093: BlockingRecv error: recv got EOF from 127.11.229.130:52093 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Sep 23 17:14:47 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.131@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:47 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.131@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:47.920496 21386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:47.914527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.131:46483)
0923 17:14:47.914789 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:47.914812 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:47.914955 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:47.915263 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:47.915266 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:47.915477 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:47.915602 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:47.915610 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:47.916738 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:47.916742 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:47.917369 (+ 627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:47.917378 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:47.917854 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:47.917857 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:47.917916 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:47.918520 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:47.918535 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:47.920380 (+ 1845us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":84,"threads_started":1}
W20260923 17:14:47.920831 21383 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:47.914582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:46483 (local address 127.11.229.190:34469)
0923 17:14:47.914747 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:47.914751 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:47.914891 (+ 140us) server_negotiation.cc:407] Connection header received
0923 17:14:47.915070 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:47.915074 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:47.915128 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:47.915233 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:47.915759 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:47.916596 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:47.917495 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:47.917745 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:47.917834 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:47.920734 (+ 2900us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.131:46483: BlockingRecv error: recv got EOF from 127.11.229.131:46483 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Sep 23 17:14:48 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.129@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:48 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.129@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:48.502293 21387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:48.496521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.129:35243)
0923 17:14:48.496870 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:48.496885 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:48.496973 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:48.497264 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:48.497266 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:48.497444 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:48.497550 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:48.497555 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:48.498467 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:48.498469 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:48.499316 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:48.499327 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:48.499795 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:48.499797 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:48.499856 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:48.500383 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:48.500394 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:48.502111 (+ 1717us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":101,"threads_started":1}
W20260923 17:14:48.502513 21388 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:48.496671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:35243 (local address 127.11.229.190:34469)
0923 17:14:48.496895 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:48.496902 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:48.496924 (+ 22us) server_negotiation.cc:407] Connection header received
0923 17:14:48.497062 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:48.497065 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:48.497110 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:48.497188 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:48.497645 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:48.498358 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:48.499443 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:48.499699 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:48.499778 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:48.502375 (+ 2597us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.129:35243: BlockingRecv error: recv got EOF from 127.11.229.129:35243 (error 108)
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":56,"threads_started":1}
Sep 23 17:14:48 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.130@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:48 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.130@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:48.715229 21389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:48.709795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.130:41339)
0923 17:14:48.710107 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:48.710120 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:48.710289 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:48.710537 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:48.710539 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:48.710723 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:48.710813 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:48.710817 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:48.711536 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:48.711538 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:48.712182 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:48.712199 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:48.712636 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:48.712639 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:48.712701 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:48.713256 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:48.713273 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:48.715075 (+ 1802us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":99,"threads_started":1}
W20260923 17:14:48.715445 21388 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:48.709787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:41339 (local address 127.11.229.190:34469)
0923 17:14:48.709963 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:48.709967 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:48.710193 (+ 226us) server_negotiation.cc:407] Connection header received
0923 17:14:48.710386 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:48.710389 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:48.710435 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:48.710508 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:48.710907 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:48.711439 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:48.712314 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:48.712538 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:48.712623 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:48.715305 (+ 2682us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.130:41339: BlockingRecv error: recv got EOF from 127.11.229.130:41339 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Sep 23 17:14:48 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.131@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:48 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.131@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:48.934113 21390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:48.921171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.131:51717)
0923 17:14:48.921564 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:48.921578 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:48.921716 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:48.921985 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:48.921988 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:48.922301 (+ 313us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:48.922401 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:48.922407 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:48.923164 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:48.923171 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:48.923730 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:48.923738 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:48.924185 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:48.924188 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:48.924273 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:48.931586 (+ 7313us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:48.931605 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:48.933990 (+ 2385us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":105,"threads_started":1}
W20260923 17:14:48.934531 21388 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:48.921349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:51717 (local address 127.11.229.190:34469)
0923 17:14:48.921516 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:48.921521 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:48.921654 (+ 133us) server_negotiation.cc:407] Connection header received
0923 17:14:48.921816 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:48.921820 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:48.921878 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:48.921965 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:48.922519 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:48.923052 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:48.923851 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:48.924071 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:48.924181 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:48.934107 (+ 9926us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.131:51717: BlockingRecv error: recv got EOF from 127.11.229.131:51717 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Sep 23 17:14:49 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.129@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:49 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.129@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:49.508916 21391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:49.503023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.129:34621)
0923 17:14:49.503295 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:49.503308 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:49.503393 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:49.503691 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:49.503694 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:49.503907 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:49.504020 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:49.504026 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:49.504828 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:49.504831 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:49.505517 (+ 686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:49.505527 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:49.505983 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:49.505990 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:49.506098 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:49.506711 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:49.506724 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:49.508744 (+ 2020us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":103,"threads_started":1}
W20260923 17:14:49.508984 21392 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:49.503212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:34621 (local address 127.11.229.190:34469)
0923 17:14:49.503436 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:49.503440 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:49.503451 (+ 11us) server_negotiation.cc:407] Connection header received
0923 17:14:49.503487 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:49.503489 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:49.503529 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:49.503613 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:49.504140 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:49.504693 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:49.505633 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:49.505851 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:49.505930 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:49.508858 (+ 2928us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.129:34621: BlockingRecv error: recv got EOF from 127.11.229.129:34621 (error 108)
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":87,"threads_started":1}
Sep 23 17:14:49 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.130@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:49 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.130@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:49.722213 21393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:49.716096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.130:55557)
0923 17:14:49.716402 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:49.716418 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:49.716538 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:49.716861 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:49.716867 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:49.717056 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:49.717150 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:49.717155 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:49.718016 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:49.718018 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:49.718768 (+ 750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:49.718777 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:49.719227 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:49.719230 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:49.719307 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:49.719795 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:49.719806 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:49.721957 (+ 2151us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":76,"threads_started":1}
W20260923 17:14:49.722206 21392 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:49.716158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:55557 (local address 127.11.229.190:34469)
0923 17:14:49.716315 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:49.716320 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:49.716498 (+ 178us) server_negotiation.cc:407] Connection header received
0923 17:14:49.716623 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:49.716626 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:49.716683 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:49.716796 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:49.717268 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:49.717925 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:49.718901 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:49.719127 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:49.719214 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:49.722083 (+ 2869us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.130:55557: BlockingRecv error: recv got EOF from 127.11.229.130:55557 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Sep 23 17:14:49 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.131@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:49 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.131@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:49.940467 21394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:49.935122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.131:42193)
0923 17:14:49.935416 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:49.935429 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:49.935530 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:49.935798 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:49.935800 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:49.935974 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:49.936067 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:49.936072 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:49.936882 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:49.936884 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:49.937430 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:49.937437 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:49.937899 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:49.937902 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:49.937968 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:49.938506 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:49.938517 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:49.940352 (+ 1835us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":97,"threads_started":1}
W20260923 17:14:49.940626 21392 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:49.935180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:42193 (local address 127.11.229.190:34469)
0923 17:14:49.935304 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:49.935309 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:49.935514 (+ 205us) server_negotiation.cc:407] Connection header received
0923 17:14:49.935620 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:49.935625 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:49.935686 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:49.935761 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:49.936210 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:49.936779 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:49.937536 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:49.937781 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:49.937865 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:49.940489 (+ 2624us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.131:42193: BlockingRecv error: recv got EOF from 127.11.229.131:42193 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Sep 23 17:14:50 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.129@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:50 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.129@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:50.515445 21395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:50.509767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.129:38119)
0923 17:14:50.510042 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:50.510055 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:50.510143 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:50.510455 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:50.510457 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:50.510633 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:50.510728 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:50.510734 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:50.511493 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:50.511496 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:50.512149 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:50.512159 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:50.512793 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:50.512799 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:50.512884 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:50.513458 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:50.513470 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:50.515331 (+ 1861us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":95,"threads_started":1}
W20260923 17:14:50.515600 21396 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:50.509878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:38119 (local address 127.11.229.190:34469)
0923 17:14:50.510099 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:50.510103 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:50.510116 (+ 13us) server_negotiation.cc:407] Connection header received
0923 17:14:50.510293 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:50.510295 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:50.510341 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:50.510423 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:50.510874 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:50.511400 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:50.512243 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:50.512640 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:50.512749 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:50.515459 (+ 2710us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.129:38119: BlockingRecv error: recv got EOF from 127.11.229.129:38119 (error 108)
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":82,"threads_started":1}
Sep 23 17:14:50 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.130@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:50 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.130@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:50.729009 21397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:50.723113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.130:33483)
0923 17:14:50.723428 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:50.723445 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:50.723564 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:50.723900 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:50.723903 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:50.724081 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:50.724172 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:50.724178 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:50.725027 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:50.725029 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:50.725576 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:50.725583 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:50.726022 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:50.726024 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:50.726081 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:50.726697 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:50.726720 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:50.728893 (+ 2173us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":108,"threads_started":1}
W20260923 17:14:50.729121 21396 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:50.723257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:33483 (local address 127.11.229.190:34469)
0923 17:14:50.723421 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:50.723426 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:50.723533 (+ 107us) server_negotiation.cc:407] Connection header received
0923 17:14:50.723680 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:50.723684 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:50.723749 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:50.723838 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:50.724292 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:50.724926 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:50.725681 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:50.725919 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:50.726006 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:50.729022 (+ 3016us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.130:33483: BlockingRecv error: recv got EOF from 127.11.229.130:33483 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Sep 23 17:14:50 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.131@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:50 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.131@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:50.947072 21398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:50.941337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.131:42039)
0923 17:14:50.941599 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:50.941612 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:50.941717 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:50.941978 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:50.941981 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:50.942162 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:50.942337 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:50.942345 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:50.943111 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:50.943114 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:50.943685 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:50.943692 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:50.944094 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:50.944096 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:50.944152 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:50.944773 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:50.944784 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:50.946921 (+ 2137us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":74,"threads_started":1}
W20260923 17:14:50.947145 21396 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:50.941466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:42039 (local address 127.11.229.190:34469)
0923 17:14:50.941624 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:50.941628 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:50.941684 (+ 56us) server_negotiation.cc:407] Connection header received
0923 17:14:50.941797 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:50.941799 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:50.941842 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:50.941912 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:50.942468 (+ 556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:50.943015 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:50.943791 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:50.944000 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:50.944076 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:50.947057 (+ 2981us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.131:42039: BlockingRecv error: recv got EOF from 127.11.229.131:42039 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Sep 23 17:14:51 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.129@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:51 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.129@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:51.521423 21399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:51.516250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.129:60053)
0923 17:14:51.516499 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:51.516514 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:51.516616 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:51.516853 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:51.516855 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:51.517030 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:51.517125 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:51.517130 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:51.517861 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:51.517863 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:51.518439 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:51.518447 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:51.518873 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:51.518875 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:51.518934 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:51.519498 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:51.519521 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:51.521308 (+ 1787us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":89,"threads_started":1}
W20260923 17:14:51.521616 21400 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:51.516294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:60053 (local address 127.11.229.190:34469)
0923 17:14:51.516530 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:51.516533 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:51.516593 (+ 60us) server_negotiation.cc:407] Connection header received
0923 17:14:51.516693 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:51.516695 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:51.516743 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:51.516829 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:51.517219 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:51.517765 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:51.518544 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:51.518774 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:51.518854 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:51.521440 (+ 2586us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.129:60053: BlockingRecv error: recv got EOF from 127.11.229.129:60053 (error 108)
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":90,"threads_started":1}
Sep 23 17:14:51 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.130@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:51 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.130@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:51.735972 21401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:51.730074 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.130:56533)
0923 17:14:51.730396 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:51.730409 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:51.730537 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:51.730821 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:51.730823 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:51.731034 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:51.731120 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:51.731126 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:51.731910 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:51.731916 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:51.732491 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:51.732498 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:51.732961 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:51.732965 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:51.733048 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:51.733558 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:51.733570 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:51.735831 (+ 2261us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":82,"threads_started":1}
W20260923 17:14:51.736129 21400 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:51.730133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:56533 (local address 127.11.229.190:34469)
0923 17:14:51.730326 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:51.730330 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:51.730481 (+ 151us) server_negotiation.cc:407] Connection header received
0923 17:14:51.730651 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:51.730655 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:51.730707 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:51.730804 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:51.731236 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:51.731767 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:51.732617 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:51.732847 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:51.732956 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:51.735974 (+ 3018us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.130:56533: BlockingRecv error: recv got EOF from 127.11.229.130:56533 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
Sep 23 17:14:51 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.131@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:51 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.131@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:51.953982 21402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:51.948008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.131:39669)
0923 17:14:51.948310 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:51.948328 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:51.948451 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:51.948767 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:51.948770 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:51.949034 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:51.949133 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:51.949139 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:51.950114 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:51.950119 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:51.950763 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:51.950772 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:51.951259 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:51.951263 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:51.951354 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:51.951866 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:51.951877 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:51.953870 (+ 1993us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":64,"threads_started":1}
W20260923 17:14:51.954192 21400 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:51.948242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:39669 (local address 127.11.229.190:34469)
0923 17:14:51.948409 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:51.948415 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:51.948429 (+ 14us) server_negotiation.cc:407] Connection header received
0923 17:14:51.948574 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:51.948579 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:51.948636 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:51.948755 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:51.949332 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:51.949890 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:51.950889 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:51.951132 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:51.951256 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:51.954049 (+ 2793us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.131:39669: BlockingRecv error: recv got EOF from 127.11.229.131:39669 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Sep 23 17:14:52 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.129@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:52 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.129@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:52.528246 21403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:52.522245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.129:40583)
0923 17:14:52.522490 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:52.522504 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:52.522615 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:52.522924 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:52.522926 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:52.523114 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:52.523215 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:52.523222 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:52.524041 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:52.524043 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:52.524726 (+ 683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:52.524738 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:52.525290 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:52.525294 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:52.525384 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:52.525898 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:52.525912 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:52.528071 (+ 2159us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":84,"threads_started":1}
W20260923 17:14:52.528519 21404 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:52.522334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:40583 (local address 127.11.229.190:34469)
0923 17:14:52.522582 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:52.522585 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:52.522601 (+ 16us) server_negotiation.cc:407] Connection header received
0923 17:14:52.522715 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:52.522717 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:52.522763 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:52.522859 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:52.523340 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:52.523935 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:52.524857 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:52.525164 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:52.525285 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:52.528246 (+ 2961us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.129:40583: BlockingRecv error: recv got EOF from 127.11.229.129:40583 (error 108)
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":90,"threads_started":1}
Sep 23 17:14:52 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.130@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:52 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.130@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:52.742973 21405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:52.736720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.130:49769)
0923 17:14:52.737082 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:52.737104 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:52.737272 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:52.737580 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:52.737583 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:52.737820 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:52.737919 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:52.737926 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:52.738834 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:52.738841 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:52.739454 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:52.739462 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:52.739969 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:52.739974 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:52.740063 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:52.740602 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:52.740634 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:52.742786 (+ 2152us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":96,"threads_started":1}
W20260923 17:14:52.743019 21404 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:52.736838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:49769 (local address 127.11.229.190:34469)
0923 17:14:52.737038 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:52.737043 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:52.737241 (+ 198us) server_negotiation.cc:407] Connection header received
0923 17:14:52.737396 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:52.737400 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:52.737463 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:52.737564 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:52.738049 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:52.738719 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:52.739597 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:52.739846 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:52.739965 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:52.742913 (+ 2948us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.130:49769: BlockingRecv error: recv got EOF from 127.11.229.130:49769 (error 108)
Metrics: {"server-negotiator.queue_time_us":89}
Sep 23 17:14:52 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.131@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:52 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.131@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:52.960597 21406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:52.954844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.131:53445)
0923 17:14:52.955119 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:52.955132 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:52.955263 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:52.955537 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:52.955540 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:52.955748 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:52.955843 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:52.955848 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:52.956638 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:52.956644 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:52.957273 (+ 629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:52.957281 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:52.957738 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:52.957742 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:52.957820 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:52.958399 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:52.958410 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:52.960424 (+ 2014us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":94,"threads_started":1}
W20260923 17:14:52.960693 21404 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:52.954906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:53445 (local address 127.11.229.190:34469)
0923 17:14:52.955062 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:52.955067 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:52.955200 (+ 133us) server_negotiation.cc:407] Connection header received
0923 17:14:52.955380 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:52.955383 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:52.955436 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:52.955517 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:52.955959 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:52.956527 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:52.957392 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:52.957630 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:52.957736 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:52.960577 (+ 2841us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.131:53445: BlockingRecv error: recv got EOF from 127.11.229.131:53445 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Sep 23 17:14:53 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.129@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:53 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.129@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:53.536616 21407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:53.529129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.129:56009)
0923 17:14:53.530479 (+ 1350us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:53.530496 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:53.530616 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:53.530949 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:53.530955 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:53.531232 (+ 277us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:53.531363 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:53.531372 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:53.532382 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:53.532385 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:53.533162 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:53.533172 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:53.533802 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:53.533807 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:53.533912 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:53.534539 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:53.534554 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:53.536479 (+ 1925us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":1272,"thread_start_us":108,"threads_started":1}
W20260923 17:14:53.536825 21408 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:53.529243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:56009 (local address 127.11.229.190:34469)
0923 17:14:53.529513 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:53.529520 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:53.530564 (+ 1044us) server_negotiation.cc:407] Connection header received
0923 17:14:53.530722 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:53.530725 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:53.530791 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:53.530884 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:53.531509 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:53.532244 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:53.533289 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:53.533675 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:53.533769 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:53.536656 (+ 2887us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.129:56009: BlockingRecv error: recv got EOF from 127.11.229.129:56009 (error 108)
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":100,"threads_started":1}
Sep 23 17:14:53 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.130@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:53 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.130@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:53.749276 21409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:53.743753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.130:55655)
0923 17:14:53.744045 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:53.744059 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:53.744219 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:53.744443 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:53.744444 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:53.744639 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:53.744729 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:53.744734 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:53.745460 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:53.745463 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:53.746020 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:53.746028 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:53.746516 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:53.746518 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:53.746577 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:53.747084 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:53.747095 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:53.749103 (+ 2008us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":128,"threads_started":1}
W20260923 17:14:53.749429 21408 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:53.743834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:55655 (local address 127.11.229.190:34469)
0923 17:14:53.744014 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:53.744020 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:53.744201 (+ 181us) server_negotiation.cc:407] Connection header received
0923 17:14:53.744312 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:53.744315 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:53.744360 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:53.744432 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:53.744824 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:53.745342 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:53.746187 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:53.746415 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:53.746493 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:53.749293 (+ 2800us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.130:55655: BlockingRecv error: recv got EOF from 127.11.229.130:55655 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
Sep 23 17:14:53 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.131@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:53 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.131@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:53.971320 21410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:53.961529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.131:35537)
0923 17:14:53.961931 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:53.961948 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:53.962098 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:53.962457 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:53.962460 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:53.962671 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:53.962764 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:53.962769 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:53.963521 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:53.963527 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:53.964189 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:53.964200 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:53.964913 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:53.964917 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:53.965015 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:53.968936 (+ 3921us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:53.968950 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:53.971151 (+ 2201us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":317,"thread_start_us":108,"threads_started":1}
W20260923 17:14:53.971457 21408 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:53.961687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:35537 (local address 127.11.229.190:34469)
0923 17:14:53.961894 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:53.961899 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:53.962033 (+ 134us) server_negotiation.cc:407] Connection header received
0923 17:14:53.962203 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:53.962206 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:53.962345 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:53.962436 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:53.962889 (+ 453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:53.963412 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:53.964370 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:53.964758 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:53.964910 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:53.971348 (+ 6438us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.131:35537: BlockingRecv error: recv got EOF from 127.11.229.131:35537 (error 108)
Metrics: {"server-negotiator.queue_time_us":104}
Sep 23 17:14:54 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.129@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:54 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.129@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:54.543258 21411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:54.537502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.129:51099)
0923 17:14:54.537824 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:54.537839 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:54.537939 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:54.538291 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:54.538294 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:54.538490 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:54.538622 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:54.538629 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:54.539413 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:54.539415 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:54.539994 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:54.540003 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:54.540453 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:54.540455 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:54.540522 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:54.541020 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:54.541032 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:54.543136 (+ 2104us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":86,"threads_started":1}
W20260923 17:14:54.543431 21412 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:54.537633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:51099 (local address 127.11.229.190:34469)
0923 17:14:54.537878 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:54.537881 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:54.537895 (+ 14us) server_negotiation.cc:407] Connection header received
0923 17:14:54.538036 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:54.538038 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:54.538081 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:54.538159 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:54.538744 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:54.539283 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:54.540114 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:54.540338 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:54.540420 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:54.543261 (+ 2841us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.129:51099: BlockingRecv error: recv got EOF from 127.11.229.129:51099 (error 108)
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":64,"threads_started":1}
Sep 23 17:14:54 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.130@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:54 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.130@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:54.756165 21413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:54.750348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.130:33619)
0923 17:14:54.750636 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:54.750652 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:54.750771 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:54.751062 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:54.751065 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:54.751342 (+ 277us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:54.751464 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:54.751474 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:54.752404 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:54.752407 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:54.752966 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:54.752974 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:54.753417 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:54.753420 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:54.753486 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:54.753968 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:54.753981 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:54.755969 (+ 1988us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":110,"threads_started":1}
W20260923 17:14:54.756232 21412 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:54.750499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:33619 (local address 127.11.229.190:34469)
0923 17:14:54.750664 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:54.750667 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:54.750775 (+ 108us) server_negotiation.cc:407] Connection header received
0923 17:14:54.750860 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:54.750863 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:54.750920 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:54.751041 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:54.751609 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:54.752296 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:54.753070 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:54.753285 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:54.753385 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:54.756096 (+ 2711us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.130:33619: BlockingRecv error: recv got EOF from 127.11.229.130:33619 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Sep 23 17:14:54 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.131@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:54 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.131@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:54.978148 21414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:54.972133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.131:34967)
0923 17:14:54.972398 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:54.972410 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:54.972511 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:54.972890 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:54.972892 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:54.973096 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:54.973189 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:54.973195 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:54.974138 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:54.974144 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:54.974925 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:54.974935 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:54.975542 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:54.975544 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:54.975602 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:54.976155 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:54.976166 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:54.978018 (+ 1852us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":93,"threads_started":1}
W20260923 17:14:54.978308 21412 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:54.972280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:34967 (local address 127.11.229.190:34469)
0923 17:14:54.972412 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:54.972415 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:54.972477 (+ 62us) server_negotiation.cc:407] Connection header received
0923 17:14:54.972594 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:54.972596 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:54.972655 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:54.972732 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:54.973371 (+ 639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:54.973993 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:54.975052 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:54.975439 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:54.975529 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:54.978158 (+ 2629us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.131:34967: BlockingRecv error: recv got EOF from 127.11.229.131:34967 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Sep 23 17:14:55 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.129@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:55 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.129@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:55.549367 21415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:55.544078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.129:33725)
0923 17:14:55.544383 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:55.544396 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:55.544479 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:55.544727 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:55.544729 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:55.544903 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:55.544993 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:55.544998 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:55.545756 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:55.545758 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:55.546383 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:55.546392 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:55.546804 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:55.546806 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:55.546865 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:55.547319 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:55.547330 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:55.549181 (+ 1851us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":81,"threads_started":1}
W20260923 17:14:55.549412 21416 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:55.544185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:33725 (local address 127.11.229.190:34469)
0923 17:14:55.544469 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:55.544472 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:55.544486 (+ 14us) server_negotiation.cc:407] Connection header received
0923 17:14:55.544567 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:55.544569 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:55.544610 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:55.544693 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:55.545111 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:55.545660 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:55.546483 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:55.546706 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:55.546784 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:55.549293 (+ 2509us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.129:33725: BlockingRecv error: recv got EOF from 127.11.229.129:33725 (error 108)
Metrics: {"server-negotiator.queue_time_us":205,"thread_start_us":82,"threads_started":1}
Sep 23 17:14:55 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.130@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:55 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.130@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:55.762633 21417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:55.757043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.130:38223)
0923 17:14:55.757334 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:55.757347 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:55.757441 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:55.757712 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:55.757714 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:55.757908 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:55.758018 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:55.758023 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:55.758981 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:55.758985 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:55.759595 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:55.759604 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:55.760082 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:55.760086 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:55.760166 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:55.760631 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:55.760642 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:55.762506 (+ 1864us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":123,"threads_started":1}
W20260923 17:14:55.762879 21416 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:55.757084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:38223 (local address 127.11.229.190:34469)
0923 17:14:55.757277 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:55.757281 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:55.757396 (+ 115us) server_negotiation.cc:407] Connection header received
0923 17:14:55.757520 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:55.757522 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:55.757565 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:55.757633 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:55.758155 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:55.758886 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:55.759716 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:55.759954 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:55.760080 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:55.762634 (+ 2554us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.130:38223: BlockingRecv error: recv got EOF from 127.11.229.130:38223 (error 108)
Metrics: {"server-negotiator.queue_time_us":92}
Sep 23 17:14:55 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.131@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:55 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.131@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:55.984553 21418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:55.979027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.131:36517)
0923 17:14:55.979278 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:55.979295 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:55.979406 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:55.979652 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:55.979660 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:55.979892 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:55.979995 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:55.980001 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:55.980773 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:55.980776 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:55.981354 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:55.981362 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:55.981960 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:55.981963 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:55.982030 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:55.982645 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:55.982656 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:55.984426 (+ 1770us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":86,"threads_started":1}
W20260923 17:14:55.984751 21416 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:55.979057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:36517 (local address 127.11.229.190:34469)
0923 17:14:55.979220 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:55.979225 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:55.979389 (+ 164us) server_negotiation.cc:407] Connection header received
0923 17:14:55.979483 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:55.979487 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:55.979546 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:55.979611 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:55.980104 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:55.980632 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:55.981500 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:55.981773 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:55.981888 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:55.984579 (+ 2691us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.131:36517: BlockingRecv error: recv got EOF from 127.11.229.131:36517 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Sep 23 17:14:56 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.129@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:56 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.129@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:56.556445 21419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:56.550371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.129:33671)
0923 17:14:56.550629 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:56.550642 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:56.550727 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:56.551024 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:56.551026 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:56.551205 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:56.551345 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:56.551351 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:56.552144 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:56.552146 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:56.552756 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:56.552765 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:56.553200 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:56.553202 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:56.553286 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:56.553916 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:56.553929 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:56.556211 (+ 2282us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":86,"threads_started":1}
W20260923 17:14:56.556483 21420 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:56.550430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:33671 (local address 127.11.229.190:34469)
0923 17:14:56.550677 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:56.550680 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:56.550694 (+ 14us) server_negotiation.cc:407] Connection header received
0923 17:14:56.550852 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:56.550855 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:56.550902 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:56.550984 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:56.551454 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:56.552036 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:56.552868 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:56.553103 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:56.553185 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:56.556352 (+ 3167us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.129:33671: BlockingRecv error: recv got EOF from 127.11.229.129:33671 (error 108)
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":65,"threads_started":1}
Sep 23 17:14:56 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.130@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
Sep 23 17:14:56 dist-test-slave-1x1f krb5kdc[20361](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.229.130@KRBTEST.COM for oryx/127.11.229.190@KRBTEST.COM, Server not found in Kerberos database
I20260923 17:14:56.769234 21421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:56.763503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:34469 (local address 127.11.229.130:52127)
0923 17:14:56.763765 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:56.763777 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:56.763903 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:56.764163 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:56.764166 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:56.764373 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:56.764462 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:56.764477 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:56.765228 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:56.765231 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:56.765821 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:56.765829 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:56.766380 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:56.766384 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:56.766466 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:56.767002 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:14:56.767025 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:56.769104 (+ 2079us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.229.190:34469: Server oryx/127.11.229.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":78,"threads_started":1}
W20260923 17:14:56.769387 21420 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:56.763530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:52127 (local address 127.11.229.190:34469)
0923 17:14:56.763697 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:56.763702 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:56.763852 (+ 150us) server_negotiation.cc:407] Connection header received
0923 17:14:56.764002 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:56.764005 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:56.764058 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:56.764143 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:56.764589 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:56.765120 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:56.765943 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:56.766163 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:56.766378 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:56.769238 (+ 2860us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.229.130:52127: BlockingRecv error: recv got EOF from 127.11.229.130:52127 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
I20260923 17:14:56.846797 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 20944
I20260923 17:14:56.852363 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 21096
I20260923 17:14:56.857549 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 21229
I20260923 17:14:56.863031 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 20874
2026-09-23T17:14:56Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (18120 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-09-23T17:14:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:14:56Z Disabled control of system clock
I20260923 17:14:56.893007 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:43943
--webserver_interface=127.11.229.190
--webserver_port=0
--builtin_ntp_servers=127.11.229.148:40683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:43943
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260923 17:14:57.003311 21425 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:57.003582 21425 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:57.003615 21425 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:57.007624 21425 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:14:57.007679 21425 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:57.007695 21425 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:57.007712 21425 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:14:57.007728 21425 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:14:57.012364 21425 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:40683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:43943
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:43943
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.229.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21425
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:57.013396 21425 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:57.014796 21425 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260923 17:14:57.023566 21425 server_base.cc:1034] running on GCE node
W20260923 17:14:57.023515 21431 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:57.023515 21430 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:57.023505 21433 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:57.024228 21425 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:57.025360 21425 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:57.026541 21425 hybrid_clock.cc:648] HybridClock initialized: now 1790183697026523 us; error 30 us; skew 500 ppm
I20260923 17:14:57.028364 21425 webserver.cc:460] Webserver started at http://127.11.229.190:40377/ using document root <none> and password file <none>
I20260923 17:14:57.028935 21425 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:57.029026 21425 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:57.029254 21425 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:57.031316 21425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "7bdcfab889bb4b28835b4cc710bf9a0b"
format_stamp: "Formatted at 2026-09-23 17:14:57 on dist-test-slave-1x1f"
server_key: "d5668cd938f336af687e7a7998fa01a3"
server_key_iv: "377ac303e0bc616a425cb82243a68b98"
server_key_version: "encryptionkey@0"
I20260923 17:14:57.031874 21425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "7bdcfab889bb4b28835b4cc710bf9a0b"
format_stamp: "Formatted at 2026-09-23 17:14:57 on dist-test-slave-1x1f"
server_key: "d5668cd938f336af687e7a7998fa01a3"
server_key_iv: "377ac303e0bc616a425cb82243a68b98"
server_key_version: "encryptionkey@0"
I20260923 17:14:57.035458 21425 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260923 17:14:57.037811 21439 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:57.039044 21425 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 17:14:57.039182 21425 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "7bdcfab889bb4b28835b4cc710bf9a0b"
format_stamp: "Formatted at 2026-09-23 17:14:57 on dist-test-slave-1x1f"
server_key: "d5668cd938f336af687e7a7998fa01a3"
server_key_iv: "377ac303e0bc616a425cb82243a68b98"
server_key_version: "encryptionkey@0"
I20260923 17:14:57.039294 21425 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:57.055943 21425 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:57.056668 21425 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:57.056950 21425 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:57.063963 21425 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.190:43943
I20260923 17:14:57.063985 21491 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.190:43943 every 8 connection(s)
I20260923 17:14:57.064885 21425 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:14:57.068058 21492 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:57.068653 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 21425
I20260923 17:14:57.068765 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:14:57.069098 12182 external_mini_cluster.cc:1428] Setting key ff4ca6f312d91c8542545053b2d02b89
I20260923 17:14:57.074170 21492 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7bdcfab889bb4b28835b4cc710bf9a0b: Bootstrap starting.
I20260923 17:14:57.076858 21492 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7bdcfab889bb4b28835b4cc710bf9a0b: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:57.077826 21492 log.cc:824] T 00000000000000000000000000000000 P 7bdcfab889bb4b28835b4cc710bf9a0b: Log is configured to *not* fsync() on all Append() calls
I20260923 17:14:57.078459 21495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:57.070554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55646 (local address 127.11.229.190:43943)
0923 17:14:57.071140 (+ 586us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:57.071155 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:57.071188 (+ 33us) server_negotiation.cc:407] Connection header received
0923 17:14:57.071815 (+ 627us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:57.071831 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:57.072193 (+ 362us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:57.072466 (+ 273us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:57.072774 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:57.073696 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:57.074853 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:57.075293 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:57.075426 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:57.076390 (+ 964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:57.076395 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:57.076406 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:14:57.076776 (+ 370us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:57.076832 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:14:57.076851 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:57.076929 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:57.077329 (+ 400us) server_negotiation.cc:299] Negotiation successful
0923 17:14:57.077573 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":260,"thread_start_us":126,"threads_started":1}
I20260923 17:14:57.079911 21492 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7bdcfab889bb4b28835b4cc710bf9a0b: No bootstrap required, opened a new log
I20260923 17:14:57.083397 21492 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7bdcfab889bb4b28835b4cc710bf9a0b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bdcfab889bb4b28835b4cc710bf9a0b" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43943 } }
I20260923 17:14:57.083635 21492 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7bdcfab889bb4b28835b4cc710bf9a0b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:57.083724 21492 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7bdcfab889bb4b28835b4cc710bf9a0b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7bdcfab889bb4b28835b4cc710bf9a0b, State: Initialized, Role: FOLLOWER
I20260923 17:14:57.084142 21492 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7bdcfab889bb4b28835b4cc710bf9a0b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bdcfab889bb4b28835b4cc710bf9a0b" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43943 } }
I20260923 17:14:57.084295 21492 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7bdcfab889bb4b28835b4cc710bf9a0b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:14:57.084388 21492 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7bdcfab889bb4b28835b4cc710bf9a0b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:14:57.084506 21492 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7bdcfab889bb4b28835b4cc710bf9a0b [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:57.085391 21492 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7bdcfab889bb4b28835b4cc710bf9a0b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bdcfab889bb4b28835b4cc710bf9a0b" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43943 } }
I20260923 17:14:57.085724 21492 leader_election.cc:302] T 00000000000000000000000000000000 P 7bdcfab889bb4b28835b4cc710bf9a0b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7bdcfab889bb4b28835b4cc710bf9a0b; no voters:
I20260923 17:14:57.086033 21492 leader_election.cc:288] T 00000000000000000000000000000000 P 7bdcfab889bb4b28835b4cc710bf9a0b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 17:14:57.086179 21497 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7bdcfab889bb4b28835b4cc710bf9a0b [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:14:57.086548 21497 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7bdcfab889bb4b28835b4cc710bf9a0b [term 1 LEADER]: Becoming Leader. State: Replica: 7bdcfab889bb4b28835b4cc710bf9a0b, State: Running, Role: LEADER
I20260923 17:14:57.086853 21497 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7bdcfab889bb4b28835b4cc710bf9a0b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bdcfab889bb4b28835b4cc710bf9a0b" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43943 } }
I20260923 17:14:57.087384 21492 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7bdcfab889bb4b28835b4cc710bf9a0b [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:14:57.088397 21498 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7bdcfab889bb4b28835b4cc710bf9a0b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7bdcfab889bb4b28835b4cc710bf9a0b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bdcfab889bb4b28835b4cc710bf9a0b" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43943 } } }
I20260923 17:14:57.088527 21498 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7bdcfab889bb4b28835b4cc710bf9a0b [sys.catalog]: This master's current role is: LEADER
I20260923 17:14:57.088436 21499 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7bdcfab889bb4b28835b4cc710bf9a0b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7bdcfab889bb4b28835b4cc710bf9a0b. Latest consensus state: current_term: 1 leader_uuid: "7bdcfab889bb4b28835b4cc710bf9a0b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7bdcfab889bb4b28835b4cc710bf9a0b" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43943 } } }
I20260923 17:14:57.088632 21499 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7bdcfab889bb4b28835b4cc710bf9a0b [sys.catalog]: This master's current role is: LEADER
I20260923 17:14:57.088907 21506 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:14:57.091513 21506 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:14:57.096798 21506 catalog_manager.cc:1347] Generated new cluster ID: 706994d17b91456d811b60178470e29c
I20260923 17:14:57.096874 21506 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:14:57.114833 21506 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:14:57.116108 21506 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:14:57.124812 21506 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7bdcfab889bb4b28835b4cc710bf9a0b: Generated new TSK 0
I20260923 17:14:57.125504 21506 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 17:14:57.135597 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.129:0
--local_ip_for_outbound_sockets=127.11.229.129
--webserver_interface=127.11.229.129
--webserver_port=0
--tserver_master_addrs=127.11.229.190:43943
--builtin_ntp_servers=127.11.229.148:40683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260923 17:14:57.247017 21516 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:57.247311 21516 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:57.247349 21516 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:57.251618 21516 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:57.251670 21516 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:57.251751 21516 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.129
I20260923 17:14:57.256496 21516 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:40683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.229.129
--webserver_port=0
--tserver_master_addrs=127.11.229.190:43943
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21516
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.129
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:57.257578 21516 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:57.258977 21516 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:57.268416 21524 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:57.268465 21516 server_base.cc:1034] running on GCE node
W20260923 17:14:57.268431 21522 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:57.268437 21521 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:57.269070 21516 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:57.269666 21516 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:57.270848 21516 hybrid_clock.cc:648] HybridClock initialized: now 1790183697270815 us; error 46 us; skew 500 ppm
I20260923 17:14:57.272583 21516 webserver.cc:460] Webserver started at http://127.11.229.129:45073/ using document root <none> and password file <none>
I20260923 17:14:57.273156 21516 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:57.273247 21516 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:57.273478 21516 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:57.275553 21516 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-0/data/instance:
uuid: "819cc9dca43e4e83af95aad16b68e270"
format_stamp: "Formatted at 2026-09-23 17:14:57 on dist-test-slave-1x1f"
server_key: "7fa378be6d2f900e7ca51bcf6edaca06"
server_key_iv: "e35caa227ccd245472302be869102968"
server_key_version: "encryptionkey@0"
I20260923 17:14:57.276115 21516 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance:
uuid: "819cc9dca43e4e83af95aad16b68e270"
format_stamp: "Formatted at 2026-09-23 17:14:57 on dist-test-slave-1x1f"
server_key: "7fa378be6d2f900e7ca51bcf6edaca06"
server_key_iv: "e35caa227ccd245472302be869102968"
server_key_version: "encryptionkey@0"
I20260923 17:14:57.279650 21516 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260923 17:14:57.282189 21530 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:57.283511 21516 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 17:14:57.283607 21516 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-0/wal
uuid: "819cc9dca43e4e83af95aad16b68e270"
format_stamp: "Formatted at 2026-09-23 17:14:57 on dist-test-slave-1x1f"
server_key: "7fa378be6d2f900e7ca51bcf6edaca06"
server_key_iv: "e35caa227ccd245472302be869102968"
server_key_version: "encryptionkey@0"
I20260923 17:14:57.283746 21516 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:57.321918 21516 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:57.322707 21516 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:57.322921 21516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:57.323513 21516 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:14:57.324473 21516 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:14:57.324519 21516 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:57.324585 21516 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:14:57.324617 21516 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:57.333519 21516 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.129:39243
I20260923 17:14:57.333542 21643 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.129:39243 every 8 connection(s)
I20260923 17:14:57.334487 21516 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
I20260923 17:14:57.342330 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 21516
I20260923 17:14:57.342480 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance
I20260923 17:14:57.342898 12182 external_mini_cluster.cc:1428] Setting key 558952944705ba24568f31e544f0e02c
I20260923 17:14:57.343619 21495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:57.336313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:48137 (local address 127.11.229.190:43943)
0923 17:14:57.336473 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:57.336478 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:57.337590 (+ 1112us) server_negotiation.cc:407] Connection header received
0923 17:14:57.339001 (+ 1411us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:57.339004 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:57.339052 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:57.339127 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:57.340003 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:57.340563 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:57.341629 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:57.341829 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:57.341901 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:57.343112 (+ 1211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:57.343115 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:57.343117 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:14:57.343130 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:57.343147 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:14:57.343155 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:57.343214 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:57.343399 (+ 185us) server_negotiation.cc:299] Negotiation successful
0923 17:14:57.343478 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260923 17:14:57.344616 21646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:57.336719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:43943 (local address 127.11.229.129:48137)
0923 17:14:57.337438 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:57.337479 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:57.338799 (+ 1320us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:57.339285 (+ 486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:57.339291 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:57.339389 (+ 98us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:57.339873 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:57.339885 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:57.340667 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:57.340669 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:57.341527 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:57.341536 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:57.341949 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:57.341952 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:57.342163 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:57.342831 (+ 668us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 17:14:57.342834 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:57.342885 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 17:14:57.342966 (+ 81us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:57.343243 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:57.343251 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:57.343257 (+ 6us) client_negotiation.cc:769] Sending connection context
0923 17:14:57.343402 (+ 145us) client_negotiation.cc:240] Negotiation successful
0923 17:14:57.343670 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":121,"threads_started":1}
I20260923 17:14:57.345306 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.130:0
--local_ip_for_outbound_sockets=127.11.229.130
--webserver_interface=127.11.229.130
--webserver_port=0
--tserver_master_addrs=127.11.229.190:43943
--builtin_ntp_servers=127.11.229.148:40683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260923 17:14:57.345863 21644 heartbeater.cc:347] Connected to a master server at 127.11.229.190:43943
I20260923 17:14:57.346123 21644 heartbeater.cc:464] Registering TS with master...
I20260923 17:14:57.346817 21644 heartbeater.cc:511] Master 127.11.229.190:43943 requested a full tablet report, sending...
I20260923 17:14:57.348510 21453 ts_manager.cc:194] Registered new tserver with Master: 819cc9dca43e4e83af95aad16b68e270 (127.11.229.129:39243)
I20260923 17:14:57.350194 21453 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.229.129:48137
W20260923 17:14:57.453560 21647 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:57.453800 21647 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:57.453835 21647 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:57.457683 21647 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:57.457727 21647 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:57.457777 21647 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.130
I20260923 17:14:57.462211 21647 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:40683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.229.130
--webserver_port=0
--tserver_master_addrs=127.11.229.190:43943
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21647
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.130
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:57.463146 21647 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:57.464522 21647 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:57.473556 21652 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:57.473618 21653 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:57.473618 21655 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:57.473848 21647 server_base.cc:1034] running on GCE node
I20260923 17:14:57.474211 21647 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:57.474927 21647 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:57.476099 21647 hybrid_clock.cc:648] HybridClock initialized: now 1790183697476061 us; error 51 us; skew 500 ppm
I20260923 17:14:57.477914 21647 webserver.cc:460] Webserver started at http://127.11.229.130:37465/ using document root <none> and password file <none>
I20260923 17:14:57.478541 21647 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:57.478629 21647 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:57.478853 21647 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:57.480844 21647 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/data/instance:
uuid: "bc34bbc6cb9644b09c32b15573523fc1"
format_stamp: "Formatted at 2026-09-23 17:14:57 on dist-test-slave-1x1f"
server_key: "1e5aa1a3ebbde4e193347e55627b872d"
server_key_iv: "ff95faf0ed8f73f4092314ebed475ae4"
server_key_version: "encryptionkey@0"
I20260923 17:14:57.481406 21647 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance:
uuid: "bc34bbc6cb9644b09c32b15573523fc1"
format_stamp: "Formatted at 2026-09-23 17:14:57 on dist-test-slave-1x1f"
server_key: "1e5aa1a3ebbde4e193347e55627b872d"
server_key_iv: "ff95faf0ed8f73f4092314ebed475ae4"
server_key_version: "encryptionkey@0"
I20260923 17:14:57.484989 21647 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.004s
I20260923 17:14:57.487764 21661 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:57.489159 21647 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260923 17:14:57.489341 21647 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/wal
uuid: "bc34bbc6cb9644b09c32b15573523fc1"
format_stamp: "Formatted at 2026-09-23 17:14:57 on dist-test-slave-1x1f"
server_key: "1e5aa1a3ebbde4e193347e55627b872d"
server_key_iv: "ff95faf0ed8f73f4092314ebed475ae4"
server_key_version: "encryptionkey@0"
I20260923 17:14:57.489457 21647 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:57.502156 21647 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:57.502857 21647 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:57.503054 21647 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:57.503615 21647 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:14:57.504504 21647 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:14:57.504576 21647 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:57.504647 21647 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:14:57.504690 21647 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:57.513182 21647 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.130:45111
I20260923 17:14:57.513206 21774 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.130:45111 every 8 connection(s)
I20260923 17:14:57.514120 21647 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
I20260923 17:14:57.522083 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 21647
I20260923 17:14:57.522193 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance
I20260923 17:14:57.522583 12182 external_mini_cluster.cc:1428] Setting key 34708b89c197cecbb91e547f4851ad07
I20260923 17:14:57.523499 21495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:57.515998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:50055 (local address 127.11.229.190:43943)
0923 17:14:57.516132 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:57.516136 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:57.517263 (+ 1127us) server_negotiation.cc:407] Connection header received
0923 17:14:57.518710 (+ 1447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:57.518714 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:57.518764 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:57.518849 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:57.519737 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:57.520273 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:57.521387 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:57.521600 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:57.521681 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:57.522984 (+ 1303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:57.522990 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:57.522992 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:14:57.523009 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:57.523039 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:14:57.523048 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:57.523114 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:57.523301 (+ 187us) server_negotiation.cc:299] Negotiation successful
0923 17:14:57.523362 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260923 17:14:57.524539 21777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:57.516408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:43943 (local address 127.11.229.130:50055)
0923 17:14:57.517056 (+ 648us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:57.517096 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:57.518450 (+ 1354us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:57.519015 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:57.519022 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:57.519107 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:57.519599 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:57.519611 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:57.520388 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:57.520390 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:57.521274 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:57.521283 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:57.521742 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:57.521744 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:57.521909 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:57.522696 (+ 787us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 17:14:57.522700 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:57.522750 (+ 50us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 17:14:57.522829 (+ 79us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:57.523137 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:57.523145 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:57.523151 (+ 6us) client_negotiation.cc:769] Sending connection context
0923 17:14:57.523280 (+ 129us) client_negotiation.cc:240] Negotiation successful
0923 17:14:57.523572 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":110,"threads_started":1}
I20260923 17:14:57.524703 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.131:0
--local_ip_for_outbound_sockets=127.11.229.131
--webserver_interface=127.11.229.131
--webserver_port=0
--tserver_master_addrs=127.11.229.190:43943
--builtin_ntp_servers=127.11.229.148:40683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260923 17:14:57.525743 21775 heartbeater.cc:347] Connected to a master server at 127.11.229.190:43943
I20260923 17:14:57.526002 21775 heartbeater.cc:464] Registering TS with master...
I20260923 17:14:57.526779 21775 heartbeater.cc:511] Master 127.11.229.190:43943 requested a full tablet report, sending...
I20260923 17:14:57.528155 21453 ts_manager.cc:194] Registered new tserver with Master: bc34bbc6cb9644b09c32b15573523fc1 (127.11.229.130:45111)
I20260923 17:14:57.529042 21453 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.229.130:50055
W20260923 17:14:57.638494 21778 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:57.638739 21778 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:57.638777 21778 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:57.642850 21778 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:57.642908 21778 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:57.642961 21778 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.131
I20260923 17:14:57.647831 21778 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:40683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.229.131
--webserver_port=0
--tserver_master_addrs=127.11.229.190:43943
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21778
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.131
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:57.648833 21778 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:57.650151 21778 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:57.659544 21783 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:57.659515 21786 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:57.659529 21784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:57.659720 21778 server_base.cc:1034] running on GCE node
I20260923 17:14:57.660236 21778 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:57.660820 21778 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:57.661975 21778 hybrid_clock.cc:648] HybridClock initialized: now 1790183697661944 us; error 43 us; skew 500 ppm
I20260923 17:14:57.663914 21778 webserver.cc:460] Webserver started at http://127.11.229.131:33839/ using document root <none> and password file <none>
I20260923 17:14:57.664461 21778 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:57.664520 21778 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:57.664760 21778 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:57.666790 21778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/data/instance:
uuid: "34fd06e586d84a078c8bed311f025954"
format_stamp: "Formatted at 2026-09-23 17:14:57 on dist-test-slave-1x1f"
server_key: "11466ef706f98fe6471b748200b4b78e"
server_key_iv: "38aacc1eb2ade658e2d4473ce5de8d77"
server_key_version: "encryptionkey@0"
I20260923 17:14:57.667335 21778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance:
uuid: "34fd06e586d84a078c8bed311f025954"
format_stamp: "Formatted at 2026-09-23 17:14:57 on dist-test-slave-1x1f"
server_key: "11466ef706f98fe6471b748200b4b78e"
server_key_iv: "38aacc1eb2ade658e2d4473ce5de8d77"
server_key_version: "encryptionkey@0"
I20260923 17:14:57.670976 21778 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260923 17:14:57.673444 21792 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:57.674692 21778 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 17:14:57.674816 21778 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/wal
uuid: "34fd06e586d84a078c8bed311f025954"
format_stamp: "Formatted at 2026-09-23 17:14:57 on dist-test-slave-1x1f"
server_key: "11466ef706f98fe6471b748200b4b78e"
server_key_iv: "38aacc1eb2ade658e2d4473ce5de8d77"
server_key_version: "encryptionkey@0"
I20260923 17:14:57.674926 21778 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:57.695830 21778 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:57.696519 21778 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:57.696722 21778 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:57.697290 21778 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:14:57.698187 21778 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:14:57.698287 21778 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:57.698374 21778 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:14:57.698428 21778 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:57.707134 21778 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.131:40785
I20260923 17:14:57.707159 21905 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.131:40785 every 8 connection(s)
I20260923 17:14:57.708002 21778 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
I20260923 17:14:57.711913 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 21778
I20260923 17:14:57.712034 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance
I20260923 17:14:57.712352 12182 external_mini_cluster.cc:1428] Setting key 3b6c44dd2cd3a5cc6d315ea82a9e9da4
I20260923 17:14:57.717535 21495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:57.709779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:39799 (local address 127.11.229.190:43943)
0923 17:14:57.709930 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:57.709933 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:57.710952 (+ 1019us) server_negotiation.cc:407] Connection header received
0923 17:14:57.712406 (+ 1454us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:57.712409 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:57.712469 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:57.712597 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:57.713625 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:57.714445 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:57.715654 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:57.715884 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:57.715984 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:57.717040 (+ 1056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:57.717043 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:57.717045 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:14:57.717056 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:57.717073 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:14:57.717080 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:57.717150 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:57.717355 (+ 205us) server_negotiation.cc:299] Negotiation successful
0923 17:14:57.717413 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260923 17:14:57.718351 21908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:57.710106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:43943 (local address 127.11.229.131:39799)
0923 17:14:57.710794 (+ 688us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:57.710839 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:57.712170 (+ 1331us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:57.712760 (+ 590us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:57.712767 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:57.712888 (+ 121us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:57.713482 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:57.713496 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:57.714592 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:57.714594 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:57.715476 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:14:57.715486 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:14:57.716036 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:14:57.716039 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:14:57.716177 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:57.716790 (+ 613us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 17:14:57.716791 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:57.716837 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 17:14:57.716900 (+ 63us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:57.717157 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:57.717163 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:57.717168 (+ 5us) client_negotiation.cc:769] Sending connection context
0923 17:14:57.717263 (+ 95us) client_negotiation.cc:240] Negotiation successful
0923 17:14:57.717484 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":323,"thread_start_us":178,"threads_started":1}
I20260923 17:14:57.719435 21906 heartbeater.cc:347] Connected to a master server at 127.11.229.190:43943
I20260923 17:14:57.719625 21906 heartbeater.cc:464] Registering TS with master...
I20260923 17:14:57.720063 21906 heartbeater.cc:511] Master 127.11.229.190:43943 requested a full tablet report, sending...
I20260923 17:14:57.721072 21453 ts_manager.cc:194] Registered new tserver with Master: 34fd06e586d84a078c8bed311f025954 (127.11.229.131:40785)
I20260923 17:14:57.721676 21453 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.229.131:39799
I20260923 17:14:57.726012 12182 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260923 17:14:57.728767 21495 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:57.727902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55660 (local address 127.11.229.190:43943)
0923 17:14:57.728017 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:57.728021 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:57.728190 (+ 169us) server_negotiation.cc:407] Connection header received
0923 17:14:57.728294 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:57.728296 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:57.728335 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:57.728400 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:57.728655 (+ 255us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55660: BlockingRecv error: recv got EOF from 127.0.0.1:55660 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
I20260923 17:14:57.729208 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 21516
I20260923 17:14:57.734900 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 21647
I20260923 17:14:57.740129 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 21778
I20260923 17:14:57.745693 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 21425
2026-09-23T17:14:57Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (882 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-09-23T17:14:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:14:57Z Disabled control of system clock
I20260923 17:14:57.775631 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:42611
--webserver_interface=127.11.229.190
--webserver_port=0
--builtin_ntp_servers=127.11.229.148:44875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:42611
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260923 17:14:57.887356 21917 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:57.887635 21917 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:57.887672 21917 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:57.891851 21917 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:14:57.891911 21917 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:57.891927 21917 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:57.891943 21917 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:14:57.891958 21917 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:14:57.896674 21917 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:44875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:42611
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:42611
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.229.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21917
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:57.897722 21917 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:57.899132 21917 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260923 17:14:57.907954 21917 server_base.cc:1034] running on GCE node
W20260923 17:14:57.907974 21922 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:57.907927 21925 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:57.908128 21923 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:57.908679 21917 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:57.909677 21917 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:57.910856 21917 hybrid_clock.cc:648] HybridClock initialized: now 1790183697910828 us; error 47 us; skew 500 ppm
I20260923 17:14:57.912664 21917 webserver.cc:460] Webserver started at http://127.11.229.190:38083/ using document root <none> and password file <none>
I20260923 17:14:57.913244 21917 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:57.913335 21917 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:57.913559 21917 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:57.915603 21917 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "17a72f0e8ba14b77b6cc53268fba838e"
format_stamp: "Formatted at 2026-09-23 17:14:57 on dist-test-slave-1x1f"
server_key: "d8c6e6265d4c623116a60c3790eb5c4f"
server_key_iv: "9a2da250fc798c082c9596039a02be13"
server_key_version: "encryptionkey@0"
I20260923 17:14:57.916154 21917 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "17a72f0e8ba14b77b6cc53268fba838e"
format_stamp: "Formatted at 2026-09-23 17:14:57 on dist-test-slave-1x1f"
server_key: "d8c6e6265d4c623116a60c3790eb5c4f"
server_key_iv: "9a2da250fc798c082c9596039a02be13"
server_key_version: "encryptionkey@0"
I20260923 17:14:57.919693 21917 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260923 17:14:57.922075 21931 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:57.923436 21917 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260923 17:14:57.923575 21917 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "17a72f0e8ba14b77b6cc53268fba838e"
format_stamp: "Formatted at 2026-09-23 17:14:57 on dist-test-slave-1x1f"
server_key: "d8c6e6265d4c623116a60c3790eb5c4f"
server_key_iv: "9a2da250fc798c082c9596039a02be13"
server_key_version: "encryptionkey@0"
I20260923 17:14:57.923689 21917 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:57.928267 21917 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:57.928841 21917 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:57.929023 21917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:57.935655 21917 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.190:42611
I20260923 17:14:57.935671 21983 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.190:42611 every 8 connection(s)
I20260923 17:14:57.936595 21917 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:14:57.939823 21984 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:57.941102 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 21917
I20260923 17:14:57.941219 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:14:57.941550 12182 external_mini_cluster.cc:1428] Setting key f2eccc0c7766481b3c8c261dbac17665
I20260923 17:14:57.945914 21984 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17a72f0e8ba14b77b6cc53268fba838e: Bootstrap starting.
I20260923 17:14:57.946944 21987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:57.942984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41152 (local address 127.11.229.190:42611)
0923 17:14:57.943588 (+ 604us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:57.943601 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:57.943634 (+ 33us) server_negotiation.cc:407] Connection header received
0923 17:14:57.944261 (+ 627us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:57.944277 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:57.944598 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:57.944932 (+ 334us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:57.945700 (+ 768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:57.945704 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:57.945716 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:14:57.945726 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:57.945784 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:14:57.945799 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:57.945944 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:57.946014 (+ 70us) server_negotiation.cc:299] Negotiation successful
0923 17:14:57.946289 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":276,"thread_start_us":123,"threads_started":1}
I20260923 17:14:57.948290 21984 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 17a72f0e8ba14b77b6cc53268fba838e: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:57.949095 21984 log.cc:824] T 00000000000000000000000000000000 P 17a72f0e8ba14b77b6cc53268fba838e: Log is configured to *not* fsync() on all Append() calls
I20260923 17:14:57.951007 21984 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17a72f0e8ba14b77b6cc53268fba838e: No bootstrap required, opened a new log
I20260923 17:14:57.954293 21984 raft_consensus.cc:348] T 00000000000000000000000000000000 P 17a72f0e8ba14b77b6cc53268fba838e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17a72f0e8ba14b77b6cc53268fba838e" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 42611 } }
I20260923 17:14:57.954516 21984 raft_consensus.cc:374] T 00000000000000000000000000000000 P 17a72f0e8ba14b77b6cc53268fba838e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:57.954550 21984 raft_consensus.cc:729] T 00000000000000000000000000000000 P 17a72f0e8ba14b77b6cc53268fba838e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17a72f0e8ba14b77b6cc53268fba838e, State: Initialized, Role: FOLLOWER
I20260923 17:14:57.954905 21984 consensus_queue.cc:260] T 00000000000000000000000000000000 P 17a72f0e8ba14b77b6cc53268fba838e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17a72f0e8ba14b77b6cc53268fba838e" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 42611 } }
I20260923 17:14:57.955009 21984 raft_consensus.cc:388] T 00000000000000000000000000000000 P 17a72f0e8ba14b77b6cc53268fba838e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:14:57.955047 21984 raft_consensus.cc:482] T 00000000000000000000000000000000 P 17a72f0e8ba14b77b6cc53268fba838e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:14:57.955113 21984 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 17a72f0e8ba14b77b6cc53268fba838e [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:57.955911 21984 raft_consensus.cc:504] T 00000000000000000000000000000000 P 17a72f0e8ba14b77b6cc53268fba838e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17a72f0e8ba14b77b6cc53268fba838e" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 42611 } }
I20260923 17:14:57.956229 21984 leader_election.cc:302] T 00000000000000000000000000000000 P 17a72f0e8ba14b77b6cc53268fba838e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 17a72f0e8ba14b77b6cc53268fba838e; no voters:
I20260923 17:14:57.956472 21984 leader_election.cc:288] T 00000000000000000000000000000000 P 17a72f0e8ba14b77b6cc53268fba838e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 17:14:57.956674 21989 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 17a72f0e8ba14b77b6cc53268fba838e [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:14:57.956947 21989 raft_consensus.cc:686] T 00000000000000000000000000000000 P 17a72f0e8ba14b77b6cc53268fba838e [term 1 LEADER]: Becoming Leader. State: Replica: 17a72f0e8ba14b77b6cc53268fba838e, State: Running, Role: LEADER
I20260923 17:14:57.957281 21989 consensus_queue.cc:237] T 00000000000000000000000000000000 P 17a72f0e8ba14b77b6cc53268fba838e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17a72f0e8ba14b77b6cc53268fba838e" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 42611 } }
I20260923 17:14:57.957764 21984 sys_catalog.cc:564] T 00000000000000000000000000000000 P 17a72f0e8ba14b77b6cc53268fba838e [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:14:57.959059 21990 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17a72f0e8ba14b77b6cc53268fba838e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "17a72f0e8ba14b77b6cc53268fba838e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17a72f0e8ba14b77b6cc53268fba838e" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 42611 } } }
I20260923 17:14:57.959055 21991 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17a72f0e8ba14b77b6cc53268fba838e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 17a72f0e8ba14b77b6cc53268fba838e. Latest consensus state: current_term: 1 leader_uuid: "17a72f0e8ba14b77b6cc53268fba838e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17a72f0e8ba14b77b6cc53268fba838e" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 42611 } } }
I20260923 17:14:57.959182 21990 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17a72f0e8ba14b77b6cc53268fba838e [sys.catalog]: This master's current role is: LEADER
I20260923 17:14:57.959195 21991 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17a72f0e8ba14b77b6cc53268fba838e [sys.catalog]: This master's current role is: LEADER
I20260923 17:14:57.959569 21998 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:14:57.962065 21998 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:14:57.967320 21998 catalog_manager.cc:1347] Generated new cluster ID: 75fbd5aefe344c22aa6333d544a17a31
I20260923 17:14:57.967389 21998 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:14:57.980674 21998 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:14:57.980999 21998 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:14:57.996322 21998 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 17a72f0e8ba14b77b6cc53268fba838e: Generated new TSK 0
I20260923 17:14:57.997264 21998 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 17:14:58.008345 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.129:0
--local_ip_for_outbound_sockets=127.11.229.129
--webserver_interface=127.11.229.129
--webserver_port=0
--tserver_master_addrs=127.11.229.190:42611
--builtin_ntp_servers=127.11.229.148:44875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260923 17:14:58.118434 22008 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:58.118739 22008 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:58.118822 22008 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:58.123461 22008 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:58.123541 22008 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:58.123638 22008 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.129
I20260923 17:14:58.128551 22008 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:44875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.229.129
--webserver_port=0
--tserver_master_addrs=127.11.229.190:42611
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22008
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.129
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:58.129642 22008 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:58.131024 22008 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:58.140352 22013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:58.140463 22014 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:58.140511 22016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:58.140726 22008 server_base.cc:1034] running on GCE node
I20260923 17:14:58.141209 22008 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:58.141866 22008 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:58.143047 22008 hybrid_clock.cc:648] HybridClock initialized: now 1790183698143014 us; error 46 us; skew 500 ppm
I20260923 17:14:58.144903 22008 webserver.cc:460] Webserver started at http://127.11.229.129:39255/ using document root <none> and password file <none>
I20260923 17:14:58.145457 22008 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:58.145546 22008 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:58.145781 22008 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:58.147835 22008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-0/data/instance:
uuid: "a2be4d67d2ef47af8b37b965d96e81f6"
format_stamp: "Formatted at 2026-09-23 17:14:58 on dist-test-slave-1x1f"
server_key: "eebd5da7880c2b9f7aa5552a9d0cffaa"
server_key_iv: "d2e59eaba176a8963cace07ef8140421"
server_key_version: "encryptionkey@0"
I20260923 17:14:58.148398 22008 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance:
uuid: "a2be4d67d2ef47af8b37b965d96e81f6"
format_stamp: "Formatted at 2026-09-23 17:14:58 on dist-test-slave-1x1f"
server_key: "eebd5da7880c2b9f7aa5552a9d0cffaa"
server_key_iv: "d2e59eaba176a8963cace07ef8140421"
server_key_version: "encryptionkey@0"
I20260923 17:14:58.152046 22008 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260923 17:14:58.154520 22022 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:58.155731 22008 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260923 17:14:58.155861 22008 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-0/wal
uuid: "a2be4d67d2ef47af8b37b965d96e81f6"
format_stamp: "Formatted at 2026-09-23 17:14:58 on dist-test-slave-1x1f"
server_key: "eebd5da7880c2b9f7aa5552a9d0cffaa"
server_key_iv: "d2e59eaba176a8963cace07ef8140421"
server_key_version: "encryptionkey@0"
I20260923 17:14:58.155973 22008 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:58.160578 22008 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:58.161157 22008 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:58.161339 22008 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:58.161862 22008 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:14:58.162783 22008 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:14:58.162853 22008 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:58.162919 22008 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:14:58.162968 22008 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:58.172012 22008 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.129:36747
I20260923 17:14:58.172034 22135 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.129:36747 every 8 connection(s)
I20260923 17:14:58.172901 22008 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
I20260923 17:14:58.174546 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 22008
I20260923 17:14:58.174660 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance
I20260923 17:14:58.174964 12182 external_mini_cluster.cc:1428] Setting key c497778da22601b5508f7f00b726d580
I20260923 17:14:58.176862 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.130:0
--local_ip_for_outbound_sockets=127.11.229.130
--webserver_interface=127.11.229.130
--webserver_port=0
--tserver_master_addrs=127.11.229.190:42611
--builtin_ntp_servers=127.11.229.148:44875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260923 17:14:58.179451 21987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:58.175368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:59009 (local address 127.11.229.190:42611)
0923 17:14:58.175510 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:58.175514 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:58.176284 (+ 770us) server_negotiation.cc:407] Connection header received
0923 17:14:58.177641 (+ 1357us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:58.177645 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:58.177684 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:58.177762 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:58.178897 (+ 1135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:58.178901 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:58.178903 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:14:58.178915 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:58.178936 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:14:58.178945 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:58.179060 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:58.179222 (+ 162us) server_negotiation.cc:299] Negotiation successful
0923 17:14:58.179268 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260923 17:14:58.180317 22138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:58.175161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:42611 (local address 127.11.229.129:59009)
0923 17:14:58.176121 (+ 960us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:58.176178 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:58.177436 (+ 1258us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:58.177918 (+ 482us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:58.177925 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:58.178010 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:58.178638 (+ 628us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 17:14:58.178639 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:58.178679 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 17:14:58.178742 (+ 63us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:58.179069 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:58.179076 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:58.179081 (+ 5us) client_negotiation.cc:769] Sending connection context
0923 17:14:58.179280 (+ 199us) client_negotiation.cc:240] Negotiation successful
0923 17:14:58.179467 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":516,"thread_start_us":138,"threads_started":1}
I20260923 17:14:58.181849 22136 heartbeater.cc:347] Connected to a master server at 127.11.229.190:42611
I20260923 17:14:58.182089 22136 heartbeater.cc:464] Registering TS with master...
I20260923 17:14:58.182605 22136 heartbeater.cc:511] Master 127.11.229.190:42611 requested a full tablet report, sending...
I20260923 17:14:58.184273 21948 ts_manager.cc:194] Registered new tserver with Master: a2be4d67d2ef47af8b37b965d96e81f6 (127.11.229.129:36747)
W20260923 17:14:58.288035 22139 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:58.288302 22139 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:58.288342 22139 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:58.292378 22139 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:58.292426 22139 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:58.292481 22139 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.130
I20260923 17:14:58.297127 22139 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:44875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.229.130
--webserver_port=0
--tserver_master_addrs=127.11.229.190:42611
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22139
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.130
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:58.298168 22139 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:58.299533 22139 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260923 17:14:58.309302 22139 server_base.cc:1034] running on GCE node
W20260923 17:14:58.309228 22147 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:58.309228 22145 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:58.309226 22144 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:58.309950 22139 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:58.310679 22139 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:58.311846 22139 hybrid_clock.cc:648] HybridClock initialized: now 1790183698311834 us; error 27 us; skew 500 ppm
I20260923 17:14:58.313783 22139 webserver.cc:460] Webserver started at http://127.11.229.130:37233/ using document root <none> and password file <none>
I20260923 17:14:58.314452 22139 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:58.314520 22139 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:58.314787 22139 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:58.316847 22139 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/data/instance:
uuid: "d45226ff326a4d528282736292ed040e"
format_stamp: "Formatted at 2026-09-23 17:14:58 on dist-test-slave-1x1f"
server_key: "fd63e681155142ab95f6dc857db1163c"
server_key_iv: "19ffbc274636ade20b6c449176fbfebc"
server_key_version: "encryptionkey@0"
I20260923 17:14:58.317407 22139 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance:
uuid: "d45226ff326a4d528282736292ed040e"
format_stamp: "Formatted at 2026-09-23 17:14:58 on dist-test-slave-1x1f"
server_key: "fd63e681155142ab95f6dc857db1163c"
server_key_iv: "19ffbc274636ade20b6c449176fbfebc"
server_key_version: "encryptionkey@0"
I20260923 17:14:58.321080 22139 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.002s
I20260923 17:14:58.323760 22153 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:58.325160 22139 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260923 17:14:58.325309 22139 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/wal
uuid: "d45226ff326a4d528282736292ed040e"
format_stamp: "Formatted at 2026-09-23 17:14:58 on dist-test-slave-1x1f"
server_key: "fd63e681155142ab95f6dc857db1163c"
server_key_iv: "19ffbc274636ade20b6c449176fbfebc"
server_key_version: "encryptionkey@0"
I20260923 17:14:58.325434 22139 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:58.330685 22139 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:58.331382 22139 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:58.331596 22139 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:58.332201 22139 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:14:58.333189 22139 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:14:58.333237 22139 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:58.333320 22139 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:14:58.333359 22139 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:58.343415 22139 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.130:33067
I20260923 17:14:58.343436 22266 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.130:33067 every 8 connection(s)
I20260923 17:14:58.344334 22139 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
I20260923 17:14:58.350466 21987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:58.346126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:48837 (local address 127.11.229.190:42611)
0923 17:14:58.346326 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:58.346330 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:58.347449 (+ 1119us) server_negotiation.cc:407] Connection header received
0923 17:14:58.348695 (+ 1246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:58.348698 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:58.348736 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:58.348817 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:58.349962 (+ 1145us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:58.349965 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:58.349968 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:14:58.349979 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:58.349998 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:14:58.350007 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:58.350087 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:58.350216 (+ 129us) server_negotiation.cc:299] Negotiation successful
0923 17:14:58.350356 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260923 17:14:58.351365 22269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:58.346640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:42611 (local address 127.11.229.130:48837)
0923 17:14:58.347302 (+ 662us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:58.347341 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:58.348499 (+ 1158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:58.348985 (+ 486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:58.348991 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:58.349075 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:58.349685 (+ 610us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 17:14:58.349687 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:58.349728 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 17:14:58.349805 (+ 77us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:58.350092 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:58.350098 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:58.350103 (+ 5us) client_negotiation.cc:769] Sending connection context
0923 17:14:58.350321 (+ 218us) client_negotiation.cc:240] Negotiation successful
0923 17:14:58.350550 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":115,"threads_started":1}
I20260923 17:14:58.352634 22267 heartbeater.cc:347] Connected to a master server at 127.11.229.190:42611
I20260923 17:14:58.352872 22267 heartbeater.cc:464] Registering TS with master...
I20260923 17:14:58.353262 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 22139
I20260923 17:14:58.353312 22267 heartbeater.cc:511] Master 127.11.229.190:42611 requested a full tablet report, sending...
I20260923 17:14:58.353398 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance
I20260923 17:14:58.353677 12182 external_mini_cluster.cc:1428] Setting key d749ccab3f7b6881bfdcf6af579b3c16
I20260923 17:14:58.354514 21948 ts_manager.cc:194] Registered new tserver with Master: d45226ff326a4d528282736292ed040e (127.11.229.130:33067)
I20260923 17:14:58.355836 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.131:0
--local_ip_for_outbound_sockets=127.11.229.131
--webserver_interface=127.11.229.131
--webserver_port=0
--tserver_master_addrs=127.11.229.190:42611
--builtin_ntp_servers=127.11.229.148:44875
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260923 17:14:58.464946 22270 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:58.465196 22270 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:58.465235 22270 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:58.469215 22270 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:58.469271 22270 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:58.469331 22270 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.131
I20260923 17:14:58.473954 22270 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:44875
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.229.131
--webserver_port=0
--tserver_master_addrs=127.11.229.190:42611
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22270
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.131
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:58.474992 22270 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:58.476284 22270 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:58.485683 22278 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:58.485692 22276 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:58.485694 22275 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:58.486066 22270 server_base.cc:1034] running on GCE node
I20260923 17:14:58.486501 22270 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:58.487210 22270 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:58.488418 22270 hybrid_clock.cc:648] HybridClock initialized: now 1790183698488403 us; error 24 us; skew 500 ppm
I20260923 17:14:58.490598 22270 webserver.cc:460] Webserver started at http://127.11.229.131:44907/ using document root <none> and password file <none>
I20260923 17:14:58.491240 22270 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:58.491339 22270 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:58.491581 22270 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:58.493717 22270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/data/instance:
uuid: "2f9ab8c4d3ff48b6bb73ffcc1320480a"
format_stamp: "Formatted at 2026-09-23 17:14:58 on dist-test-slave-1x1f"
server_key: "fdc1fe51f7cc042c7b14c3a80dc196be"
server_key_iv: "e464dc2275a3ea580f83891143a2c7d0"
server_key_version: "encryptionkey@0"
I20260923 17:14:58.494387 22270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance:
uuid: "2f9ab8c4d3ff48b6bb73ffcc1320480a"
format_stamp: "Formatted at 2026-09-23 17:14:58 on dist-test-slave-1x1f"
server_key: "fdc1fe51f7cc042c7b14c3a80dc196be"
server_key_iv: "e464dc2275a3ea580f83891143a2c7d0"
server_key_version: "encryptionkey@0"
I20260923 17:14:58.498421 22270 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260923 17:14:58.501003 22284 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:58.502372 22270 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 17:14:58.502506 22270 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/wal
uuid: "2f9ab8c4d3ff48b6bb73ffcc1320480a"
format_stamp: "Formatted at 2026-09-23 17:14:58 on dist-test-slave-1x1f"
server_key: "fdc1fe51f7cc042c7b14c3a80dc196be"
server_key_iv: "e464dc2275a3ea580f83891143a2c7d0"
server_key_version: "encryptionkey@0"
I20260923 17:14:58.502622 22270 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:58.507229 22270 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:58.507844 22270 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:58.508023 22270 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:58.508570 22270 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:14:58.509475 22270 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:14:58.509547 22270 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:58.509613 22270 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:14:58.509647 22270 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:58.519310 22270 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.131:37759
I20260923 17:14:58.519351 22397 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.131:37759 every 8 connection(s)
I20260923 17:14:58.520237 22270 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
I20260923 17:14:58.521881 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 22270
I20260923 17:14:58.521992 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance
I20260923 17:14:58.522329 12182 external_mini_cluster.cc:1428] Setting key d7ebd47bdde62e06513ee98227ebbc94
I20260923 17:14:58.526950 21987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:58.522189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:43877 (local address 127.11.229.190:42611)
0923 17:14:58.523694 (+ 1505us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:58.523699 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:58.523733 (+ 34us) server_negotiation.cc:407] Connection header received
0923 17:14:58.525181 (+ 1448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:58.525185 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:58.525223 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:58.525312 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:58.526509 (+ 1197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:58.526512 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:58.526515 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:14:58.526527 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:58.526546 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:14:58.526554 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:58.526650 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:58.526804 (+ 154us) server_negotiation.cc:299] Negotiation successful
0923 17:14:58.526844 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1421}
I20260923 17:14:58.527992 22400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:58.522686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:42611 (local address 127.11.229.131:43877)
0923 17:14:58.523627 (+ 941us) negotiation.cc:107] Waiting for socket to connect
0923 17:14:58.523667 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0923 17:14:58.524900 (+ 1233us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:14:58.525434 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:14:58.525440 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:14:58.525523 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:14:58.526049 (+ 526us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 17:14:58.526052 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:14:58.526147 (+ 95us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 17:14:58.526330 (+ 183us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:14:58.526645 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:14:58.526654 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:14:58.526660 (+ 6us) client_negotiation.cc:769] Sending connection context
0923 17:14:58.526816 (+ 156us) client_negotiation.cc:240] Negotiation successful
0923 17:14:58.527043 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":136,"threads_started":1}
I20260923 17:14:58.529274 22398 heartbeater.cc:347] Connected to a master server at 127.11.229.190:42611
I20260923 17:14:58.529520 22398 heartbeater.cc:464] Registering TS with master...
I20260923 17:14:58.530009 22398 heartbeater.cc:511] Master 127.11.229.190:42611 requested a full tablet report, sending...
I20260923 17:14:58.531165 21947 ts_manager.cc:194] Registered new tserver with Master: 2f9ab8c4d3ff48b6bb73ffcc1320480a (127.11.229.131:37759)
I20260923 17:14:58.536355 12182 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260923 17:14:58.539644 21987 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:14:58.538546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41168 (local address 127.11.229.190:42611)
0923 17:14:58.538683 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:58.538690 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:58.538875 (+ 185us) server_negotiation.cc:407] Connection header received
0923 17:14:58.539034 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:58.539039 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:58.539085 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:58.539179 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:58.539513 (+ 334us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41168: BlockingRecv error: recv got EOF from 127.0.0.1:41168 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
I20260923 17:14:58.539839 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 22008
I20260923 17:14:58.546315 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 22139
I20260923 17:14:58.552485 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 22270
I20260923 17:14:58.558611 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 21917
2026-09-23T17:14:58Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (813 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 17:14:58 dist-test-slave-1x1f krb5kdc[22408](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 17:14:58 dist-test-slave-1x1f krb5kdc[22408](info): set up 2 sockets
Sep 23 17:14:58 dist-test-slave-1x1f krb5kdc[22408](info): commencing operation
krb5kdc: starting...
W20260923 17:14:59.635617 12182 mini_kdc.cc:121] Time spent starting KDC: real 1.055s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Sep 23 17:14:59 dist-test-slave-1x1f krb5kdc[22408](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183699, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T17:14:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:14:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.229.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
I20260923 17:14:59.761402 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:40409
--webserver_interface=127.11.229.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:41409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:40409
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:14:59.867491 22421 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:14:59.867799 22421 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:14:59.867888 22421 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:14:59.871950 22421 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:14:59.872035 22421 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:14:59.872074 22421 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:14:59.872138 22421 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:14:59.872174 22421 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:14:59.877292 22421 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:41409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:40409
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:40409
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.229.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22421
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:14:59.878305 22421 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:14:59.879293 22421 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:14:59.888479 22426 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:59.888581 22429 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:14:59.888479 22427 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:14:59.888741 22421 server_base.cc:1034] running on GCE node
I20260923 17:14:59.889235 22421 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:14:59.890419 22421 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:14:59.891603 22421 hybrid_clock.cc:648] HybridClock initialized: now 1790183699891588 us; error 27 us; skew 500 ppm
Sep 23 17:14:59 dist-test-slave-1x1f krb5kdc[22408](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183699, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:14:59.900612 22421 init.cc:377] Logged in from keytab as kudu/127.11.229.190@KRBTEST.COM (short username kudu)
I20260923 17:14:59.901741 22421 webserver.cc:460] Webserver started at http://127.11.229.190:46735/ using document root <none> and password file <none>
I20260923 17:14:59.902424 22421 fs_manager.cc:359] Metadata directory not provided
I20260923 17:14:59.902530 22421 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:14:59.902757 22421 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:14:59.904917 22421 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "f90328a537484e7c92925a994b9dd7e4"
format_stamp: "Formatted at 2026-09-23 17:14:59 on dist-test-slave-1x1f"
server_key: "46932248001f59688af07426c036c435"
server_key_iv: "9bcda2b756acf1547f877098e7a00e5b"
server_key_version: "encryptionkey@0"
I20260923 17:14:59.905529 22421 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "f90328a537484e7c92925a994b9dd7e4"
format_stamp: "Formatted at 2026-09-23 17:14:59 on dist-test-slave-1x1f"
server_key: "46932248001f59688af07426c036c435"
server_key_iv: "9bcda2b756acf1547f877098e7a00e5b"
server_key_version: "encryptionkey@0"
I20260923 17:14:59.909456 22421 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260923 17:14:59.912019 22436 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:14:59.913359 22421 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 17:14:59.913511 22421 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "f90328a537484e7c92925a994b9dd7e4"
format_stamp: "Formatted at 2026-09-23 17:14:59 on dist-test-slave-1x1f"
server_key: "46932248001f59688af07426c036c435"
server_key_iv: "9bcda2b756acf1547f877098e7a00e5b"
server_key_version: "encryptionkey@0"
I20260923 17:14:59.913631 22421 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:14:59.931875 22421 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:14:59.935114 22421 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:14:59.935344 22421 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:14:59.942881 22421 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.190:40409
I20260923 17:14:59.943197 22488 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.190:40409 every 8 connection(s)
I20260923 17:14:59.943899 22421 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:14:59.946744 22489 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:14:59.947497 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 22421
I20260923 17:14:59.947628 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:14:59.947932 12182 external_mini_cluster.cc:1428] Setting key 6cb908622a357342a0da5e0cea1cee1f
I20260923 17:14:59.953415 22489 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f90328a537484e7c92925a994b9dd7e4: Bootstrap starting.
I20260923 17:14:59.956044 22489 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f90328a537484e7c92925a994b9dd7e4: Neither blocks nor log segments found. Creating new log.
I20260923 17:14:59.956799 22489 log.cc:824] T 00000000000000000000000000000000 P f90328a537484e7c92925a994b9dd7e4: Log is configured to *not* fsync() on all Append() calls
Sep 23 17:14:59 dist-test-slave-1x1f krb5kdc[22408](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183699, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:14:59.959016 22489 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f90328a537484e7c92925a994b9dd7e4: No bootstrap required, opened a new log
I20260923 17:14:59.962685 22492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:14:59.949525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49910 (local address 127.11.229.190:40409)
0923 17:14:59.949930 (+ 405us) server_negotiation.cc:206] Beginning negotiation
0923 17:14:59.949950 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0923 17:14:59.950010 (+ 60us) server_negotiation.cc:407] Connection header received
0923 17:14:59.950844 (+ 834us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:14:59.950866 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:14:59.951283 (+ 417us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:14:59.951650 (+ 367us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:14:59.952283 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:59.953710 (+ 1427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:59.954765 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:14:59.955428 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:14:59.955587 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:14:59.958097 (+ 2510us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:14:59.958103 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:14:59.958116 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:14:59.958142 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:14:59.959876 (+ 1734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:59.960304 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:59.960309 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:59.960315 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:59.960429 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:14:59.960737 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:14:59.960740 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:14:59.960742 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:14:59.961124 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:14:59.961330 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0923 17:14:59.961606 (+ 276us) server_negotiation.cc:299] Negotiation successful
0923 17:14:59.961895 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":259,"thread_start_us":97,"threads_started":1}
I20260923 17:14:59.962636 22489 raft_consensus.cc:348] T 00000000000000000000000000000000 P f90328a537484e7c92925a994b9dd7e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f90328a537484e7c92925a994b9dd7e4" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 40409 } }
I20260923 17:14:59.962891 22489 raft_consensus.cc:374] T 00000000000000000000000000000000 P f90328a537484e7c92925a994b9dd7e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:14:59.962954 22489 raft_consensus.cc:729] T 00000000000000000000000000000000 P f90328a537484e7c92925a994b9dd7e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f90328a537484e7c92925a994b9dd7e4, State: Initialized, Role: FOLLOWER
I20260923 17:14:59.963428 22489 consensus_queue.cc:260] T 00000000000000000000000000000000 P f90328a537484e7c92925a994b9dd7e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f90328a537484e7c92925a994b9dd7e4" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 40409 } }
I20260923 17:14:59.963547 22489 raft_consensus.cc:388] T 00000000000000000000000000000000 P f90328a537484e7c92925a994b9dd7e4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:14:59.963632 22489 raft_consensus.cc:482] T 00000000000000000000000000000000 P f90328a537484e7c92925a994b9dd7e4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:14:59.963739 22489 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f90328a537484e7c92925a994b9dd7e4 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:14:59.964648 22489 raft_consensus.cc:504] T 00000000000000000000000000000000 P f90328a537484e7c92925a994b9dd7e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f90328a537484e7c92925a994b9dd7e4" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 40409 } }
I20260923 17:14:59.965000 22489 leader_election.cc:302] T 00000000000000000000000000000000 P f90328a537484e7c92925a994b9dd7e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f90328a537484e7c92925a994b9dd7e4; no voters:
I20260923 17:14:59.965355 22489 leader_election.cc:288] T 00000000000000000000000000000000 P f90328a537484e7c92925a994b9dd7e4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 17:14:59.965435 22494 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f90328a537484e7c92925a994b9dd7e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:14:59.965629 22494 raft_consensus.cc:686] T 00000000000000000000000000000000 P f90328a537484e7c92925a994b9dd7e4 [term 1 LEADER]: Becoming Leader. State: Replica: f90328a537484e7c92925a994b9dd7e4, State: Running, Role: LEADER
I20260923 17:14:59.965920 22494 consensus_queue.cc:237] T 00000000000000000000000000000000 P f90328a537484e7c92925a994b9dd7e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f90328a537484e7c92925a994b9dd7e4" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 40409 } }
I20260923 17:14:59.966622 22489 sys_catalog.cc:564] T 00000000000000000000000000000000 P f90328a537484e7c92925a994b9dd7e4 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:14:59.967653 22496 sys_catalog.cc:455] T 00000000000000000000000000000000 P f90328a537484e7c92925a994b9dd7e4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f90328a537484e7c92925a994b9dd7e4. Latest consensus state: current_term: 1 leader_uuid: "f90328a537484e7c92925a994b9dd7e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f90328a537484e7c92925a994b9dd7e4" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 40409 } } }
I20260923 17:14:59.967705 22495 sys_catalog.cc:455] T 00000000000000000000000000000000 P f90328a537484e7c92925a994b9dd7e4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f90328a537484e7c92925a994b9dd7e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f90328a537484e7c92925a994b9dd7e4" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 40409 } } }
I20260923 17:14:59.967815 22496 sys_catalog.cc:458] T 00000000000000000000000000000000 P f90328a537484e7c92925a994b9dd7e4 [sys.catalog]: This master's current role is: LEADER
I20260923 17:14:59.967818 22495 sys_catalog.cc:458] T 00000000000000000000000000000000 P f90328a537484e7c92925a994b9dd7e4 [sys.catalog]: This master's current role is: LEADER
W20260923 17:14:59.971480 22510 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f90328a537484e7c92925a994b9dd7e4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 17:14:59.971575 22510 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 17:14:59.971642 22503 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:14:59.972292 22503 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:14:59.978019 22503 catalog_manager.cc:1347] Generated new cluster ID: 0268b81bca6e401282834bf90ee8ae0f
I20260923 17:14:59.978094 22503 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:14:59.985539 22503 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:14:59.986780 22503 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:14:59.999558 22503 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f90328a537484e7c92925a994b9dd7e4: Generated new TSK 0
I20260923 17:15:00.000458 22503 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.229.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab.
Entry for principal kudu/127.11.229.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab.
I20260923 17:15:00.034001 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.129:0
--local_ip_for_outbound_sockets=127.11.229.129
--webserver_interface=127.11.229.129
--webserver_port=0
--tserver_master_addrs=127.11.229.190:40409
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab
--principal=kudu/127.11.229.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:41409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:15:00.149326 22515 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:15:00.149636 22515 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:15:00.149708 22515 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:15:00.153817 22515 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:15:00.153913 22515 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:15:00.154002 22515 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.129
I20260923 17:15:00.159325 22515 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:41409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab
--principal=kudu/127.11.229.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.229.129
--webserver_port=0
--tserver_master_addrs=127.11.229.190:40409
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22515
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.129
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:15:00.160368 22515 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:15:00.161376 22515 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:15:00.171205 22521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:15:00.171176 22523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:15:00.171329 22515 server_base.cc:1034] running on GCE node
W20260923 17:15:00.171155 22520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:15:00.171877 22515 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:15:00.172576 22515 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:15:00.173799 22515 hybrid_clock.cc:648] HybridClock initialized: now 1790183700173786 us; error 25 us; skew 500 ppm
Sep 23 17:15:00 dist-test-slave-1x1f krb5kdc[22408](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183700, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:15:00.176620 22515 init.cc:377] Logged in from keytab as kudu/127.11.229.129@KRBTEST.COM (short username kudu)
I20260923 17:15:00.177418 22515 webserver.cc:460] Webserver started at http://127.11.229.129:41767/ using document root <none> and password file <none>
I20260923 17:15:00.177932 22515 fs_manager.cc:359] Metadata directory not provided
I20260923 17:15:00.177989 22515 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:15:00.178151 22515 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:15:00.180212 22515 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-0/data/instance:
uuid: "80341444e10a4e53878fab8b34e6988d"
format_stamp: "Formatted at 2026-09-23 17:15:00 on dist-test-slave-1x1f"
server_key: "e63c68a8577cbe03c7744aa99f3ed43e"
server_key_iv: "8f1af666b882bd2f1af41f815624e718"
server_key_version: "encryptionkey@0"
I20260923 17:15:00.180707 22515 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance:
uuid: "80341444e10a4e53878fab8b34e6988d"
format_stamp: "Formatted at 2026-09-23 17:15:00 on dist-test-slave-1x1f"
server_key: "e63c68a8577cbe03c7744aa99f3ed43e"
server_key_iv: "8f1af666b882bd2f1af41f815624e718"
server_key_version: "encryptionkey@0"
I20260923 17:15:00.184286 22515 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260923 17:15:00.186810 22530 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:15:00.188151 22515 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 17:15:00.188277 22515 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-0/wal
uuid: "80341444e10a4e53878fab8b34e6988d"
format_stamp: "Formatted at 2026-09-23 17:15:00 on dist-test-slave-1x1f"
server_key: "e63c68a8577cbe03c7744aa99f3ed43e"
server_key_iv: "8f1af666b882bd2f1af41f815624e718"
server_key_version: "encryptionkey@0"
I20260923 17:15:00.188381 22515 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:15:00.220800 22515 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:15:00.223814 22515 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:15:00.224012 22515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:15:00.224634 22515 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:15:00.225466 22515 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:15:00.225514 22515 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:15:00.225553 22515 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:15:00.225601 22515 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:15:00.235483 22515 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.129:35415
I20260923 17:15:00.235510 22643 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.129:35415 every 8 connection(s)
I20260923 17:15:00.236407 22515 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
I20260923 17:15:00.241082 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 22515
I20260923 17:15:00.241174 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance
I20260923 17:15:00.241458 12182 external_mini_cluster.cc:1428] Setting key cc1642827d569429ed5e6083b514fe14
Sep 23 17:15:00 dist-test-slave-1x1f krb5kdc[22408](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183700, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.129@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:15:00.250880 22492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:15:00.238143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:49931 (local address 127.11.229.190:40409)
0923 17:15:00.238300 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0923 17:15:00.238306 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 17:15:00.239130 (+ 824us) server_negotiation.cc:407] Connection header received
0923 17:15:00.240394 (+ 1264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:15:00.240397 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:15:00.240446 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:15:00.240522 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:15:00.241765 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:15:00.242611 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:15:00.243804 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:15:00.244050 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:15:00.244159 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:15:00.246771 (+ 2612us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:15:00.246778 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:15:00.246784 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:15:00.246818 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:15:00.248546 (+ 1728us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:15:00.249206 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:15:00.249208 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:15:00.249210 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:15:00.249283 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:15:00.249708 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:15:00.249711 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:15:00.249712 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:15:00.249885 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:15:00.249962 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0923 17:15:00.250639 (+ 677us) server_negotiation.cc:299] Negotiation successful
0923 17:15:00.250759 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
WARNING: no policy specified for kudu/127.11.229.130@KRBTEST.COM; defaulting to no policy
I20260923 17:15:00.252045 22646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:15:00.238557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:40409 (local address 127.11.229.129:49931)
0923 17:15:00.238981 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0923 17:15:00.239020 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0923 17:15:00.240197 (+ 1177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:15:00.240672 (+ 475us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:15:00.240678 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:15:00.241036 (+ 358us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:15:00.241619 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:15:00.241634 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:15:00.242761 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:15:00.242768 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:15:00.243670 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:15:00.243679 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:15:00.244193 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:15:00.244197 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:15:00.244369 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:15:00.244968 (+ 599us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:15:00.244984 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:15:00.246602 (+ 1618us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:15:00.248672 (+ 2070us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:15:00.248681 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:15:00.248702 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:15:00.249087 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:15:00.249377 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:15:00.249382 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:15:00.249386 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:15:00.249574 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:15:00.249997 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:15:00.250005 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:15:00.250382 (+ 377us) client_negotiation.cc:769] Sending connection context
0923 17:15:00.250603 (+ 221us) client_negotiation.cc:240] Negotiation successful
0923 17:15:00.250960 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":104,"threads_started":1}
I20260923 17:15:00.253328 22644 heartbeater.cc:347] Connected to a master server at 127.11.229.190:40409
I20260923 17:15:00.253695 22644 heartbeater.cc:464] Registering TS with master...
I20260923 17:15:00.254333 22644 heartbeater.cc:511] Master 127.11.229.190:40409 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.130@KRBTEST.COM" created.
I20260923 17:15:00.255959 22453 ts_manager.cc:194] Registered new tserver with Master: 80341444e10a4e53878fab8b34e6988d (127.11.229.129:35415)
I20260923 17:15:00.257071 22453 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.129@KRBTEST.COM'} at 127.11.229.129:49931
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab.
Entry for principal kudu/127.11.229.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab.
I20260923 17:15:00.273100 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.130:0
--local_ip_for_outbound_sockets=127.11.229.130
--webserver_interface=127.11.229.130
--webserver_port=0
--tserver_master_addrs=127.11.229.190:40409
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab
--principal=kudu/127.11.229.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:41409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:15:00.385270 22649 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:15:00.385546 22649 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:15:00.385623 22649 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:15:00.389664 22649 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:15:00.389750 22649 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:15:00.389837 22649 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.130
I20260923 17:15:00.395181 22649 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:41409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab
--principal=kudu/127.11.229.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.229.130
--webserver_port=0
--tserver_master_addrs=127.11.229.190:40409
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22649
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.130
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:15:00.396188 22649 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:15:00.397169 22649 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:15:00.406397 22655 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:15:00.406395 22657 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:15:00.406404 22654 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:15:00.406570 22649 server_base.cc:1034] running on GCE node
I20260923 17:15:00.407078 22649 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:15:00.407716 22649 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:15:00.408896 22649 hybrid_clock.cc:648] HybridClock initialized: now 1790183700408882 us; error 28 us; skew 500 ppm
Sep 23 17:15:00 dist-test-slave-1x1f krb5kdc[22408](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183700, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:15:00.411634 22649 init.cc:377] Logged in from keytab as kudu/127.11.229.130@KRBTEST.COM (short username kudu)
I20260923 17:15:00.412546 22649 webserver.cc:460] Webserver started at http://127.11.229.130:41687/ using document root <none> and password file <none>
I20260923 17:15:00.413089 22649 fs_manager.cc:359] Metadata directory not provided
I20260923 17:15:00.413182 22649 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:15:00.413395 22649 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:15:00.415406 22649 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/data/instance:
uuid: "5eec0234722a4eabaa8507c47c3df6e0"
format_stamp: "Formatted at 2026-09-23 17:15:00 on dist-test-slave-1x1f"
server_key: "4e6a94707a2acd1f3e2408620d32fd69"
server_key_iv: "3e351d4794a9c5050d831e5a346be290"
server_key_version: "encryptionkey@0"
I20260923 17:15:00.415935 22649 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance:
uuid: "5eec0234722a4eabaa8507c47c3df6e0"
format_stamp: "Formatted at 2026-09-23 17:15:00 on dist-test-slave-1x1f"
server_key: "4e6a94707a2acd1f3e2408620d32fd69"
server_key_iv: "3e351d4794a9c5050d831e5a346be290"
server_key_version: "encryptionkey@0"
I20260923 17:15:00.419656 22649 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s
I20260923 17:15:00.421911 22664 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:15:00.423254 22649 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 17:15:00.423401 22649 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/wal
uuid: "5eec0234722a4eabaa8507c47c3df6e0"
format_stamp: "Formatted at 2026-09-23 17:15:00 on dist-test-slave-1x1f"
server_key: "4e6a94707a2acd1f3e2408620d32fd69"
server_key_iv: "3e351d4794a9c5050d831e5a346be290"
server_key_version: "encryptionkey@0"
I20260923 17:15:00.423506 22649 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:15:00.443755 22649 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:15:00.446957 22649 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:15:00.447175 22649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:15:00.447760 22649 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:15:00.448580 22649 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:15:00.448645 22649 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:15:00.448709 22649 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:15:00.448750 22649 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:15:00.457681 22649 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.130:41875
I20260923 17:15:00.457731 22777 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.130:41875 every 8 connection(s)
I20260923 17:15:00.458629 22649 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
I20260923 17:15:00.459678 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 22649
I20260923 17:15:00.459805 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance
I20260923 17:15:00.460141 12182 external_mini_cluster.cc:1428] Setting key 6440be5a5000e735140e22482718d743
Sep 23 17:15:00 dist-test-slave-1x1f krb5kdc[22408](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183700, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.130@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.229.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.131@KRBTEST.COM" created.
I20260923 17:15:00.473313 22492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:15:00.460501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:59811 (local address 127.11.229.190:40409)
0923 17:15:00.460656 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0923 17:15:00.460661 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:15:00.461506 (+ 845us) server_negotiation.cc:407] Connection header received
0923 17:15:00.463004 (+ 1498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:15:00.463007 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:15:00.463060 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:15:00.463138 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:15:00.464724 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:15:00.465258 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:15:00.466453 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:15:00.466749 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:15:00.466856 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:15:00.469671 (+ 2815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:15:00.469675 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:15:00.469678 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:15:00.469705 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:15:00.471257 (+ 1552us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:15:00.471765 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:15:00.471770 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:15:00.471772 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:15:00.471855 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:15:00.472207 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:15:00.472210 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:15:00.472212 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:15:00.472396 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:15:00.472499 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0923 17:15:00.473030 (+ 531us) server_negotiation.cc:299] Negotiation successful
0923 17:15:00.473172 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260923 17:15:00.474488 22780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:15:00.460898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:40409 (local address 127.11.229.130:59811)
0923 17:15:00.461360 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0923 17:15:00.461411 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0923 17:15:00.462787 (+ 1376us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:15:00.463324 (+ 537us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:15:00.463335 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:15:00.463862 (+ 527us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:15:00.464564 (+ 702us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:15:00.464580 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:15:00.465387 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:15:00.465390 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:15:00.466336 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:15:00.466345 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:15:00.466894 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:15:00.466898 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:15:00.467118 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:15:00.467753 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:15:00.467771 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:15:00.469492 (+ 1721us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:15:00.471368 (+ 1876us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:15:00.471375 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:15:00.471390 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:15:00.471656 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:15:00.471955 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:15:00.471959 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:15:00.471960 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:15:00.472099 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:15:00.472497 (+ 398us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:15:00.472504 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:15:00.472761 (+ 257us) client_negotiation.cc:769] Sending connection context
0923 17:15:00.472963 (+ 202us) client_negotiation.cc:240] Negotiation successful
0923 17:15:00.473306 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":135,"threads_started":1}
I20260923 17:15:00.475669 22778 heartbeater.cc:347] Connected to a master server at 127.11.229.190:40409
I20260923 17:15:00.475932 22778 heartbeater.cc:464] Registering TS with master...
I20260923 17:15:00.476418 22778 heartbeater.cc:511] Master 127.11.229.190:40409 requested a full tablet report, sending...
I20260923 17:15:00.477427 22453 ts_manager.cc:194] Registered new tserver with Master: 5eec0234722a4eabaa8507c47c3df6e0 (127.11.229.130:41875)
I20260923 17:15:00.478022 22453 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.130@KRBTEST.COM'} at 127.11.229.130:59811
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab.
Entry for principal kudu/127.11.229.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab.
I20260923 17:15:00.493712 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.131:0
--local_ip_for_outbound_sockets=127.11.229.131
--webserver_interface=127.11.229.131
--webserver_port=0
--tserver_master_addrs=127.11.229.190:40409
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab
--principal=kudu/127.11.229.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:41409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:15:00.602865 22783 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:15:00.603107 22783 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:15:00.603150 22783 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:15:00.607184 22783 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:15:00.607244 22783 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:15:00.607352 22783 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.131
I20260923 17:15:00.612970 22783 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:41409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab
--principal=kudu/127.11.229.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.229.131
--webserver_port=0
--tserver_master_addrs=127.11.229.190:40409
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22783
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.131
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:15:00.613973 22783 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:15:00.614962 22783 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:15:00.624926 22789 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:15:00.624840 22788 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:15:00.624995 22783 server_base.cc:1034] running on GCE node
W20260923 17:15:00.624840 22791 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:15:00.625650 22783 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:15:00.626303 22783 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:15:00.627457 22783 hybrid_clock.cc:648] HybridClock initialized: now 1790183700627441 us; error 28 us; skew 500 ppm
Sep 23 17:15:00 dist-test-slave-1x1f krb5kdc[22408](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183700, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:15:00.630049 22783 init.cc:377] Logged in from keytab as kudu/127.11.229.131@KRBTEST.COM (short username kudu)
I20260923 17:15:00.630975 22783 webserver.cc:460] Webserver started at http://127.11.229.131:45935/ using document root <none> and password file <none>
I20260923 17:15:00.631539 22783 fs_manager.cc:359] Metadata directory not provided
I20260923 17:15:00.631600 22783 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:15:00.632043 22783 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:15:00.634135 22783 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/data/instance:
uuid: "1bd975730bf54322b06a70a173f0b433"
format_stamp: "Formatted at 2026-09-23 17:15:00 on dist-test-slave-1x1f"
server_key: "8f32ee591302e6919a8ddd1f63b20e65"
server_key_iv: "c7035aaa975eeccd040d36aa5fb38a3f"
server_key_version: "encryptionkey@0"
I20260923 17:15:00.634764 22783 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance:
uuid: "1bd975730bf54322b06a70a173f0b433"
format_stamp: "Formatted at 2026-09-23 17:15:00 on dist-test-slave-1x1f"
server_key: "8f32ee591302e6919a8ddd1f63b20e65"
server_key_iv: "c7035aaa975eeccd040d36aa5fb38a3f"
server_key_version: "encryptionkey@0"
I20260923 17:15:00.638600 22783 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260923 17:15:00.641054 22798 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:15:00.642308 22783 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 17:15:00.642424 22783 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/wal
uuid: "1bd975730bf54322b06a70a173f0b433"
format_stamp: "Formatted at 2026-09-23 17:15:00 on dist-test-slave-1x1f"
server_key: "8f32ee591302e6919a8ddd1f63b20e65"
server_key_iv: "c7035aaa975eeccd040d36aa5fb38a3f"
server_key_version: "encryptionkey@0"
I20260923 17:15:00.642529 22783 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:15:00.672030 22783 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:15:00.675037 22783 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:15:00.675262 22783 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:15:00.675871 22783 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:15:00.676707 22783 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:15:00.676756 22783 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:15:00.676827 22783 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:15:00.676865 22783 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:15:00.686146 22783 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.131:42109
I20260923 17:15:00.686195 22911 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.131:42109 every 8 connection(s)
I20260923 17:15:00.687211 22783 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
I20260923 17:15:00.689982 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 22783
I20260923 17:15:00.690116 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance
I20260923 17:15:00.690456 12182 external_mini_cluster.cc:1428] Setting key a518c4733928ccbbb0a7f7354998244f
Sep 23 17:15:00 dist-test-slave-1x1f krb5kdc[22408](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183700, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.131@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:15:00.701226 22492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:15:00.689216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:59221 (local address 127.11.229.190:40409)
0923 17:15:00.689341 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0923 17:15:00.689344 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 17:15:00.690249 (+ 905us) server_negotiation.cc:407] Connection header received
0923 17:15:00.692084 (+ 1835us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:15:00.692087 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:15:00.692136 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:15:00.692199 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:15:00.693543 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:15:00.694070 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:15:00.695347 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:15:00.695557 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:15:00.695631 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:15:00.697871 (+ 2240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:15:00.697874 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:15:00.697876 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:15:00.697898 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:15:00.699317 (+ 1419us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:15:00.699765 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:15:00.699767 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:15:00.699768 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:15:00.699850 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:15:00.700243 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:15:00.700245 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:15:00.700246 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:15:00.700417 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:15:00.700491 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0923 17:15:00.701011 (+ 520us) server_negotiation.cc:299] Negotiation successful
0923 17:15:00.701108 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260923 17:15:00.702068 22914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:15:00.689578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:40409 (local address 127.11.229.131:59221)
0923 17:15:00.690070 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0923 17:15:00.690135 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0923 17:15:00.691825 (+ 1690us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:15:00.692474 (+ 649us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:15:00.692484 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:15:00.692911 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:15:00.693410 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:15:00.693424 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:15:00.694287 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:15:00.694292 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:15:00.695231 (+ 939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:15:00.695240 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:15:00.695678 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:15:00.695681 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:15:00.695814 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:15:00.696352 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:15:00.696368 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:15:00.697727 (+ 1359us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:15:00.699424 (+ 1697us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:15:00.699428 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:15:00.699438 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:15:00.699684 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:15:00.699947 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:15:00.699950 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:15:00.699952 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:15:00.700088 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:15:00.700548 (+ 460us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:15:00.700553 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:15:00.700783 (+ 230us) client_negotiation.cc:769] Sending connection context
0923 17:15:00.700945 (+ 162us) client_negotiation.cc:240] Negotiation successful
0923 17:15:00.701245 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":142,"threads_started":1}
I20260923 17:15:00.703294 22912 heartbeater.cc:347] Connected to a master server at 127.11.229.190:40409
I20260923 17:15:00.703568 22912 heartbeater.cc:464] Registering TS with master...
I20260923 17:15:00.704031 22912 heartbeater.cc:511] Master 127.11.229.190:40409 requested a full tablet report, sending...
I20260923 17:15:00.704988 22453 ts_manager.cc:194] Registered new tserver with Master: 1bd975730bf54322b06a70a173f0b433 (127.11.229.131:42109)
I20260923 17:15:00.705497 22453 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.131@KRBTEST.COM'} at 127.11.229.131:59221
I20260923 17:15:00.716004 12182 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 17:15:00.725229 22492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:15:00.717899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49924 (local address 127.11.229.190:40409)
0923 17:15:00.718052 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0923 17:15:00.718061 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 17:15:00.718193 (+ 132us) server_negotiation.cc:407] Connection header received
0923 17:15:00.718357 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:15:00.718360 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:15:00.718401 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:15:00.718470 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:15:00.719177 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:15:00.719666 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:15:00.720498 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:15:00.720726 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:15:00.720817 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:15:00.722166 (+ 1349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:15:00.722169 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:15:00.722172 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:15:00.722197 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:15:00.723686 (+ 1489us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:15:00.724065 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:15:00.724067 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:15:00.724068 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:15:00.724144 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:15:00.724413 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:15:00.724416 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:15:00.724417 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:15:00.724648 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:15:00.724754 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0923 17:15:00.724958 (+ 204us) server_negotiation.cc:299] Negotiation successful
0923 17:15:00.725046 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260923 17:15:00.728117 22453 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49924:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 17:15:00.731146 22453 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 17:15:00.745530 22924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:15:00.739098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.131:42109 (local address 127.0.0.1:37502)
0923 17:15:00.740286 (+ 1188us) negotiation.cc:107] Waiting for socket to connect
0923 17:15:00.740342 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0923 17:15:00.740555 (+ 213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:15:00.741123 (+ 568us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:15:00.741129 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:15:00.741155 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:15:00.741341 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:15:00.741347 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:15:00.742823 (+ 1476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:15:00.742827 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:15:00.744089 (+ 1262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:15:00.744098 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:15:00.744980 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:15:00.744983 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:15:00.745090 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:15:00.745131 (+ 41us) client_negotiation.cc:769] Sending connection context
0923 17:15:00.745247 (+ 116us) client_negotiation.cc:240] Negotiation successful
0923 17:15:00.745372 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1011,"mutex_wait_us":51,"spinlock_wait_cycles":8448,"thread_start_us":89,"threads_started":1}
I20260923 17:15:00.745589 22925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:15:00.739194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37502 (local address 127.11.229.131:42109)
0923 17:15:00.740028 (+ 834us) server_negotiation.cc:206] Beginning negotiation
0923 17:15:00.740042 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0923 17:15:00.740435 (+ 393us) server_negotiation.cc:407] Connection header received
0923 17:15:00.740745 (+ 310us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:15:00.740751 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:15:00.740954 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:15:00.741114 (+ 160us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:15:00.741465 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:15:00.742676 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:15:00.744223 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:15:00.744859 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:15:00.745005 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:15:00.745140 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0923 17:15:00.745293 (+ 153us) server_negotiation.cc:299] Negotiation successful
0923 17:15:00.745393 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":711,"thread_start_us":132,"threads_started":1}
I20260923 17:15:00.746953 22926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:15:00.739399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46172 (local address 127.11.229.129:35415)
0923 17:15:00.739766 (+ 367us) server_negotiation.cc:206] Beginning negotiation
0923 17:15:00.739784 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0923 17:15:00.740424 (+ 640us) server_negotiation.cc:407] Connection header received
0923 17:15:00.741434 (+ 1010us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:15:00.741440 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:15:00.741620 (+ 180us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:15:00.741772 (+ 152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:15:00.741947 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:15:00.743411 (+ 1464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:15:00.744885 (+ 1474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:15:00.745862 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:15:00.746011 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:15:00.746149 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0923 17:15:00.746432 (+ 283us) server_negotiation.cc:299] Negotiation successful
0923 17:15:00.746637 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":268,"thread_start_us":65,"threads_started":1}
I20260923 17:15:00.747244 22928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:15:00.740007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33798 (local address 127.11.229.130:41875)
0923 17:15:00.740725 (+ 718us) server_negotiation.cc:206] Beginning negotiation
0923 17:15:00.740736 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 17:15:00.740756 (+ 20us) server_negotiation.cc:407] Connection header received
0923 17:15:00.740826 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:15:00.740830 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:15:00.740968 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:15:00.741114 (+ 146us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:15:00.742355 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:15:00.743536 (+ 1181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:15:00.744905 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:15:00.745840 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:15:00.745975 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:15:00.746868 (+ 893us) server_negotiation.cc:1035] Waiting for connection context
0923 17:15:00.746923 (+ 55us) server_negotiation.cc:299] Negotiation successful
0923 17:15:00.747034 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":597,"thread_start_us":88,"threads_started":1}
I20260923 17:15:00.746698 22923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:15:00.739861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.130:41875 (local address 127.0.0.1:33798)
0923 17:15:00.740430 (+ 569us) negotiation.cc:107] Waiting for socket to connect
0923 17:15:00.740444 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 17:15:00.740556 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:15:00.741184 (+ 628us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:15:00.741187 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:15:00.741206 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:15:00.741339 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:15:00.741347 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:15:00.743684 (+ 2337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:15:00.743687 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:15:00.744777 (+ 1090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:15:00.744787 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:15:00.746160 (+ 1373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:15:00.746165 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:15:00.746299 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:15:00.746342 (+ 43us) client_negotiation.cc:769] Sending connection context
0923 17:15:00.746421 (+ 79us) client_negotiation.cc:240] Negotiation successful
0923 17:15:00.746509 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":509,"mutex_wait_us":2,"spinlock_wait_cycles":3584,"thread_start_us":105,"threads_started":1}
I20260923 17:15:00.747397 22927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:15:00.739166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:35415 (local address 127.0.0.1:46172)
0923 17:15:00.740289 (+ 1123us) negotiation.cc:107] Waiting for socket to connect
0923 17:15:00.740342 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0923 17:15:00.741269 (+ 927us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:15:00.741760 (+ 491us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:15:00.741763 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:15:00.741780 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:15:00.741861 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:15:00.741866 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:15:00.743538 (+ 1672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:15:00.743541 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:15:00.744741 (+ 1200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:15:00.744752 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:15:00.746013 (+ 1261us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:15:00.746029 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:15:00.746170 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:15:00.746218 (+ 48us) client_negotiation.cc:769] Sending connection context
0923 17:15:00.747158 (+ 940us) client_negotiation.cc:240] Negotiation successful
0923 17:15:00.747244 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":989,"mutex_wait_us":60,"spinlock_wait_cycles":1696256,"thread_start_us":104,"threads_started":1}
I20260923 17:15:00.750064 22846 tablet_service.cc:1467] Processing CreateTablet for tablet 40dced7796b4479b826a23b3abfde77d (DEFAULT_TABLE table=test-table [id=a1c65d5e8a0a472893e0317b59daa495]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:15:00.750142 22578 tablet_service.cc:1467] Processing CreateTablet for tablet 40dced7796b4479b826a23b3abfde77d (DEFAULT_TABLE table=test-table [id=a1c65d5e8a0a472893e0317b59daa495]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:15:00.750142 22712 tablet_service.cc:1467] Processing CreateTablet for tablet 40dced7796b4479b826a23b3abfde77d (DEFAULT_TABLE table=test-table [id=a1c65d5e8a0a472893e0317b59daa495]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:15:00.751230 22578 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40dced7796b4479b826a23b3abfde77d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:15:00.751226 22712 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40dced7796b4479b826a23b3abfde77d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:15:00.751245 22846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 40dced7796b4479b826a23b3abfde77d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:15:00.757942 22929 tablet_bootstrap.cc:492] T 40dced7796b4479b826a23b3abfde77d P 1bd975730bf54322b06a70a173f0b433: Bootstrap starting.
I20260923 17:15:00.759722 22931 tablet_bootstrap.cc:492] T 40dced7796b4479b826a23b3abfde77d P 5eec0234722a4eabaa8507c47c3df6e0: Bootstrap starting.
I20260923 17:15:00.760305 22929 tablet_bootstrap.cc:654] T 40dced7796b4479b826a23b3abfde77d P 1bd975730bf54322b06a70a173f0b433: Neither blocks nor log segments found. Creating new log.
I20260923 17:15:00.761705 22929 log.cc:824] T 40dced7796b4479b826a23b3abfde77d P 1bd975730bf54322b06a70a173f0b433: Log is configured to *not* fsync() on all Append() calls
I20260923 17:15:00.762043 22931 tablet_bootstrap.cc:654] T 40dced7796b4479b826a23b3abfde77d P 5eec0234722a4eabaa8507c47c3df6e0: Neither blocks nor log segments found. Creating new log.
I20260923 17:15:00.762575 22930 tablet_bootstrap.cc:492] T 40dced7796b4479b826a23b3abfde77d P 80341444e10a4e53878fab8b34e6988d: Bootstrap starting.
I20260923 17:15:00.762916 22931 log.cc:824] T 40dced7796b4479b826a23b3abfde77d P 5eec0234722a4eabaa8507c47c3df6e0: Log is configured to *not* fsync() on all Append() calls
I20260923 17:15:00.763782 22929 tablet_bootstrap.cc:492] T 40dced7796b4479b826a23b3abfde77d P 1bd975730bf54322b06a70a173f0b433: No bootstrap required, opened a new log
I20260923 17:15:00.763988 22929 ts_tablet_manager.cc:1397] T 40dced7796b4479b826a23b3abfde77d P 1bd975730bf54322b06a70a173f0b433: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260923 17:15:00.764597 22930 tablet_bootstrap.cc:654] T 40dced7796b4479b826a23b3abfde77d P 80341444e10a4e53878fab8b34e6988d: Neither blocks nor log segments found. Creating new log.
I20260923 17:15:00.764907 22931 tablet_bootstrap.cc:492] T 40dced7796b4479b826a23b3abfde77d P 5eec0234722a4eabaa8507c47c3df6e0: No bootstrap required, opened a new log
I20260923 17:15:00.765084 22931 ts_tablet_manager.cc:1397] T 40dced7796b4479b826a23b3abfde77d P 5eec0234722a4eabaa8507c47c3df6e0: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260923 17:15:00.765396 22930 log.cc:824] T 40dced7796b4479b826a23b3abfde77d P 80341444e10a4e53878fab8b34e6988d: Log is configured to *not* fsync() on all Append() calls
I20260923 17:15:00.767402 22930 tablet_bootstrap.cc:492] T 40dced7796b4479b826a23b3abfde77d P 80341444e10a4e53878fab8b34e6988d: No bootstrap required, opened a new log
I20260923 17:15:00.767585 22930 ts_tablet_manager.cc:1397] T 40dced7796b4479b826a23b3abfde77d P 80341444e10a4e53878fab8b34e6988d: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260923 17:15:00.767688 22929 raft_consensus.cc:348] T 40dced7796b4479b826a23b3abfde77d P 1bd975730bf54322b06a70a173f0b433 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd975730bf54322b06a70a173f0b433" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42109 } } peers { permanent_uuid: "80341444e10a4e53878fab8b34e6988d" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 35415 } } peers { permanent_uuid: "5eec0234722a4eabaa8507c47c3df6e0" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 41875 } }
I20260923 17:15:00.767971 22929 raft_consensus.cc:374] T 40dced7796b4479b826a23b3abfde77d P 1bd975730bf54322b06a70a173f0b433 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:15:00.768038 22929 raft_consensus.cc:729] T 40dced7796b4479b826a23b3abfde77d P 1bd975730bf54322b06a70a173f0b433 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bd975730bf54322b06a70a173f0b433, State: Initialized, Role: FOLLOWER
I20260923 17:15:00.768558 22929 consensus_queue.cc:260] T 40dced7796b4479b826a23b3abfde77d P 1bd975730bf54322b06a70a173f0b433 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd975730bf54322b06a70a173f0b433" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42109 } } peers { permanent_uuid: "80341444e10a4e53878fab8b34e6988d" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 35415 } } peers { permanent_uuid: "5eec0234722a4eabaa8507c47c3df6e0" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 41875 } }
I20260923 17:15:00.769462 22929 ts_tablet_manager.cc:1428] T 40dced7796b4479b826a23b3abfde77d P 1bd975730bf54322b06a70a173f0b433: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260923 17:15:00.769309 22931 raft_consensus.cc:348] T 40dced7796b4479b826a23b3abfde77d P 5eec0234722a4eabaa8507c47c3df6e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd975730bf54322b06a70a173f0b433" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42109 } } peers { permanent_uuid: "80341444e10a4e53878fab8b34e6988d" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 35415 } } peers { permanent_uuid: "5eec0234722a4eabaa8507c47c3df6e0" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 41875 } }
I20260923 17:15:00.769572 22931 raft_consensus.cc:374] T 40dced7796b4479b826a23b3abfde77d P 5eec0234722a4eabaa8507c47c3df6e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:15:00.769639 22931 raft_consensus.cc:729] T 40dced7796b4479b826a23b3abfde77d P 5eec0234722a4eabaa8507c47c3df6e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5eec0234722a4eabaa8507c47c3df6e0, State: Initialized, Role: FOLLOWER
I20260923 17:15:00.769860 22912 heartbeater.cc:503] Master 127.11.229.190:40409 was elected leader, sending a full tablet report...
I20260923 17:15:00.770095 22931 consensus_queue.cc:260] T 40dced7796b4479b826a23b3abfde77d P 5eec0234722a4eabaa8507c47c3df6e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd975730bf54322b06a70a173f0b433" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42109 } } peers { permanent_uuid: "80341444e10a4e53878fab8b34e6988d" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 35415 } } peers { permanent_uuid: "5eec0234722a4eabaa8507c47c3df6e0" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 41875 } }
I20260923 17:15:00.770838 22778 heartbeater.cc:503] Master 127.11.229.190:40409 was elected leader, sending a full tablet report...
I20260923 17:15:00.771099 22931 ts_tablet_manager.cc:1428] T 40dced7796b4479b826a23b3abfde77d P 5eec0234722a4eabaa8507c47c3df6e0: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260923 17:15:00.771895 22930 raft_consensus.cc:348] T 40dced7796b4479b826a23b3abfde77d P 80341444e10a4e53878fab8b34e6988d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd975730bf54322b06a70a173f0b433" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42109 } } peers { permanent_uuid: "80341444e10a4e53878fab8b34e6988d" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 35415 } } peers { permanent_uuid: "5eec0234722a4eabaa8507c47c3df6e0" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 41875 } }
I20260923 17:15:00.772126 22930 raft_consensus.cc:374] T 40dced7796b4479b826a23b3abfde77d P 80341444e10a4e53878fab8b34e6988d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:15:00.772181 22930 raft_consensus.cc:729] T 40dced7796b4479b826a23b3abfde77d P 80341444e10a4e53878fab8b34e6988d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80341444e10a4e53878fab8b34e6988d, State: Initialized, Role: FOLLOWER
I20260923 17:15:00.772581 22930 consensus_queue.cc:260] T 40dced7796b4479b826a23b3abfde77d P 80341444e10a4e53878fab8b34e6988d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd975730bf54322b06a70a173f0b433" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42109 } } peers { permanent_uuid: "80341444e10a4e53878fab8b34e6988d" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 35415 } } peers { permanent_uuid: "5eec0234722a4eabaa8507c47c3df6e0" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 41875 } }
I20260923 17:15:00.773123 22644 heartbeater.cc:503] Master 127.11.229.190:40409 was elected leader, sending a full tablet report...
I20260923 17:15:00.773448 22930 ts_tablet_manager.cc:1428] T 40dced7796b4479b826a23b3abfde77d P 80341444e10a4e53878fab8b34e6988d: Time spent starting tablet: real 0.006s user 0.002s sys 0.005s
I20260923 17:15:00.818727 22935 raft_consensus.cc:482] T 40dced7796b4479b826a23b3abfde77d P 1bd975730bf54322b06a70a173f0b433 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 17:15:00.818954 22935 raft_consensus.cc:504] T 40dced7796b4479b826a23b3abfde77d P 1bd975730bf54322b06a70a173f0b433 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd975730bf54322b06a70a173f0b433" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42109 } } peers { permanent_uuid: "80341444e10a4e53878fab8b34e6988d" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 35415 } } peers { permanent_uuid: "5eec0234722a4eabaa8507c47c3df6e0" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 41875 } }
I20260923 17:15:00.820163 22935 leader_election.cc:288] T 40dced7796b4479b826a23b3abfde77d P 1bd975730bf54322b06a70a173f0b433 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 80341444e10a4e53878fab8b34e6988d (127.11.229.129:35415), 5eec0234722a4eabaa8507c47c3df6e0 (127.11.229.130:41875)
I20260923 17:15:00.824318 22914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:15:00.820416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.130:41875 (local address 127.11.229.131:55289)
0923 17:15:00.820522 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0923 17:15:00.820538 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 17:15:00.820644 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:15:00.821022 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:15:00.821025 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:15:00.821044 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:15:00.821164 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:15:00.821171 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:15:00.822107 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:15:00.822110 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:15:00.823038 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:15:00.823047 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:15:00.823874 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:15:00.823878 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:15:00.823980 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:15:00.824006 (+ 26us) client_negotiation.cc:769] Sending connection context
0923 17:15:00.824106 (+ 100us) client_negotiation.cc:240] Negotiation successful
0923 17:15:00.824184 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260923 17:15:00.824384 22928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:15:00.820570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:55289 (local address 127.11.229.130:41875)
0923 17:15:00.820684 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0923 17:15:00.820689 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:15:00.820732 (+ 43us) server_negotiation.cc:407] Connection header received
0923 17:15:00.820794 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:15:00.820799 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:15:00.820853 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:15:00.820941 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:15:00.821299 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:15:00.822006 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:15:00.823217 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:15:00.823763 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:15:00.823858 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:15:00.823901 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0923 17:15:00.824164 (+ 263us) server_negotiation.cc:299] Negotiation successful
0923 17:15:00.824253 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260923 17:15:00.824767 22926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:15:00.820734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:52653 (local address 127.11.229.129:35415)
0923 17:15:00.820859 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0923 17:15:00.820864 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:15:00.821166 (+ 302us) server_negotiation.cc:407] Connection header received
0923 17:15:00.821301 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:15:00.821304 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:15:00.821344 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:15:00.821399 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:15:00.821699 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:15:00.822357 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:15:00.823524 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:15:00.823991 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:15:00.824241 (+ 250us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:15:00.824285 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0923 17:15:00.824529 (+ 244us) server_negotiation.cc:299] Negotiation successful
0923 17:15:00.824630 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260923 17:15:00.825031 22732 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40dced7796b4479b826a23b3abfde77d" candidate_uuid: "1bd975730bf54322b06a70a173f0b433" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eec0234722a4eabaa8507c47c3df6e0" is_pre_election: true
I20260923 17:15:00.825125 22938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:15:00.820416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:35415 (local address 127.11.229.131:52653)
0923 17:15:00.821088 (+ 672us) negotiation.cc:107] Waiting for socket to connect
0923 17:15:00.821100 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 17:15:00.821186 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:15:00.821438 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:15:00.821441 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:15:00.821458 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:15:00.821580 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:15:00.821587 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:15:00.822458 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:15:00.822461 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:15:00.823392 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:15:00.823403 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:15:00.824249 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:15:00.824252 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:15:00.824356 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:15:00.824379 (+ 23us) client_negotiation.cc:769] Sending connection context
0923 17:15:00.824930 (+ 551us) client_negotiation.cc:240] Negotiation successful
0923 17:15:00.825012 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":583,"mutex_wait_us":304,"thread_start_us":124,"threads_started":1}
I20260923 17:15:00.825343 22732 raft_consensus.cc:2454] T 40dced7796b4479b826a23b3abfde77d P 5eec0234722a4eabaa8507c47c3df6e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1bd975730bf54322b06a70a173f0b433 in term 0.
I20260923 17:15:00.825838 22799 leader_election.cc:302] T 40dced7796b4479b826a23b3abfde77d P 1bd975730bf54322b06a70a173f0b433 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bd975730bf54322b06a70a173f0b433, 5eec0234722a4eabaa8507c47c3df6e0; no voters:
I20260923 17:15:00.825871 22598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40dced7796b4479b826a23b3abfde77d" candidate_uuid: "1bd975730bf54322b06a70a173f0b433" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80341444e10a4e53878fab8b34e6988d" is_pre_election: true
I20260923 17:15:00.826133 22598 raft_consensus.cc:2454] T 40dced7796b4479b826a23b3abfde77d P 80341444e10a4e53878fab8b34e6988d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1bd975730bf54322b06a70a173f0b433 in term 0.
I20260923 17:15:00.826134 22935 raft_consensus.cc:2781] T 40dced7796b4479b826a23b3abfde77d P 1bd975730bf54322b06a70a173f0b433 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 17:15:00.826268 22935 raft_consensus.cc:482] T 40dced7796b4479b826a23b3abfde77d P 1bd975730bf54322b06a70a173f0b433 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 17:15:00.826333 22935 raft_consensus.cc:3037] T 40dced7796b4479b826a23b3abfde77d P 1bd975730bf54322b06a70a173f0b433 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:15:00.827591 22935 raft_consensus.cc:504] T 40dced7796b4479b826a23b3abfde77d P 1bd975730bf54322b06a70a173f0b433 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd975730bf54322b06a70a173f0b433" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42109 } } peers { permanent_uuid: "80341444e10a4e53878fab8b34e6988d" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 35415 } } peers { permanent_uuid: "5eec0234722a4eabaa8507c47c3df6e0" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 41875 } }
I20260923 17:15:00.828034 22935 leader_election.cc:288] T 40dced7796b4479b826a23b3abfde77d P 1bd975730bf54322b06a70a173f0b433 [CANDIDATE]: Term 1 election: Requested vote from peers 80341444e10a4e53878fab8b34e6988d (127.11.229.129:35415), 5eec0234722a4eabaa8507c47c3df6e0 (127.11.229.130:41875)
I20260923 17:15:00.828532 22598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40dced7796b4479b826a23b3abfde77d" candidate_uuid: "1bd975730bf54322b06a70a173f0b433" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80341444e10a4e53878fab8b34e6988d"
I20260923 17:15:00.828681 22598 raft_consensus.cc:3037] T 40dced7796b4479b826a23b3abfde77d P 80341444e10a4e53878fab8b34e6988d [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:15:00.828758 22732 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "40dced7796b4479b826a23b3abfde77d" candidate_uuid: "1bd975730bf54322b06a70a173f0b433" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5eec0234722a4eabaa8507c47c3df6e0"
I20260923 17:15:00.828912 22732 raft_consensus.cc:3037] T 40dced7796b4479b826a23b3abfde77d P 5eec0234722a4eabaa8507c47c3df6e0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:15:00.829900 22598 raft_consensus.cc:2454] T 40dced7796b4479b826a23b3abfde77d P 80341444e10a4e53878fab8b34e6988d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bd975730bf54322b06a70a173f0b433 in term 1.
I20260923 17:15:00.830058 22732 raft_consensus.cc:2454] T 40dced7796b4479b826a23b3abfde77d P 5eec0234722a4eabaa8507c47c3df6e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bd975730bf54322b06a70a173f0b433 in term 1.
I20260923 17:15:00.830222 22802 leader_election.cc:302] T 40dced7796b4479b826a23b3abfde77d P 1bd975730bf54322b06a70a173f0b433 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bd975730bf54322b06a70a173f0b433, 80341444e10a4e53878fab8b34e6988d; no voters:
I20260923 17:15:00.830428 22935 raft_consensus.cc:2781] T 40dced7796b4479b826a23b3abfde77d P 1bd975730bf54322b06a70a173f0b433 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:15:00.830696 22935 raft_consensus.cc:686] T 40dced7796b4479b826a23b3abfde77d P 1bd975730bf54322b06a70a173f0b433 [term 1 LEADER]: Becoming Leader. State: Replica: 1bd975730bf54322b06a70a173f0b433, State: Running, Role: LEADER
I20260923 17:15:00.831056 22935 consensus_queue.cc:237] T 40dced7796b4479b826a23b3abfde77d P 1bd975730bf54322b06a70a173f0b433 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd975730bf54322b06a70a173f0b433" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42109 } } peers { permanent_uuid: "80341444e10a4e53878fab8b34e6988d" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 35415 } } peers { permanent_uuid: "5eec0234722a4eabaa8507c47c3df6e0" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 41875 } }
I20260923 17:15:00.834384 22451 catalog_manager.cc:5495] T 40dced7796b4479b826a23b3abfde77d P 1bd975730bf54322b06a70a173f0b433 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1bd975730bf54322b06a70a173f0b433 (127.11.229.131). New cstate: current_term: 1 leader_uuid: "1bd975730bf54322b06a70a173f0b433" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd975730bf54322b06a70a173f0b433" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 42109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80341444e10a4e53878fab8b34e6988d" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 35415 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5eec0234722a4eabaa8507c47c3df6e0" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 41875 } health_report { overall_health: UNKNOWN } } }
I20260923 17:15:00.867494 22925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:15:00.863766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37504 (local address 127.11.229.131:42109)
0923 17:15:00.863893 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0923 17:15:00.863896 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 17:15:00.863910 (+ 14us) server_negotiation.cc:407] Connection header received
0923 17:15:00.864004 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:15:00.864006 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:15:00.864059 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:15:00.864148 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 17:15:00.864404 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:15:00.864903 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:15:00.865744 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:15:00.865991 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:15:00.866092 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:15:00.866416 (+ 324us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 17:15:00.866934 (+ 518us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 17:15:00.867034 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0923 17:15:00.867190 (+ 156us) server_negotiation.cc:299] Negotiation successful
0923 17:15:00.867279 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260923 17:15:00.873507 22732 raft_consensus.cc:1261] T 40dced7796b4479b826a23b3abfde77d P 5eec0234722a4eabaa8507c47c3df6e0 [term 1 FOLLOWER]: Refusing update from remote peer 1bd975730bf54322b06a70a173f0b433: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:15:00.873507 22598 raft_consensus.cc:1261] T 40dced7796b4479b826a23b3abfde77d P 80341444e10a4e53878fab8b34e6988d [term 1 FOLLOWER]: Refusing update from remote peer 1bd975730bf54322b06a70a173f0b433: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:15:00.874217 22935 consensus_queue.cc:1035] T 40dced7796b4479b826a23b3abfde77d P 1bd975730bf54322b06a70a173f0b433 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80341444e10a4e53878fab8b34e6988d" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 35415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:15:00.874430 22939 consensus_queue.cc:1035] T 40dced7796b4479b826a23b3abfde77d P 1bd975730bf54322b06a70a173f0b433 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5eec0234722a4eabaa8507c47c3df6e0" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 41875 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:15:00.880851 22942 mvcc.cc:205] Tried to move back new op lower bound from 7332592438770610176 to 7332592438606782464. Current Snapshot: MvccSnapshot[applied={T|T < 7332592438770610176}]
I20260923 17:15:00.882328 22943 mvcc.cc:205] Tried to move back new op lower bound from 7332592438770610176 to 7332592438606782464. Current Snapshot: MvccSnapshot[applied={T|T < 7332592438770610176}]
I20260923 17:15:00.882479 22944 mvcc.cc:205] Tried to move back new op lower bound from 7332592438770610176 to 7332592438606782464. Current Snapshot: MvccSnapshot[applied={T|T < 7332592438770610176}]
I20260923 17:15:00.890038 22452 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49924:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:15:00.890230 22452 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49924:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:15:00.892882 22452 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f90328a537484e7c92925a994b9dd7e4: Sending DeleteTablet for 3 replicas of tablet 40dced7796b4479b826a23b3abfde77d
I20260923 17:15:00.893659 22846 tablet_service.cc:1514] Processing DeleteTablet for tablet 40dced7796b4479b826a23b3abfde77d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:15:00 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:37502
I20260923 17:15:00.893675 22578 tablet_service.cc:1514] Processing DeleteTablet for tablet 40dced7796b4479b826a23b3abfde77d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:15:00 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:46172
I20260923 17:15:00.893860 22712 tablet_service.cc:1514] Processing DeleteTablet for tablet 40dced7796b4479b826a23b3abfde77d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:15:00 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:33798
I20260923 17:15:00.894317 22953 tablet_replica.cc:330] T 40dced7796b4479b826a23b3abfde77d P 5eec0234722a4eabaa8507c47c3df6e0: stopping tablet replica
I20260923 17:15:00.894415 22951 tablet_replica.cc:330] T 40dced7796b4479b826a23b3abfde77d P 80341444e10a4e53878fab8b34e6988d: stopping tablet replica
I20260923 17:15:00.894598 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 22515
I20260923 17:15:00.894696 22951 raft_consensus.cc:2229] T 40dced7796b4479b826a23b3abfde77d P 80341444e10a4e53878fab8b34e6988d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:15:00.894985 22951 raft_consensus.cc:2258] T 40dced7796b4479b826a23b3abfde77d P 80341444e10a4e53878fab8b34e6988d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:15:00.895221 22952 tablet_replica.cc:330] T 40dced7796b4479b826a23b3abfde77d P 1bd975730bf54322b06a70a173f0b433: stopping tablet replica
I20260923 17:15:00.895442 22952 raft_consensus.cc:2229] T 40dced7796b4479b826a23b3abfde77d P 1bd975730bf54322b06a70a173f0b433 [term 1 LEADER]: Raft consensus shutting down.
I20260923 17:15:00.895762 22952 raft_consensus.cc:2258] T 40dced7796b4479b826a23b3abfde77d P 1bd975730bf54322b06a70a173f0b433 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:15:00.894680 22953 raft_consensus.cc:2229] T 40dced7796b4479b826a23b3abfde77d P 5eec0234722a4eabaa8507c47c3df6e0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:15:00.896461 22953 raft_consensus.cc:2258] T 40dced7796b4479b826a23b3abfde77d P 5eec0234722a4eabaa8507c47c3df6e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:15:00.897173 22952 ts_tablet_manager.cc:1905] T 40dced7796b4479b826a23b3abfde77d P 1bd975730bf54322b06a70a173f0b433: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:15:00.897837 22953 ts_tablet_manager.cc:1905] T 40dced7796b4479b826a23b3abfde77d P 5eec0234722a4eabaa8507c47c3df6e0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:15:00.899861 22952 ts_tablet_manager.cc:1918] T 40dced7796b4479b826a23b3abfde77d P 1bd975730bf54322b06a70a173f0b433: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 17:15:00.899956 22952 log.cc:1196] T 40dced7796b4479b826a23b3abfde77d P 1bd975730bf54322b06a70a173f0b433: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-2/wal/wals/40dced7796b4479b826a23b3abfde77d
I20260923 17:15:00.900266 22952 ts_tablet_manager.cc:1939] T 40dced7796b4479b826a23b3abfde77d P 1bd975730bf54322b06a70a173f0b433: Deleting consensus metadata
I20260923 17:15:00.900738 22953 ts_tablet_manager.cc:1918] T 40dced7796b4479b826a23b3abfde77d P 5eec0234722a4eabaa8507c47c3df6e0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 17:15:00.900842 22953 log.cc:1196] T 40dced7796b4479b826a23b3abfde77d P 5eec0234722a4eabaa8507c47c3df6e0: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790183633736342-12182-0/minicluster-data/ts-1/wal/wals/40dced7796b4479b826a23b3abfde77d
I20260923 17:15:00.901221 22953 ts_tablet_manager.cc:1939] T 40dced7796b4479b826a23b3abfde77d P 5eec0234722a4eabaa8507c47c3df6e0: Deleting consensus metadata
I20260923 17:15:00.901414 22439 catalog_manager.cc:4841] TS 1bd975730bf54322b06a70a173f0b433 (127.11.229.131:42109): tablet 40dced7796b4479b826a23b3abfde77d (table test-table [id=a1c65d5e8a0a472893e0317b59daa495]) successfully deleted
W20260923 17:15:00.901610 22440 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.229.129:35415 (error 108)
I20260923 17:15:00.902647 22437 catalog_manager.cc:4841] TS 5eec0234722a4eabaa8507c47c3df6e0 (127.11.229.130:41875): tablet 40dced7796b4479b826a23b3abfde77d (table test-table [id=a1c65d5e8a0a472893e0317b59daa495]) successfully deleted
W20260923 17:15:00.903882 22927 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:15:00.902595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:35415 (local address 127.0.0.1:46182)
0923 17:15:00.902801 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0923 17:15:00.902816 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 17:15:00.903350 (+ 534us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:15:00.903718 (+ 368us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.129:35415: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":105}
W20260923 17:15:00.904147 22440 catalog_manager.cc:4584] TS 80341444e10a4e53878fab8b34e6988d (127.11.229.129:35415): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 40dced7796b4479b826a23b3abfde77d: Network error: Client connection negotiation failed: client connection to 127.11.229.129:35415: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260923 17:15:00.905822 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 22649
I20260923 17:15:00.913867 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 22783
I20260923 17:15:00.920432 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 22421
2026-09-23T17:15:00Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2361 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 17:15:00 dist-test-slave-1x1f krb5kdc[22957](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 17:15:00 dist-test-slave-1x1f krb5kdc[22957](info): set up 2 sockets
Sep 23 17:15:00 dist-test-slave-1x1f krb5kdc[22957](info): commencing operation
krb5kdc: starting...
W20260923 17:15:02.024236 12182 mini_kdc.cc:121] Time spent starting KDC: real 1.082s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Sep 23 17:15:02 dist-test-slave-1x1f krb5kdc[22957](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183702, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T17:15:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:15:02Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.11.229.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.11.229.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.11.229.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/krb5kdc/rangeradmin_127.11.229.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.11.229.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/krb5kdc/rangeradmin_127.11.229.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.11.229.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.11.229.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.11.229.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/krb5kdc/rangerlookup_127.11.229.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.11.229.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/krb5kdc/rangerlookup_127.11.229.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.229.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.11.229.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.229.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/krb5kdc/HTTP_127.11.229.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.229.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/krb5kdc/HTTP_127.11.229.148@KRBTEST.COM.keytab.
I20260923 17:15:02.197903 12182 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskks427P/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/postgres -l logfile start
2026-09-23 17:15:04.923 UTC [22987] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-09-23 17:15:04.923 UTC [22987] LOG: listening on IPv4 address "127.11.229.148", port 57955
2026-09-23 17:15:04.928 UTC [22987] LOG: listening on Unix socket "/tmp/.s.PGSQL.57955"
2026-09-23 17:15:04.963 UTC [22990] LOG: database system was shut down at 2026-09-23 17:15:03 UTC
2026-09-23 17:15:04.967 UTC [22987] LOG: database system is ready to accept connections
I20260923 17:15:05.911666 12182 mini_postgres.cc:96] Postgres bound to 57955
2026-09-23 17:15:05.920 UTC [22998] FATAL: database "slave" does not exist
127.11.229.148:57955 - accepting connections
I20260923 17:15:05.920994 12182 mini_ranger.cc:161] Starting Ranger...
I20260923 17:15:05.936229 12182 mini_ranger.cc:84] Created miniranger Postgres user
I20260923 17:15:06.487243 12182 mini_ranger.cc:87] Created ranger Postgres database
I20260923 17:15:06.487350 12182 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ranger-admin
2026-09-23 17:15:06,773 [I] DB FLAVOR :POSTGRES
2026-09-23 17:15:06,774 [I] --------- Verifying Ranger DB connection ---------
2026-09-23 17:15:06,774 [I] Checking connection..
2026-09-23 17:15:06,774 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskks427P/build/debug/bin/postgresql.jar:/tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.229.148:57955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-09-23 17:15:07,051 [I] Checking connection passed.
2026-09-23 17:15:07,051 [I] --------- Verifying version history table ---------
2026-09-23 17:15:07,051 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskks427P/build/debug/bin/postgresql.jar:/tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.229.148:57955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-23 17:15:07,336 [I] Table x_db_version_h does not exist in database ranger
2026-09-23 17:15:07,337 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskks427P/build/debug/bin/postgresql.jar:/tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.229.148:57955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-23 17:15:07,595 [I] Table x_db_version_h does not exist in database ranger
2026-09-23 17:15:07,595 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-09-23 17:15:07,596 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskks427P/build/debug/bin/postgresql.jar:/tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.229.148:57955/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-09-23 17:15:07.822 UTC [23062] WARNING: there is no transaction in progress
2026-09-23 17:15:07,829 [I] create_dbversion_catalog.sql file imported successfully
2026-09-23 17:15:07,829 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskks427P/build/debug/bin/postgresql.jar:/tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.229.148:57955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-23 17:15:08,066 [I] Table x_db_version_h already exists in database 'ranger'
2026-09-23 17:15:08,067 [I] --------- Importing Ranger Core DB Schema ---------
2026-09-23 17:15:08,067 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskks427P/build/debug/bin/postgresql.jar:/tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.229.148:57955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-09-23 17:15:08,320 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskks427P/build/debug/bin/postgresql.jar:/tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.229.148:57955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-09-23 17:15:08,569 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskks427P/build/debug/bin/postgresql.jar:/tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.229.148:57955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-1x1f.c.gcp-upstream.internal','N') ;"
2026-09-23 17:15:08,790 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskks427P/build/debug/bin/postgresql.jar:/tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.229.148:57955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-23 17:15:09,037 [I] Table x_portal_user does not exist in database ranger
2026-09-23 17:15:09,037 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskks427P/build/debug/bin/postgresql.jar:/tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.229.148:57955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-23 17:15:09,293 [I] Table x_policy_ref_group does not exist in database ranger
2026-09-23 17:15:09,293 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskks427P/build/debug/bin/postgresql.jar:/tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.229.148:57955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-23 17:15:09,569 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskks427P/build/debug/bin/postgresql.jar:/tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.229.148:57955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-23 17:15:09,795 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-09-23 17:15:09,795 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskks427P/build/debug/bin/postgresql.jar:/tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.229.148:57955/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-09-23 17:15:10.884 UTC [23170] WARNING: there is no transaction in progress
2026-09-23 17:15:10.902 UTC [23170] WARNING: there is no transaction in progress
2026-09-23 17:15:10.921 UTC [23170] WARNING: there is no transaction in progress
2026-09-23 17:15:10.940 UTC [23170] WARNING: there is no transaction in progress
2026-09-23 17:15:10.959 UTC [23170] WARNING: there is no transaction in progress
2026-09-23 17:15:10.982 UTC [23170] WARNING: there is no transaction in progress
2026-09-23 17:15:11.047 UTC [23170] WARNING: there is no transaction in progress
2026-09-23 17:15:11.056 UTC [23170] WARNING: there is no transaction in progress
2026-09-23 17:15:11.076 UTC [23170] WARNING: there is no transaction in progress
2026-09-23 17:15:11.089 UTC [23170] WARNING: there is no transaction in progress
2026-09-23 17:15:11.102 UTC [23170] WARNING: there is no transaction in progress
2026-09-23 17:15:11.120 UTC [23170] WARNING: there is no transaction in progress
2026-09-23 17:15:11.131 UTC [23170] WARNING: there is no transaction in progress
2026-09-23 17:15:11.141 UTC [23170] WARNING: there is no transaction in progress
2026-09-23 17:15:11.152 UTC [23170] WARNING: there is no transaction in progress
2026-09-23 17:15:11.162 UTC [23170] WARNING: there is no transaction in progress
2026-09-23 17:15:11,959 [I] ranger_core_db_postgres.sql file imported successfully
2026-09-23 17:15:11,959 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskks427P/build/debug/bin/postgresql.jar:/tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.229.148:57955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-09-23 17:15:12,206 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-09-23 17:15:12,207 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskks427P/build/debug/bin/postgresql.jar:/tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.229.148:57955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-23 17:15:12,483 [I] Table x_portal_user already exists in database 'ranger'
2026-09-23 17:15:12,483 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskks427P/build/debug/bin/postgresql.jar:/tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.229.148:57955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-23 17:15:12,765 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-09-23 17:15:12,765 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskks427P/build/debug/bin/postgresql.jar:/tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.229.148:57955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-23 17:15:13,041 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskks427P/build/debug/bin/postgresql.jar:/tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.229.148:57955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-23 17:15:13,332 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskks427P/build/debug/bin/postgresql.jar:/tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.229.148:57955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-1x1f.c.gcp-upstream.internal';"
2026-09-23 17:15:13,581 [I] CORE_DB_SCHEMA import status has been updated
2026-09-23 17:15:13,581 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskks427P/build/debug/bin/postgresql.jar:/tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.229.148:57955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-09-23 17:15:13,859 [I] DB_PATCHES have already been applied
I20260923 17:15:13.865244 12182 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ranger-admin:/tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskks427P/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskks427P/build/debug/bin/postgresql.jar:/tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260923 17:15:13.865307 12182 mini_ranger.cc:193] Using host: 127.11.229.148
I20260923 17:15:13.868842 12182 mini_ranger.cc:227] Ranger admin URL: http://127.11.229.148:44561
Sep 23, 2026 5:15:14 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 23, 2026 5:15:14 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 23, 2026 5:15:14 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ranger-admin/ews/webapp
Sep 23, 2026 5:15:14 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Sep 23, 2026 5:15:14 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ranger-admin/ews/webapp] .....
Sep 23, 2026 5:15:14 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ranger-admin/ews/webapp].
Sep 23, 2026 5:15:14 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260923 17:15:15.035867 12182 mini_ranger.cc:160] Time spent starting Ranger: real 9.115s user 0.001s sys 0.009s
Sep 23, 2026 5:15:34 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Sep 23, 2026 5:15:34 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Sep 23, 2026 5:15:34 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Sep 23, 2026 5:15:34 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Sep 23, 2026 5:15:34 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Sep 23, 2026 5:15:34 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Sep 23, 2026 5:15:34 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Sep 23, 2026 5:15:34 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Sep 23, 2026 5:15:34 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Sep 23, 2026 5:15:34 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Sep 23, 2026 5:15:34 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Sep 23, 2026 5:15:34 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Sep 23, 2026 5:15:34 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Sep 23, 2026 5:15:34 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Sep 23, 2026 5:15:34 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Sep 23, 2026 5:15:34 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Sep 23, 2026 5:15:34 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Sep 23, 2026 5:15:35 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260923 17:15:36.009822 12182 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.11.229.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.11.229.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.11.229.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/krb5kdc/rangerkms_127.11.229.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.11.229.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/krb5kdc/rangerkms_127.11.229.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.229.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.11.229.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.229.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/krb5kdc/HTTP_127.11.229.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.229.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/krb5kdc/HTTP_127.11.229.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Sep 23 17:15:36 dist-test-slave-1x1f krb5kdc[22957](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183736, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260923 17:15:36.097625 12182 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260923 17:15:36.106932 12182 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260923 17:15:37.100040 12182 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260923 17:15:37.100140 12182 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ranger-kms
I20260923 17:15:37.100242 12182 mini_ranger_kms.cc:227] Using postgres at 127.11.229.148:57955
2026-09-23 17:15:37,291 [I] DB FLAVOR :POSTGRES
2026-09-23 17:15:37,291 [I] --------- Verifying Ranger DB connection ---------
2026-09-23 17:15:37,292 [I] Checking connection
2026-09-23 17:15:37,292 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskks427P/build/debug/bin/postgresql.jar:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.229.148:57955/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-09-23 17:15:37,534 [I] connection success
2026-09-23 17:15:37,534 [I] --------- Verifying Ranger DB tables ---------
2026-09-23 17:15:37,534 [I] Verifying table ranger_masterkey in database rangerkms
2026-09-23 17:15:37,534 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskks427P/build/debug/bin/postgresql.jar:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.229.148:57955/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-09-23 17:15:37,779 [I] Table ranger_masterkey does not exist in database rangerkms
2026-09-23 17:15:37,779 [I] --------- Importing Ranger Core DB Schema ---------
2026-09-23 17:15:37,779 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-09-23 17:15:37,779 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskks427P/build/debug/bin/postgresql.jar:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.229.148:57955/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-09-23 17:15:38,046 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260923 17:15:38.512524 12182 mini_ranger_kms.cc:310] Created kms service
I20260923 17:15:38.719378 12182 mini_ranger_kms.cc:326] Created kudu user
I20260923 17:15:38.761566 12182 mini_ranger_kms.cc:343] Created rangerkms user
Sep 23 17:15:38 dist-test-slave-1x1f krb5kdc[22957](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183736, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.11.229.148@KRBTEST.COM
I20260923 17:15:39.156926 12182 mini_ranger_kms.cc:384] Added ranger policy
I20260923 17:15:39.157073 12182 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ranger-kms:/tmp/dist-test-taskks427P/build/debug/bin/postgresql.jar:/tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260923 17:15:39.157094 12182 mini_ranger_kms.cc:240] Using host: 127.11.229.148
I20260923 17:15:39.161171 12182 mini_ranger_kms.cc:276] Ranger KMS PID: 23350
I20260923 17:15:39.161296 12182 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.11.229.148:53875
Sep 23, 2026 5:15:40 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 23, 2026 5:15:40 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 23, 2026 5:15:40 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Sep 23, 2026 5:15:40 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ranger-kms/ews/webapp] .....
Sep 23, 2026 5:15:40 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ranger-kms/ews/webapp].
Sep 23, 2026 5:15:40 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260923 17:15:41.602188 12182 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.505s user 0.021s sys 0.154s
I20260923 17:15:41.602389 12182 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260923 17:15:41.602526 12182 mini_ranger_kms.cc:401] 127.11.229.148:53875/kms/v1/keys
Sep 23 17:15:41 dist-test-slave-1x1f krb5kdc[22957](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790183741, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.229.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Sep 23 17:15:42 dist-test-slave-1x1f krb5kdc[22957](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183741, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.229.148@KRBTEST.COM for HTTP/127.11.229.148@KRBTEST.COM
Sep 23 17:15:42 dist-test-slave-1x1f krb5kdc[22957](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183741, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.229.148@KRBTEST.COM for HTTP/127.11.229.148@KRBTEST.COM
Sep 23 17:15:44 dist-test-slave-1x1f krb5kdc[22957](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183744, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.11.229.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
I20260923 17:15:44.850399 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:43325
--webserver_interface=127.11.229.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:46333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:43325
--ranger_config_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.229.148:53875/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:15:44.973480 23401 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:15:44.973755 23401 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:15:44.973796 23401 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:15:44.978729 23401 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:15:44.978806 23401 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:15:44.978826 23401 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:15:44.978842 23401 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:15:44.978858 23401 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:15:44.984479 23401 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:46333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/master-0/wal
--ranger_kms_url=127.11.229.148:53875/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:43325
--ranger_config_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:43325
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.229.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23401
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:15:44.985618 23401 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:15:44.986729 23401 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:15:44.995900 23409 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:15:44.995913 23407 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:15:44.995898 23406 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:15:44.996317 23401 server_base.cc:1034] running on GCE node
I20260923 17:15:44.996994 23401 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:15:44.998381 23401 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:15:44.999590 23401 hybrid_clock.cc:648] HybridClock initialized: now 1790183744999569 us; error 37 us; skew 500 ppm
Sep 23 17:15:45 dist-test-slave-1x1f krb5kdc[22957](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183745, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:15:45.007431 23401 init.cc:377] Logged in from keytab as kudu/127.11.229.190@KRBTEST.COM (short username kudu)
I20260923 17:15:45.008472 23401 webserver.cc:460] Webserver started at http://127.11.229.190:33917/ using document root <none> and password file <none>
I20260923 17:15:45.009070 23401 fs_manager.cc:359] Metadata directory not provided
I20260923 17:15:45.009130 23401 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:15:45.009375 23401 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 23 17:15:45 dist-test-slave-1x1f krb5kdc[22957](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183745, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for HTTP/127.11.229.148@KRBTEST.COM
I20260923 17:15:45.060379 23401 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "f14d55aa527846d8ae67e761aff55c4e"
format_stamp: "Formatted at 2026-09-23 17:15:45 on dist-test-slave-1x1f"
server_key: "14ca16011ad38539a797562200d651be"
server_key_iv: "ea9f46e327b23e33ff2029148c98b337"
server_key_version: "kuduclusterkey@0"
I20260923 17:15:45.061007 23401 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "f14d55aa527846d8ae67e761aff55c4e"
format_stamp: "Formatted at 2026-09-23 17:15:45 on dist-test-slave-1x1f"
server_key: "14ca16011ad38539a797562200d651be"
server_key_iv: "ea9f46e327b23e33ff2029148c98b337"
server_key_version: "kuduclusterkey@0"
I20260923 17:15:45.064950 23401 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260923 17:15:45.082976 23416 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:15:45.084434 23401 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 17:15:45.084587 23401 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "f14d55aa527846d8ae67e761aff55c4e"
format_stamp: "Formatted at 2026-09-23 17:15:45 on dist-test-slave-1x1f"
server_key: "14ca16011ad38539a797562200d651be"
server_key_iv: "ea9f46e327b23e33ff2029148c98b337"
server_key_version: "kuduclusterkey@0"
I20260923 17:15:45.084728 23401 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:15:45.096836 23401 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:15:45.100265 23401 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:15:45.100489 23401 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:15:45.109294 23401 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.190:43325
I20260923 17:15:45.109313 23468 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.190:43325 every 8 connection(s)
I20260923 17:15:45.110391 23401 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:15:45.113844 23469 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:15:45.118839 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 23401
I20260923 17:15:45.119096 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:15:45.119356 12182 external_mini_cluster.cc:1428] Setting key 3ee03c2b30f9af138dbd7c082afc7b94
I20260923 17:15:45.120960 23469 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f14d55aa527846d8ae67e761aff55c4e: Bootstrap starting.
I20260923 17:15:45.124325 23469 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f14d55aa527846d8ae67e761aff55c4e: Neither blocks nor log segments found. Creating new log.
I20260923 17:15:45.125264 23469 log.cc:824] T 00000000000000000000000000000000 P f14d55aa527846d8ae67e761aff55c4e: Log is configured to *not* fsync() on all Append() calls
I20260923 17:15:45.127502 23469 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f14d55aa527846d8ae67e761aff55c4e: No bootstrap required, opened a new log
Sep 23 17:15:45 dist-test-slave-1x1f krb5kdc[22957](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183744, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:15:45.131902 23469 raft_consensus.cc:348] T 00000000000000000000000000000000 P f14d55aa527846d8ae67e761aff55c4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f14d55aa527846d8ae67e761aff55c4e" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43325 } }
I20260923 17:15:45.132174 23469 raft_consensus.cc:374] T 00000000000000000000000000000000 P f14d55aa527846d8ae67e761aff55c4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:15:45.132262 23469 raft_consensus.cc:729] T 00000000000000000000000000000000 P f14d55aa527846d8ae67e761aff55c4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f14d55aa527846d8ae67e761aff55c4e, State: Initialized, Role: FOLLOWER
I20260923 17:15:45.132759 23469 consensus_queue.cc:260] T 00000000000000000000000000000000 P f14d55aa527846d8ae67e761aff55c4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f14d55aa527846d8ae67e761aff55c4e" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43325 } }
I20260923 17:15:45.132916 23469 raft_consensus.cc:388] T 00000000000000000000000000000000 P f14d55aa527846d8ae67e761aff55c4e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:15:45.133001 23469 raft_consensus.cc:482] T 00000000000000000000000000000000 P f14d55aa527846d8ae67e761aff55c4e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:15:45.133096 23469 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f14d55aa527846d8ae67e761aff55c4e [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:15:45.134064 23472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:15:45.120796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47064 (local address 127.11.229.190:43325)
0923 17:15:45.121293 (+ 497us) server_negotiation.cc:206] Beginning negotiation
0923 17:15:45.121311 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0923 17:15:45.121346 (+ 35us) server_negotiation.cc:407] Connection header received
0923 17:15:45.121985 (+ 639us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:15:45.122002 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:15:45.122403 (+ 401us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:15:45.122735 (+ 332us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:15:45.123525 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:15:45.124571 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:15:45.125470 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:15:45.126120 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:15:45.126313 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:15:45.129134 (+ 2821us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:15:45.129139 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:15:45.129152 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:15:45.129178 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:15:45.130892 (+ 1714us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:15:45.131332 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:15:45.131344 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:15:45.131349 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:15:45.131445 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:15:45.131734 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:15:45.131739 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:15:45.131740 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:15:45.132121 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:15:45.132941 (+ 820us) server_negotiation.cc:1035] Waiting for connection context
0923 17:15:45.133096 (+ 155us) server_negotiation.cc:299] Negotiation successful
0923 17:15:45.133355 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":162,"threads_started":1}
I20260923 17:15:45.134156 23469 raft_consensus.cc:504] T 00000000000000000000000000000000 P f14d55aa527846d8ae67e761aff55c4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f14d55aa527846d8ae67e761aff55c4e" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43325 } }
I20260923 17:15:45.134557 23469 leader_election.cc:302] T 00000000000000000000000000000000 P f14d55aa527846d8ae67e761aff55c4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f14d55aa527846d8ae67e761aff55c4e; no voters:
I20260923 17:15:45.134882 23469 leader_election.cc:288] T 00000000000000000000000000000000 P f14d55aa527846d8ae67e761aff55c4e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 17:15:45.134985 23474 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f14d55aa527846d8ae67e761aff55c4e [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:15:45.135253 23474 raft_consensus.cc:686] T 00000000000000000000000000000000 P f14d55aa527846d8ae67e761aff55c4e [term 1 LEADER]: Becoming Leader. State: Replica: f14d55aa527846d8ae67e761aff55c4e, State: Running, Role: LEADER
I20260923 17:15:45.135573 23474 consensus_queue.cc:237] T 00000000000000000000000000000000 P f14d55aa527846d8ae67e761aff55c4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f14d55aa527846d8ae67e761aff55c4e" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43325 } }
I20260923 17:15:45.136723 23474 sys_catalog.cc:455] T 00000000000000000000000000000000 P f14d55aa527846d8ae67e761aff55c4e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f14d55aa527846d8ae67e761aff55c4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f14d55aa527846d8ae67e761aff55c4e" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43325 } } }
I20260923 17:15:45.136883 23474 sys_catalog.cc:458] T 00000000000000000000000000000000 P f14d55aa527846d8ae67e761aff55c4e [sys.catalog]: This master's current role is: LEADER
I20260923 17:15:45.137079 23474 sys_catalog.cc:455] T 00000000000000000000000000000000 P f14d55aa527846d8ae67e761aff55c4e [sys.catalog]: SysCatalogTable state changed. Reason: New leader f14d55aa527846d8ae67e761aff55c4e. Latest consensus state: current_term: 1 leader_uuid: "f14d55aa527846d8ae67e761aff55c4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f14d55aa527846d8ae67e761aff55c4e" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43325 } } }
I20260923 17:15:45.137161 23474 sys_catalog.cc:458] T 00000000000000000000000000000000 P f14d55aa527846d8ae67e761aff55c4e [sys.catalog]: This master's current role is: LEADER
I20260923 17:15:45.137265 23469 sys_catalog.cc:564] T 00000000000000000000000000000000 P f14d55aa527846d8ae67e761aff55c4e [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:15:45.137434 23478 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:15:45.141114 23478 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:15:45.141521 23469 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260923 17:15:45.146574 23478 catalog_manager.cc:1347] Generated new cluster ID: 1464d0fce9884a55a4861ccbe2d2889d
I20260923 17:15:45.146663 23478 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:15:45.174917 23478 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:15:45.176407 23478 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:15:45.194293 23478 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f14d55aa527846d8ae67e761aff55c4e: Generated new TSK 0
I20260923 17:15:45.195360 23478 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.229.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab.
Entry for principal kudu/127.11.229.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab.
I20260923 17:15:45.929860 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.229.148:53875/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.129:0
--local_ip_for_outbound_sockets=127.11.229.129
--webserver_interface=127.11.229.129
--webserver_port=0
--tserver_master_addrs=127.11.229.190:43325
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab
--principal=kudu/127.11.229.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:46333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:15:46.075603 23514 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:15:46.075899 23514 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:15:46.076005 23514 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:15:46.080698 23514 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:15:46.080775 23514 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:15:46.080869 23514 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.129
I20260923 17:15:46.088622 23514 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:46333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.11.229.148:53875/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab
--principal=kudu/127.11.229.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.229.129
--webserver_port=0
--tserver_master_addrs=127.11.229.190:43325
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23514
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.129
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:15:46.089888 23514 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:15:46.090953 23514 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:15:46.102675 23521 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:15:46.102687 23522 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:15:46.103106 23524 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:15:46.103731 23514 server_base.cc:1034] running on GCE node
I20260923 17:15:46.104218 23514 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:15:46.105041 23514 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:15:46.106271 23514 hybrid_clock.cc:648] HybridClock initialized: now 1790183746106252 us; error 33 us; skew 500 ppm
Sep 23 17:15:46 dist-test-slave-1x1f krb5kdc[22957](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183746, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:15:46.109902 23514 init.cc:377] Logged in from keytab as kudu/127.11.229.129@KRBTEST.COM (short username kudu)
I20260923 17:15:46.110932 23514 webserver.cc:460] Webserver started at http://127.11.229.129:44709/ using document root <none> and password file <none>
I20260923 17:15:46.111601 23514 fs_manager.cc:359] Metadata directory not provided
I20260923 17:15:46.111681 23514 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:15:46.111879 23514 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 23 17:15:46 dist-test-slave-1x1f krb5kdc[22957](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183746, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.129@KRBTEST.COM for HTTP/127.11.229.148@KRBTEST.COM
I20260923 17:15:46.132395 23514 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-0/data/instance:
uuid: "4c7482fffec748ee8a65b60b778e5f7b"
format_stamp: "Formatted at 2026-09-23 17:15:46 on dist-test-slave-1x1f"
server_key: "ac88457b7adeb07a3b727b22aaae82de"
server_key_iv: "829b6f9aa1fbb5ad0f58de1b132fee0c"
server_key_version: "kuduclusterkey@0"
I20260923 17:15:46.133720 23514 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance:
uuid: "4c7482fffec748ee8a65b60b778e5f7b"
format_stamp: "Formatted at 2026-09-23 17:15:46 on dist-test-slave-1x1f"
server_key: "ac88457b7adeb07a3b727b22aaae82de"
server_key_iv: "829b6f9aa1fbb5ad0f58de1b132fee0c"
server_key_version: "kuduclusterkey@0"
I20260923 17:15:46.139122 23514 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260923 17:15:46.164566 23532 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:15:46.166007 23514 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 17:15:46.166163 23514 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-0/wal
uuid: "4c7482fffec748ee8a65b60b778e5f7b"
format_stamp: "Formatted at 2026-09-23 17:15:46 on dist-test-slave-1x1f"
server_key: "ac88457b7adeb07a3b727b22aaae82de"
server_key_iv: "829b6f9aa1fbb5ad0f58de1b132fee0c"
server_key_version: "kuduclusterkey@0"
I20260923 17:15:46.166338 23514 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:15:46.183797 23514 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:15:46.187449 23514 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:15:46.187629 23514 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:15:46.188333 23514 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:15:46.189355 23514 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:15:46.189419 23514 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:15:46.189496 23514 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:15:46.189530 23514 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:15:46.201447 23514 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.129:43155
I20260923 17:15:46.203904 23646 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.129:43155 every 8 connection(s)
I20260923 17:15:46.204424 23514 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
I20260923 17:15:46.206496 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 23514
I20260923 17:15:46.206610 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance
I20260923 17:15:46.206943 12182 external_mini_cluster.cc:1428] Setting key 86a26f5150f49a50115851088084a8f4
WARNING: no policy specified for kudu/127.11.229.130@KRBTEST.COM; defaulting to no policy
Sep 23 17:15:46 dist-test-slave-1x1f krb5kdc[22957](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183746, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.129@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:15:46.235780 23650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:15:46.208549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:45093 (local address 127.11.229.190:43325)
0923 17:15:46.216106 (+ 7557us) server_negotiation.cc:206] Beginning negotiation
0923 17:15:46.216110 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:15:46.216126 (+ 16us) server_negotiation.cc:407] Connection header received
0923 17:15:46.216168 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:15:46.216171 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:15:46.216220 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:15:46.216326 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:15:46.219706 (+ 3380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:15:46.220538 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:15:46.222296 (+ 1758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:15:46.222655 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:15:46.222761 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:15:46.230944 (+ 8183us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:15:46.230949 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:15:46.230952 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:15:46.230982 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:15:46.232887 (+ 1905us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:15:46.233539 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:15:46.233542 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:15:46.233544 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:15:46.233628 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:15:46.234027 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:15:46.234030 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:15:46.234032 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:15:46.234282 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:15:46.234365 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0923 17:15:46.235459 (+ 1094us) server_negotiation.cc:299] Negotiation successful
0923 17:15:46.235593 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7471,"thread_start_us":85,"threads_started":1}
I20260923 17:15:46.237959 23649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:15:46.207508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:43325 (local address 127.11.229.129:45093)
0923 17:15:46.214493 (+ 6985us) negotiation.cc:107] Waiting for socket to connect
0923 17:15:46.214566 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0923 17:15:46.215652 (+ 1086us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:15:46.218403 (+ 2751us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:15:46.218414 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:15:46.218789 (+ 375us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:15:46.219521 (+ 732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:15:46.219541 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:15:46.220688 (+ 1147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:15:46.220691 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:15:46.222112 (+ 1421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:15:46.222123 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:15:46.227840 (+ 5717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:15:46.227846 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:15:46.228082 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:15:46.228792 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:15:46.228813 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:15:46.230711 (+ 1898us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:15:46.233041 (+ 2330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:15:46.233047 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:15:46.233066 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:15:46.233418 (+ 352us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:15:46.233741 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:15:46.233744 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:15:46.233747 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:15:46.233921 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:15:46.234429 (+ 508us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:15:46.234436 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:15:46.234762 (+ 326us) client_negotiation.cc:769] Sending connection context
0923 17:15:46.236295 (+ 1533us) client_negotiation.cc:240] Negotiation successful
0923 17:15:46.236641 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6657,"thread_start_us":138,"threads_started":1}
I20260923 17:15:46.239794 23647 heartbeater.cc:347] Connected to a master server at 127.11.229.190:43325
I20260923 17:15:46.240022 23647 heartbeater.cc:464] Registering TS with master...
I20260923 17:15:46.240585 23647 heartbeater.cc:511] Master 127.11.229.190:43325 requested a full tablet report, sending...
I20260923 17:15:46.242424 23433 ts_manager.cc:194] Registered new tserver with Master: 4c7482fffec748ee8a65b60b778e5f7b (127.11.229.129:43155)
I20260923 17:15:46.243945 23433 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.129@KRBTEST.COM'} at 127.11.229.129:45093
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.130@KRBTEST.COM" created.
Sep 23 17:15:46 dist-test-slave-1x1f krb5kdc[22957](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790183746, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab.
Entry for principal kudu/127.11.229.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab.
I20260923 17:15:46.266281 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.229.148:53875/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.130:0
--local_ip_for_outbound_sockets=127.11.229.130
--webserver_interface=127.11.229.130
--webserver_port=0
--tserver_master_addrs=127.11.229.190:43325
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab
--principal=kudu/127.11.229.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:46333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:15:46.414674 23653 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:15:46.415107 23653 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:15:46.415212 23653 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:15:46.420369 23653 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:15:46.420431 23653 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:15:46.420521 23653 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.130
I20260923 17:15:46.426853 23653 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:46333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.11.229.148:53875/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab
--principal=kudu/127.11.229.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.229.130
--webserver_port=0
--tserver_master_addrs=127.11.229.190:43325
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23653
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.130
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:15:46.428138 23653 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:15:46.429389 23653 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:15:46.442581 23662 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:15:46.443240 23659 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:15:46.443863 23660 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:15:46.444737 23653 server_base.cc:1034] running on GCE node
I20260923 17:15:46.445289 23653 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:15:46.446202 23653 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:15:46.447490 23653 hybrid_clock.cc:648] HybridClock initialized: now 1790183746447469 us; error 35 us; skew 500 ppm
Sep 23 17:15:46 dist-test-slave-1x1f krb5kdc[22957](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183746, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:15:46.451144 23653 init.cc:377] Logged in from keytab as kudu/127.11.229.130@KRBTEST.COM (short username kudu)
I20260923 17:15:46.452301 23653 webserver.cc:460] Webserver started at http://127.11.229.130:43277/ using document root <none> and password file <none>
I20260923 17:15:46.452975 23653 fs_manager.cc:359] Metadata directory not provided
I20260923 17:15:46.453056 23653 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:15:46.453275 23653 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 23 17:15:46 dist-test-slave-1x1f krb5kdc[22957](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183746, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.130@KRBTEST.COM for HTTP/127.11.229.148@KRBTEST.COM
I20260923 17:15:46.470886 23653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-1/data/instance:
uuid: "df49f927cd714342b5fc478cbc87cbec"
format_stamp: "Formatted at 2026-09-23 17:15:46 on dist-test-slave-1x1f"
server_key: "9c353034f068652798390d5cd50e6e32"
server_key_iv: "1192956a83150e6a64529668a161dd2c"
server_key_version: "kuduclusterkey@0"
I20260923 17:15:46.471724 23653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance:
uuid: "df49f927cd714342b5fc478cbc87cbec"
format_stamp: "Formatted at 2026-09-23 17:15:46 on dist-test-slave-1x1f"
server_key: "9c353034f068652798390d5cd50e6e32"
server_key_iv: "1192956a83150e6a64529668a161dd2c"
server_key_version: "kuduclusterkey@0"
I20260923 17:15:46.477250 23653 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260923 17:15:46.506757 23669 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:15:46.508755 23653 fs_manager.cc:725] Time spent opening block manager: real 0.015s user 0.003s sys 0.001s
I20260923 17:15:46.508966 23653 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-1/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-1/wal
uuid: "df49f927cd714342b5fc478cbc87cbec"
format_stamp: "Formatted at 2026-09-23 17:15:46 on dist-test-slave-1x1f"
server_key: "9c353034f068652798390d5cd50e6e32"
server_key_iv: "1192956a83150e6a64529668a161dd2c"
server_key_version: "kuduclusterkey@0"
I20260923 17:15:46.509262 23653 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:15:46.547768 23653 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:15:46.551649 23653 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:15:46.551853 23653 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:15:46.552536 23653 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:15:46.553669 23653 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:15:46.553740 23653 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:15:46.553800 23653 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:15:46.553835 23653 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:15:46.565783 23653 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.130:42943
I20260923 17:15:46.566300 23782 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.130:42943 every 8 connection(s)
I20260923 17:15:46.567041 23653 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
I20260923 17:15:46.578593 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 23653
I20260923 17:15:46.578725 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance
I20260923 17:15:46.579010 12182 external_mini_cluster.cc:1428] Setting key b61f1a1eda424f0db2132776ff244418
Sep 23 17:15:46 dist-test-slave-1x1f krb5kdc[22957](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183746, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.130@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:15:46.597512 23650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:15:46.571428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:50065 (local address 127.11.229.190:43325)
0923 17:15:46.571571 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0923 17:15:46.571577 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 17:15:46.581428 (+ 9851us) server_negotiation.cc:407] Connection header received
0923 17:15:46.582853 (+ 1425us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:15:46.582857 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:15:46.582912 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:15:46.582970 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:15:46.584711 (+ 1741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:15:46.585509 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:15:46.588941 (+ 3432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:15:46.589298 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:15:46.589381 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:15:46.592583 (+ 3202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:15:46.592587 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:15:46.592590 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:15:46.592619 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:15:46.594606 (+ 1987us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:15:46.595272 (+ 666us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:15:46.595276 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:15:46.595278 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:15:46.595369 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:15:46.596184 (+ 815us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:15:46.596188 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:15:46.596190 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:15:46.596416 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:15:46.596501 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0923 17:15:46.597203 (+ 702us) server_negotiation.cc:299] Negotiation successful
0923 17:15:46.597338 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260923 17:15:46.599426 23785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:15:46.570198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:43325 (local address 127.11.229.130:50065)
0923 17:15:46.581232 (+ 11034us) negotiation.cc:107] Waiting for socket to connect
0923 17:15:46.581320 (+ 88us) client_negotiation.cc:174] Beginning negotiation
0923 17:15:46.582571 (+ 1251us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:15:46.583422 (+ 851us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:15:46.583433 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:15:46.583828 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:15:46.584539 (+ 711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:15:46.584558 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:15:46.586090 (+ 1532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:15:46.586094 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:15:46.588799 (+ 2705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:15:46.588810 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:15:46.589655 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:15:46.589660 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:15:46.589887 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:15:46.590581 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:15:46.590602 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:15:46.592375 (+ 1773us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:15:46.594758 (+ 2383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:15:46.594764 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:15:46.594795 (+ 31us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:15:46.595147 (+ 352us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:15:46.595873 (+ 726us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:15:46.595876 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:15:46.595879 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:15:46.596066 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:15:46.596572 (+ 506us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:15:46.596578 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:15:46.596915 (+ 337us) client_negotiation.cc:769] Sending connection context
0923 17:15:46.598003 (+ 1088us) client_negotiation.cc:240] Negotiation successful
0923 17:15:46.598381 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10726,"thread_start_us":167,"threads_started":1}
I20260923 17:15:46.600984 23783 heartbeater.cc:347] Connected to a master server at 127.11.229.190:43325
I20260923 17:15:46.601221 23783 heartbeater.cc:464] Registering TS with master...
I20260923 17:15:46.601773 23783 heartbeater.cc:511] Master 127.11.229.190:43325 requested a full tablet report, sending...
I20260923 17:15:46.602950 23433 ts_manager.cc:194] Registered new tserver with Master: df49f927cd714342b5fc478cbc87cbec (127.11.229.130:42943)
I20260923 17:15:46.603670 23433 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.130@KRBTEST.COM'} at 127.11.229.130:50065
WARNING: no policy specified for kudu/127.11.229.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab.
Entry for principal kudu/127.11.229.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab.
I20260923 17:15:46.662122 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.229.148:53875/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.131:0
--local_ip_for_outbound_sockets=127.11.229.131
--webserver_interface=127.11.229.131
--webserver_port=0
--tserver_master_addrs=127.11.229.190:43325
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab
--principal=kudu/127.11.229.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:46333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 23 17:15:46 dist-test-slave-1x1f krb5kdc[22957](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183746, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for HTTP/127.11.229.148@KRBTEST.COM
W20260923 17:15:46.838961 23788 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:15:46.839430 23788 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:15:46.839648 23788 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:15:46.846105 23788 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:15:46.846284 23788 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:15:46.846446 23788 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.131
I20260923 17:15:46.855252 23788 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:46333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.11.229.148:53875/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab
--principal=kudu/127.11.229.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.229.131
--webserver_port=0
--tserver_master_addrs=127.11.229.190:43325
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23788
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.131
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:15:46.856918 23788 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:15:46.858440 23788 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:15:46.876760 23796 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:15:46.876739 23794 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:15:46.877609 23793 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:15:46.878914 23788 server_base.cc:1034] running on GCE node
I20260923 17:15:46.879422 23788 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:15:46.880303 23788 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:15:46.881605 23788 hybrid_clock.cc:648] HybridClock initialized: now 1790183746881537 us; error 82 us; skew 500 ppm
Sep 23 17:15:46 dist-test-slave-1x1f krb5kdc[22957](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183746, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:15:46.885456 23788 init.cc:377] Logged in from keytab as kudu/127.11.229.131@KRBTEST.COM (short username kudu)
I20260923 17:15:46.886636 23788 webserver.cc:460] Webserver started at http://127.11.229.131:42277/ using document root <none> and password file <none>
I20260923 17:15:46.887467 23788 fs_manager.cc:359] Metadata directory not provided
I20260923 17:15:46.887632 23788 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:15:46.887944 23788 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 23 17:15:46 dist-test-slave-1x1f krb5kdc[22957](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183746, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.131@KRBTEST.COM for HTTP/127.11.229.148@KRBTEST.COM
I20260923 17:15:46.903345 23788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-2/data/instance:
uuid: "65c354b7cced46a984928ed323b24613"
format_stamp: "Formatted at 2026-09-23 17:15:46 on dist-test-slave-1x1f"
server_key: "d7df819371029047a76e3229441caa3e"
server_key_iv: "a73ff612127c7a30856a94d8a36e6e90"
server_key_version: "kuduclusterkey@0"
I20260923 17:15:46.904147 23788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance:
uuid: "65c354b7cced46a984928ed323b24613"
format_stamp: "Formatted at 2026-09-23 17:15:46 on dist-test-slave-1x1f"
server_key: "d7df819371029047a76e3229441caa3e"
server_key_iv: "a73ff612127c7a30856a94d8a36e6e90"
server_key_version: "kuduclusterkey@0"
I20260923 17:15:46.913194 23788 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.006s sys 0.000s
I20260923 17:15:46.927806 23803 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:15:46.929240 23788 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260923 17:15:46.929386 23788 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-2/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-2/wal
uuid: "65c354b7cced46a984928ed323b24613"
format_stamp: "Formatted at 2026-09-23 17:15:46 on dist-test-slave-1x1f"
server_key: "d7df819371029047a76e3229441caa3e"
server_key_iv: "a73ff612127c7a30856a94d8a36e6e90"
server_key_version: "kuduclusterkey@0"
I20260923 17:15:46.929533 23788 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:15:46.946888 23788 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:15:46.950646 23788 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:15:46.950837 23788 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:15:46.951512 23788 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:15:46.952494 23788 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:15:46.952559 23788 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:15:46.952623 23788 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:15:46.952652 23788 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:15:46.964499 23788 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.131:39221
I20260923 17:15:46.964689 23916 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.131:39221 every 8 connection(s)
I20260923 17:15:46.965854 23788 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
I20260923 17:15:46.975294 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 23788
I20260923 17:15:46.975440 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance
I20260923 17:15:46.975773 12182 external_mini_cluster.cc:1428] Setting key fdf5abb95b28ba6d8d4418036e368014
Sep 23 17:15:46 dist-test-slave-1x1f krb5kdc[22957](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183746, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.131@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:15:46.984603 23650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:15:46.969766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:38753 (local address 127.11.229.190:43325)
0923 17:15:46.969917 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0923 17:15:46.969923 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 17:15:46.969943 (+ 20us) server_negotiation.cc:407] Connection header received
0923 17:15:46.971319 (+ 1376us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:15:46.971324 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:15:46.971385 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:15:46.971493 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:15:46.972988 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:15:46.973929 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:15:46.975633 (+ 1704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:15:46.975969 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:15:46.976045 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:15:46.980138 (+ 4093us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:15:46.980142 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:15:46.980145 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:15:46.980174 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:15:46.981933 (+ 1759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:15:46.982690 (+ 757us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:15:46.982696 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:15:46.982700 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:15:46.982797 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:15:46.983255 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:15:46.983257 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:15:46.983259 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:15:46.983486 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:15:46.983590 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0923 17:15:46.984306 (+ 716us) server_negotiation.cc:299] Negotiation successful
0923 17:15:46.984439 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260923 17:15:46.985852 23919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:15:46.968590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:43325 (local address 127.11.229.131:38753)
0923 17:15:46.969205 (+ 615us) negotiation.cc:107] Waiting for socket to connect
0923 17:15:46.969274 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0923 17:15:46.970949 (+ 1675us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:15:46.971705 (+ 756us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:15:46.971714 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:15:46.972062 (+ 348us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:15:46.972809 (+ 747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:15:46.972828 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:15:46.974086 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:15:46.974089 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:15:46.975487 (+ 1398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:15:46.975499 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:15:46.976332 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:15:46.976336 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:15:46.976706 (+ 370us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:15:46.977413 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:15:46.977434 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:15:46.979940 (+ 2506us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:15:46.982075 (+ 2135us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:15:46.982083 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:15:46.982102 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:15:46.982555 (+ 453us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:15:46.982915 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:15:46.982918 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:15:46.982921 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:15:46.983136 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:15:46.983610 (+ 474us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:15:46.983618 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:15:46.983983 (+ 365us) client_negotiation.cc:769] Sending connection context
0923 17:15:46.984207 (+ 224us) client_negotiation.cc:240] Negotiation successful
0923 17:15:46.984580 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":165,"threads_started":1}
I20260923 17:15:46.987919 23917 heartbeater.cc:347] Connected to a master server at 127.11.229.190:43325
I20260923 17:15:46.988184 23917 heartbeater.cc:464] Registering TS with master...
I20260923 17:15:46.988808 23917 heartbeater.cc:511] Master 127.11.229.190:43325 requested a full tablet report, sending...
I20260923 17:15:46.990017 23433 ts_manager.cc:194] Registered new tserver with Master: 65c354b7cced46a984928ed323b24613 (127.11.229.131:39221)
I20260923 17:15:46.990895 23433 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.131@KRBTEST.COM'} at 127.11.229.131:38753
I20260923 17:15:46.991277 12182 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 17:15:47.008270 23650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:15:46.993759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47080 (local address 127.11.229.190:43325)
0923 17:15:46.995724 (+ 1965us) server_negotiation.cc:206] Beginning negotiation
0923 17:15:46.995729 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:15:46.998604 (+ 2875us) server_negotiation.cc:407] Connection header received
0923 17:15:46.998774 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:15:46.998777 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:15:46.998832 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:15:46.998927 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:15:46.999946 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:15:47.000776 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:15:47.002065 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:15:47.002418 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:15:47.002524 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:15:47.004378 (+ 1854us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:15:47.004382 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:15:47.004385 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:15:47.004413 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:15:47.006325 (+ 1912us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:15:47.006864 (+ 539us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:15:47.006870 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:15:47.006872 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:15:47.006959 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:15:47.007300 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:15:47.007303 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:15:47.007305 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:15:47.007518 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:15:47.007647 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0923 17:15:47.007948 (+ 301us) server_negotiation.cc:299] Negotiation successful
0923 17:15:47.008091 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1877}
I20260923 17:15:47.011755 23433 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47080:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 17:15:47.016209 23433 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 17:15:47.037091 23933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:15:47.027091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.130:42943 (local address 127.0.0.1:42404)
0923 17:15:47.029005 (+ 1914us) negotiation.cc:107] Waiting for socket to connect
0923 17:15:47.029056 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0923 17:15:47.029185 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:15:47.030932 (+ 1747us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:15:47.030937 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:15:47.030958 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:15:47.031065 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:15:47.031072 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:15:47.032739 (+ 1667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:15:47.032743 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:15:47.034861 (+ 2118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:15:47.034870 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:15:47.036473 (+ 1603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:15:47.036477 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:15:47.036605 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:15:47.036646 (+ 41us) client_negotiation.cc:769] Sending connection context
0923 17:15:47.036782 (+ 136us) client_negotiation.cc:240] Negotiation successful
0923 17:15:47.036916 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1734,"mutex_wait_us":18,"thread_start_us":107,"threads_started":1}
I20260923 17:15:47.037439 23932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:15:47.028025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36638 (local address 127.11.229.129:43155)
0923 17:15:47.028395 (+ 370us) server_negotiation.cc:206] Beginning negotiation
0923 17:15:47.028402 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 17:15:47.029548 (+ 1146us) server_negotiation.cc:407] Connection header received
0923 17:15:47.029637 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:15:47.029643 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:15:47.029840 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:15:47.029983 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:15:47.030471 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:15:47.031589 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:15:47.035788 (+ 4199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:15:47.036563 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:15:47.036656 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:15:47.036767 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0923 17:15:47.037174 (+ 407us) server_negotiation.cc:299] Negotiation successful
0923 17:15:47.037285 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":276,"thread_start_us":107,"threads_started":1}
I20260923 17:15:47.038116 23930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:15:47.027226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42404 (local address 127.11.229.130:42943)
0923 17:15:47.030043 (+ 2817us) server_negotiation.cc:206] Beginning negotiation
0923 17:15:47.030058 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0923 17:15:47.030080 (+ 22us) server_negotiation.cc:407] Connection header received
0923 17:15:47.030153 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:15:47.030158 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:15:47.030363 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:15:47.031224 (+ 861us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:15:47.031365 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:15:47.032574 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:15:47.035207 (+ 2633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:15:47.036118 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:15:47.036251 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:15:47.036402 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0923 17:15:47.037792 (+ 1390us) server_negotiation.cc:299] Negotiation successful
0923 17:15:47.037943 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2715,"thread_start_us":65,"threads_started":1}
I20260923 17:15:47.039086 23931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:15:47.027868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:43155 (local address 127.0.0.1:36638)
0923 17:15:47.029422 (+ 1554us) negotiation.cc:107] Waiting for socket to connect
0923 17:15:47.029436 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 17:15:47.029533 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:15:47.030139 (+ 606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:15:47.030146 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:15:47.030167 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:15:47.030341 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:15:47.030348 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:15:47.032203 (+ 1855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:15:47.032206 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:15:47.035646 (+ 3440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:15:47.035655 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:15:47.036863 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:15:47.036868 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:15:47.036971 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:15:47.036991 (+ 20us) client_negotiation.cc:769] Sending connection context
0923 17:15:47.038871 (+ 1880us) client_negotiation.cc:240] Negotiation successful
0923 17:15:47.038953 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1490,"mutex_wait_us":1,"thread_start_us":97,"threads_started":1}
I20260923 17:15:47.041240 23717 tablet_service.cc:1467] Processing CreateTablet for tablet efc449133d4d417491e6279b57edddc7 (DEFAULT_TABLE table=test-table [id=91b0ebecc9754e44812c90cd37641d6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:15:47.042430 23717 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet efc449133d4d417491e6279b57edddc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:15:47.042441 23929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:15:47.028196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.131:39221 (local address 127.0.0.1:56582)
0923 17:15:47.029720 (+ 1524us) negotiation.cc:107] Waiting for socket to connect
0923 17:15:47.029733 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 17:15:47.029818 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:15:47.033577 (+ 3759us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:15:47.033580 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:15:47.033598 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:15:47.033682 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:15:47.033687 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:15:47.039187 (+ 5500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:15:47.039191 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:15:47.040450 (+ 1259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:15:47.040462 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:15:47.041787 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:15:47.041793 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:15:47.042049 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:15:47.042081 (+ 32us) client_negotiation.cc:769] Sending connection context
0923 17:15:47.042160 (+ 79us) client_negotiation.cc:240] Negotiation successful
0923 17:15:47.042269 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1456,"thread_start_us":85,"threads_started":1}
I20260923 17:15:47.043148 23934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:15:47.028679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56582 (local address 127.11.229.131:39221)
0923 17:15:47.029062 (+ 383us) server_negotiation.cc:206] Beginning negotiation
0923 17:15:47.029072 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 17:15:47.032993 (+ 3921us) server_negotiation.cc:407] Connection header received
0923 17:15:47.033080 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:15:47.033086 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:15:47.033281 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:15:47.033432 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:15:47.033827 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:15:47.035048 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:15:47.040658 (+ 5610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:15:47.041584 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:15:47.041747 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:15:47.041889 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0923 17:15:47.042909 (+ 1020us) server_negotiation.cc:299] Negotiation successful
0923 17:15:47.043014 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":131,"threads_started":1}
I20260923 17:15:47.046142 23843 tablet_service.cc:1467] Processing CreateTablet for tablet efc449133d4d417491e6279b57edddc7 (DEFAULT_TABLE table=test-table [id=91b0ebecc9754e44812c90cd37641d6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:15:47.047271 23843 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet efc449133d4d417491e6279b57edddc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:15:47.048287 23574 tablet_service.cc:1467] Processing CreateTablet for tablet efc449133d4d417491e6279b57edddc7 (DEFAULT_TABLE table=test-table [id=91b0ebecc9754e44812c90cd37641d6f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:15:47.049244 23574 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet efc449133d4d417491e6279b57edddc7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:15:47.056923 23937 tablet_bootstrap.cc:492] T efc449133d4d417491e6279b57edddc7 P 4c7482fffec748ee8a65b60b778e5f7b: Bootstrap starting.
I20260923 17:15:47.058602 23936 tablet_bootstrap.cc:492] T efc449133d4d417491e6279b57edddc7 P df49f927cd714342b5fc478cbc87cbec: Bootstrap starting.
I20260923 17:15:47.059062 23937 tablet_bootstrap.cc:654] T efc449133d4d417491e6279b57edddc7 P 4c7482fffec748ee8a65b60b778e5f7b: Neither blocks nor log segments found. Creating new log.
I20260923 17:15:47.060032 23937 log.cc:824] T efc449133d4d417491e6279b57edddc7 P 4c7482fffec748ee8a65b60b778e5f7b: Log is configured to *not* fsync() on all Append() calls
I20260923 17:15:47.062165 23936 tablet_bootstrap.cc:654] T efc449133d4d417491e6279b57edddc7 P df49f927cd714342b5fc478cbc87cbec: Neither blocks nor log segments found. Creating new log.
I20260923 17:15:47.062506 23937 tablet_bootstrap.cc:492] T efc449133d4d417491e6279b57edddc7 P 4c7482fffec748ee8a65b60b778e5f7b: No bootstrap required, opened a new log
I20260923 17:15:47.062698 23937 ts_tablet_manager.cc:1397] T efc449133d4d417491e6279b57edddc7 P 4c7482fffec748ee8a65b60b778e5f7b: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260923 17:15:47.063068 23936 log.cc:824] T efc449133d4d417491e6279b57edddc7 P df49f927cd714342b5fc478cbc87cbec: Log is configured to *not* fsync() on all Append() calls
I20260923 17:15:47.064713 23935 tablet_bootstrap.cc:492] T efc449133d4d417491e6279b57edddc7 P 65c354b7cced46a984928ed323b24613: Bootstrap starting.
I20260923 17:15:47.067117 23937 raft_consensus.cc:348] T efc449133d4d417491e6279b57edddc7 P 4c7482fffec748ee8a65b60b778e5f7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df49f927cd714342b5fc478cbc87cbec" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42943 } } peers { permanent_uuid: "4c7482fffec748ee8a65b60b778e5f7b" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 43155 } } peers { permanent_uuid: "65c354b7cced46a984928ed323b24613" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39221 } }
I20260923 17:15:47.067482 23937 raft_consensus.cc:374] T efc449133d4d417491e6279b57edddc7 P 4c7482fffec748ee8a65b60b778e5f7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:15:47.067484 23935 tablet_bootstrap.cc:654] T efc449133d4d417491e6279b57edddc7 P 65c354b7cced46a984928ed323b24613: Neither blocks nor log segments found. Creating new log.
I20260923 17:15:47.067541 23937 raft_consensus.cc:729] T efc449133d4d417491e6279b57edddc7 P 4c7482fffec748ee8a65b60b778e5f7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c7482fffec748ee8a65b60b778e5f7b, State: Initialized, Role: FOLLOWER
I20260923 17:15:47.068252 23937 consensus_queue.cc:260] T efc449133d4d417491e6279b57edddc7 P 4c7482fffec748ee8a65b60b778e5f7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df49f927cd714342b5fc478cbc87cbec" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42943 } } peers { permanent_uuid: "4c7482fffec748ee8a65b60b778e5f7b" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 43155 } } peers { permanent_uuid: "65c354b7cced46a984928ed323b24613" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39221 } }
I20260923 17:15:47.069489 23937 ts_tablet_manager.cc:1428] T efc449133d4d417491e6279b57edddc7 P 4c7482fffec748ee8a65b60b778e5f7b: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260923 17:15:47.069571 23935 log.cc:824] T efc449133d4d417491e6279b57edddc7 P 65c354b7cced46a984928ed323b24613: Log is configured to *not* fsync() on all Append() calls
I20260923 17:15:47.069957 23647 heartbeater.cc:503] Master 127.11.229.190:43325 was elected leader, sending a full tablet report...
I20260923 17:15:47.071879 23935 tablet_bootstrap.cc:492] T efc449133d4d417491e6279b57edddc7 P 65c354b7cced46a984928ed323b24613: No bootstrap required, opened a new log
I20260923 17:15:47.071880 23936 tablet_bootstrap.cc:492] T efc449133d4d417491e6279b57edddc7 P df49f927cd714342b5fc478cbc87cbec: No bootstrap required, opened a new log
I20260923 17:15:47.072070 23936 ts_tablet_manager.cc:1397] T efc449133d4d417491e6279b57edddc7 P df49f927cd714342b5fc478cbc87cbec: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.004s
I20260923 17:15:47.072070 23935 ts_tablet_manager.cc:1397] T efc449133d4d417491e6279b57edddc7 P 65c354b7cced46a984928ed323b24613: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260923 17:15:47.076421 23935 raft_consensus.cc:348] T efc449133d4d417491e6279b57edddc7 P 65c354b7cced46a984928ed323b24613 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df49f927cd714342b5fc478cbc87cbec" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42943 } } peers { permanent_uuid: "4c7482fffec748ee8a65b60b778e5f7b" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 43155 } } peers { permanent_uuid: "65c354b7cced46a984928ed323b24613" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39221 } }
I20260923 17:15:47.076421 23936 raft_consensus.cc:348] T efc449133d4d417491e6279b57edddc7 P df49f927cd714342b5fc478cbc87cbec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df49f927cd714342b5fc478cbc87cbec" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42943 } } peers { permanent_uuid: "4c7482fffec748ee8a65b60b778e5f7b" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 43155 } } peers { permanent_uuid: "65c354b7cced46a984928ed323b24613" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39221 } }
I20260923 17:15:47.076680 23936 raft_consensus.cc:374] T efc449133d4d417491e6279b57edddc7 P df49f927cd714342b5fc478cbc87cbec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:15:47.076680 23935 raft_consensus.cc:374] T efc449133d4d417491e6279b57edddc7 P 65c354b7cced46a984928ed323b24613 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:15:47.076730 23935 raft_consensus.cc:729] T efc449133d4d417491e6279b57edddc7 P 65c354b7cced46a984928ed323b24613 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65c354b7cced46a984928ed323b24613, State: Initialized, Role: FOLLOWER
I20260923 17:15:47.076738 23936 raft_consensus.cc:729] T efc449133d4d417491e6279b57edddc7 P df49f927cd714342b5fc478cbc87cbec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df49f927cd714342b5fc478cbc87cbec, State: Initialized, Role: FOLLOWER
I20260923 17:15:47.077473 23935 consensus_queue.cc:260] T efc449133d4d417491e6279b57edddc7 P 65c354b7cced46a984928ed323b24613 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df49f927cd714342b5fc478cbc87cbec" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42943 } } peers { permanent_uuid: "4c7482fffec748ee8a65b60b778e5f7b" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 43155 } } peers { permanent_uuid: "65c354b7cced46a984928ed323b24613" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39221 } }
I20260923 17:15:47.079568 23935 ts_tablet_manager.cc:1428] T efc449133d4d417491e6279b57edddc7 P 65c354b7cced46a984928ed323b24613: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260923 17:15:47.079661 23936 consensus_queue.cc:260] T efc449133d4d417491e6279b57edddc7 P df49f927cd714342b5fc478cbc87cbec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df49f927cd714342b5fc478cbc87cbec" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42943 } } peers { permanent_uuid: "4c7482fffec748ee8a65b60b778e5f7b" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 43155 } } peers { permanent_uuid: "65c354b7cced46a984928ed323b24613" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39221 } }
I20260923 17:15:47.080018 23917 heartbeater.cc:503] Master 127.11.229.190:43325 was elected leader, sending a full tablet report...
I20260923 17:15:47.080597 23936 ts_tablet_manager.cc:1428] T efc449133d4d417491e6279b57edddc7 P df49f927cd714342b5fc478cbc87cbec: Time spent starting tablet: real 0.008s user 0.005s sys 0.002s
I20260923 17:15:47.080904 23783 heartbeater.cc:503] Master 127.11.229.190:43325 was elected leader, sending a full tablet report...
Sep 23 17:15:47 dist-test-slave-1x1f krb5kdc[22957](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183746, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for HTTP/127.11.229.148@KRBTEST.COM
I20260923 17:15:47.178531 23939 raft_consensus.cc:482] T efc449133d4d417491e6279b57edddc7 P 4c7482fffec748ee8a65b60b778e5f7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 17:15:47.178791 23939 raft_consensus.cc:504] T efc449133d4d417491e6279b57edddc7 P 4c7482fffec748ee8a65b60b778e5f7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df49f927cd714342b5fc478cbc87cbec" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42943 } } peers { permanent_uuid: "4c7482fffec748ee8a65b60b778e5f7b" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 43155 } } peers { permanent_uuid: "65c354b7cced46a984928ed323b24613" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39221 } }
I20260923 17:15:47.180022 23939 leader_election.cc:288] T efc449133d4d417491e6279b57edddc7 P 4c7482fffec748ee8a65b60b778e5f7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df49f927cd714342b5fc478cbc87cbec (127.11.229.130:42943), 65c354b7cced46a984928ed323b24613 (127.11.229.131:39221)
I20260923 17:15:47.189208 23934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:15:47.180836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:43545 (local address 127.11.229.131:39221)
0923 17:15:47.180966 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0923 17:15:47.180971 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:15:47.183299 (+ 2328us) server_negotiation.cc:407] Connection header received
0923 17:15:47.183527 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:15:47.183533 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:15:47.183590 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:15:47.183636 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:15:47.184471 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:15:47.185132 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:15:47.187743 (+ 2611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:15:47.188345 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:15:47.188440 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:15:47.188495 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0923 17:15:47.188982 (+ 487us) server_negotiation.cc:299] Negotiation successful
0923 17:15:47.189062 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260923 17:15:47.189862 23946 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:15:47.180282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.131:39221 (local address 127.11.229.129:43545)
0923 17:15:47.183212 (+ 2930us) negotiation.cc:107] Waiting for socket to connect
0923 17:15:47.183226 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 17:15:47.183397 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:15:47.184222 (+ 825us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:15:47.184225 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:15:47.184243 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:15:47.184355 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:15:47.184361 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:15:47.185929 (+ 1568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:15:47.185932 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:15:47.187106 (+ 1174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:15:47.187117 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:15:47.188738 (+ 1621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:15:47.188741 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:15:47.188843 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:15:47.188866 (+ 23us) client_negotiation.cc:769] Sending connection context
0923 17:15:47.189417 (+ 551us) client_negotiation.cc:240] Negotiation successful
0923 17:15:47.189693 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2867,"thread_start_us":78,"threads_started":1}
I20260923 17:15:47.190893 23943 raft_consensus.cc:482] T efc449133d4d417491e6279b57edddc7 P df49f927cd714342b5fc478cbc87cbec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 17:15:47.191074 23943 raft_consensus.cc:504] T efc449133d4d417491e6279b57edddc7 P df49f927cd714342b5fc478cbc87cbec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df49f927cd714342b5fc478cbc87cbec" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42943 } } peers { permanent_uuid: "4c7482fffec748ee8a65b60b778e5f7b" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 43155 } } peers { permanent_uuid: "65c354b7cced46a984928ed323b24613" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39221 } }
I20260923 17:15:47.192111 23866 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efc449133d4d417491e6279b57edddc7" candidate_uuid: "4c7482fffec748ee8a65b60b778e5f7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c354b7cced46a984928ed323b24613" is_pre_election: true
I20260923 17:15:47.192401 23943 leader_election.cc:288] T efc449133d4d417491e6279b57edddc7 P df49f927cd714342b5fc478cbc87cbec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c7482fffec748ee8a65b60b778e5f7b (127.11.229.129:43155), 65c354b7cced46a984928ed323b24613 (127.11.229.131:39221)
I20260923 17:15:47.192426 23866 raft_consensus.cc:2454] T efc449133d4d417491e6279b57edddc7 P 65c354b7cced46a984928ed323b24613 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c7482fffec748ee8a65b60b778e5f7b in term 0.
I20260923 17:15:47.194031 23930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:15:47.180696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:47281 (local address 127.11.229.130:42943)
0923 17:15:47.180858 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0923 17:15:47.180864 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 17:15:47.182543 (+ 1679us) server_negotiation.cc:407] Connection header received
0923 17:15:47.182771 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:15:47.182774 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:15:47.182823 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:15:47.182874 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:15:47.183804 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:15:47.184534 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:15:47.188429 (+ 3895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:15:47.189072 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:15:47.189155 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:15:47.189197 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0923 17:15:47.193828 (+ 4631us) server_negotiation.cc:299] Negotiation successful
0923 17:15:47.193912 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260923 17:15:47.194422 23947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:15:47.180204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.130:42943 (local address 127.11.229.129:47281)
0923 17:15:47.182448 (+ 2244us) negotiation.cc:107] Waiting for socket to connect
0923 17:15:47.182470 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0923 17:15:47.182621 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:15:47.183027 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:15:47.183029 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:15:47.183049 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:15:47.183684 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:15:47.183692 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:15:47.185248 (+ 1556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:15:47.185251 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:15:47.188262 (+ 3011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:15:47.188273 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:15:47.189619 (+ 1346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:15:47.189623 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:15:47.193670 (+ 4047us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:15:47.193700 (+ 30us) client_negotiation.cc:769] Sending connection context
0923 17:15:47.194132 (+ 432us) client_negotiation.cc:240] Negotiation successful
0923 17:15:47.194245 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2165,"thread_start_us":117,"threads_started":1}
I20260923 17:15:47.195070 23534 leader_election.cc:302] T efc449133d4d417491e6279b57edddc7 P 4c7482fffec748ee8a65b60b778e5f7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c7482fffec748ee8a65b60b778e5f7b, 65c354b7cced46a984928ed323b24613; no voters:
I20260923 17:15:47.195355 23939 raft_consensus.cc:2781] T efc449133d4d417491e6279b57edddc7 P 4c7482fffec748ee8a65b60b778e5f7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 17:15:47.195444 23939 raft_consensus.cc:482] T efc449133d4d417491e6279b57edddc7 P 4c7482fffec748ee8a65b60b778e5f7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 17:15:47.195506 23939 raft_consensus.cc:3037] T efc449133d4d417491e6279b57edddc7 P 4c7482fffec748ee8a65b60b778e5f7b [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:15:47.195847 23731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efc449133d4d417491e6279b57edddc7" candidate_uuid: "4c7482fffec748ee8a65b60b778e5f7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df49f927cd714342b5fc478cbc87cbec" is_pre_election: true
I20260923 17:15:47.196024 23731 raft_consensus.cc:2454] T efc449133d4d417491e6279b57edddc7 P df49f927cd714342b5fc478cbc87cbec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c7482fffec748ee8a65b60b778e5f7b in term 0.
I20260923 17:15:47.196877 23939 raft_consensus.cc:504] T efc449133d4d417491e6279b57edddc7 P 4c7482fffec748ee8a65b60b778e5f7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df49f927cd714342b5fc478cbc87cbec" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42943 } } peers { permanent_uuid: "4c7482fffec748ee8a65b60b778e5f7b" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 43155 } } peers { permanent_uuid: "65c354b7cced46a984928ed323b24613" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39221 } }
I20260923 17:15:47.197227 23939 leader_election.cc:288] T efc449133d4d417491e6279b57edddc7 P 4c7482fffec748ee8a65b60b778e5f7b [CANDIDATE]: Term 1 election: Requested vote from peers df49f927cd714342b5fc478cbc87cbec (127.11.229.130:42943), 65c354b7cced46a984928ed323b24613 (127.11.229.131:39221)
I20260923 17:15:47.197820 23731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efc449133d4d417491e6279b57edddc7" candidate_uuid: "4c7482fffec748ee8a65b60b778e5f7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df49f927cd714342b5fc478cbc87cbec"
I20260923 17:15:47.197820 23866 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efc449133d4d417491e6279b57edddc7" candidate_uuid: "4c7482fffec748ee8a65b60b778e5f7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c354b7cced46a984928ed323b24613"
I20260923 17:15:47.197935 23731 raft_consensus.cc:3037] T efc449133d4d417491e6279b57edddc7 P df49f927cd714342b5fc478cbc87cbec [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:15:47.197937 23866 raft_consensus.cc:3037] T efc449133d4d417491e6279b57edddc7 P 65c354b7cced46a984928ed323b24613 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:15:47.199153 23866 raft_consensus.cc:2454] T efc449133d4d417491e6279b57edddc7 P 65c354b7cced46a984928ed323b24613 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c7482fffec748ee8a65b60b778e5f7b in term 1.
I20260923 17:15:47.199152 23731 raft_consensus.cc:2454] T efc449133d4d417491e6279b57edddc7 P df49f927cd714342b5fc478cbc87cbec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c7482fffec748ee8a65b60b778e5f7b in term 1.
I20260923 17:15:47.199481 23535 leader_election.cc:302] T efc449133d4d417491e6279b57edddc7 P 4c7482fffec748ee8a65b60b778e5f7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c7482fffec748ee8a65b60b778e5f7b, df49f927cd714342b5fc478cbc87cbec; no voters:
I20260923 17:15:47.201261 23939 raft_consensus.cc:2781] T efc449133d4d417491e6279b57edddc7 P 4c7482fffec748ee8a65b60b778e5f7b [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:15:47.201527 23939 raft_consensus.cc:686] T efc449133d4d417491e6279b57edddc7 P 4c7482fffec748ee8a65b60b778e5f7b [term 1 LEADER]: Becoming Leader. State: Replica: 4c7482fffec748ee8a65b60b778e5f7b, State: Running, Role: LEADER
I20260923 17:15:47.201882 23939 consensus_queue.cc:237] T efc449133d4d417491e6279b57edddc7 P 4c7482fffec748ee8a65b60b778e5f7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df49f927cd714342b5fc478cbc87cbec" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42943 } } peers { permanent_uuid: "4c7482fffec748ee8a65b60b778e5f7b" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 43155 } } peers { permanent_uuid: "65c354b7cced46a984928ed323b24613" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39221 } }
W20260923 17:15:47.206091 23648 tablet.cc:2369] T efc449133d4d417491e6279b57edddc7 P 4c7482fffec748ee8a65b60b778e5f7b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 17:15:47.207736 23932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:15:47.194678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:58497 (local address 127.11.229.129:43155)
0923 17:15:47.194802 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0923 17:15:47.194808 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 17:15:47.196790 (+ 1982us) server_negotiation.cc:407] Connection header received
0923 17:15:47.203637 (+ 6847us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:15:47.203640 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:15:47.203691 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:15:47.203741 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:15:47.204155 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:15:47.204930 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:15:47.206446 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:15:47.207035 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:15:47.207127 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:15:47.207203 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0923 17:15:47.207552 (+ 349us) server_negotiation.cc:299] Negotiation successful
0923 17:15:47.207629 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260923 17:15:47.208144 23948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:15:47.193711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:43155 (local address 127.11.229.130:58497)
0923 17:15:47.196706 (+ 2995us) negotiation.cc:107] Waiting for socket to connect
0923 17:15:47.196724 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 17:15:47.196872 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:15:47.203886 (+ 7014us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:15:47.203889 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:15:47.203909 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:15:47.204035 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:15:47.204041 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:15:47.205066 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:15:47.205069 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:15:47.206297 (+ 1228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:15:47.206311 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:15:47.207304 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:15:47.207308 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:15:47.207416 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:15:47.207438 (+ 22us) client_negotiation.cc:769] Sending connection context
0923 17:15:47.207911 (+ 473us) client_negotiation.cc:240] Negotiation successful
0923 17:15:47.207992 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2906,"thread_start_us":112,"threads_started":1}
I20260923 17:15:47.208710 23601 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efc449133d4d417491e6279b57edddc7" candidate_uuid: "df49f927cd714342b5fc478cbc87cbec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c7482fffec748ee8a65b60b778e5f7b" is_pre_election: true
I20260923 17:15:47.212320 23433 catalog_manager.cc:5495] T efc449133d4d417491e6279b57edddc7 P 4c7482fffec748ee8a65b60b778e5f7b reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c7482fffec748ee8a65b60b778e5f7b (127.11.229.129). New cstate: current_term: 1 leader_uuid: "4c7482fffec748ee8a65b60b778e5f7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df49f927cd714342b5fc478cbc87cbec" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42943 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c7482fffec748ee8a65b60b778e5f7b" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 43155 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65c354b7cced46a984928ed323b24613" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39221 } health_report { overall_health: UNKNOWN } } }
I20260923 17:15:47.212879 23934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:15:47.194465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:36375 (local address 127.11.229.131:39221)
0923 17:15:47.194908 (+ 443us) server_negotiation.cc:206] Beginning negotiation
0923 17:15:47.194913 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:15:47.208657 (+ 13744us) server_negotiation.cc:407] Connection header received
0923 17:15:47.208820 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:15:47.208824 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:15:47.208882 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:15:47.208925 (+ 43us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:15:47.209230 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:15:47.209996 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:15:47.211666 (+ 1670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:15:47.212213 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:15:47.212309 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:15:47.212364 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0923 17:15:47.212673 (+ 309us) server_negotiation.cc:299] Negotiation successful
0923 17:15:47.212751 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356}
I20260923 17:15:47.213228 23948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:15:47.194100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.131:39221 (local address 127.11.229.130:36375)
0923 17:15:47.208584 (+ 14484us) negotiation.cc:107] Waiting for socket to connect
0923 17:15:47.208598 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 17:15:47.208720 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:15:47.209037 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:15:47.209040 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:15:47.209053 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:15:47.209118 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:15:47.209122 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:15:47.210496 (+ 1374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:15:47.210499 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:15:47.211531 (+ 1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:15:47.211543 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:15:47.212456 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:15:47.212459 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:15:47.212543 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:15:47.212564 (+ 21us) client_negotiation.cc:769] Sending connection context
0923 17:15:47.213040 (+ 476us) client_negotiation.cc:240] Negotiation successful
0923 17:15:47.213111 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14427,"thread_start_us":1249,"threads_started":1}
I20260923 17:15:47.213635 23866 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efc449133d4d417491e6279b57edddc7" candidate_uuid: "df49f927cd714342b5fc478cbc87cbec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65c354b7cced46a984928ed323b24613" is_pre_election: true
I20260923 17:15:47.213819 23866 raft_consensus.cc:2379] T efc449133d4d417491e6279b57edddc7 P 65c354b7cced46a984928ed323b24613 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate df49f927cd714342b5fc478cbc87cbec in current term 1: Already voted for candidate 4c7482fffec748ee8a65b60b778e5f7b in this term.
I20260923 17:15:47.214309 23670 leader_election.cc:302] T efc449133d4d417491e6279b57edddc7 P df49f927cd714342b5fc478cbc87cbec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df49f927cd714342b5fc478cbc87cbec; no voters: 4c7482fffec748ee8a65b60b778e5f7b, 65c354b7cced46a984928ed323b24613
I20260923 17:15:47.214761 23943 raft_consensus.cc:2726] T efc449133d4d417491e6279b57edddc7 P df49f927cd714342b5fc478cbc87cbec [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 17:15:47.218029 23918 tablet.cc:2369] T efc449133d4d417491e6279b57edddc7 P 65c354b7cced46a984928ed323b24613: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 17:15:47.236207 23932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:15:47.231257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36644 (local address 127.11.229.129:43155)
0923 17:15:47.231380 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0923 17:15:47.231388 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 17:15:47.231405 (+ 17us) server_negotiation.cc:407] Connection header received
0923 17:15:47.231488 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:15:47.231491 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:15:47.231559 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:15:47.231687 (+ 128us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 17:15:47.231973 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:15:47.232781 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:15:47.234007 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:15:47.234363 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:15:47.234483 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:15:47.234919 (+ 436us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 17:15:47.235479 (+ 560us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 17:15:47.235593 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0923 17:15:47.236010 (+ 417us) server_negotiation.cc:299] Negotiation successful
0923 17:15:47.236069 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260923 17:15:47.243440 23866 raft_consensus.cc:1261] T efc449133d4d417491e6279b57edddc7 P 65c354b7cced46a984928ed323b24613 [term 1 FOLLOWER]: Refusing update from remote peer 4c7482fffec748ee8a65b60b778e5f7b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:15:47.244191 23939 consensus_queue.cc:1035] T efc449133d4d417491e6279b57edddc7 P 4c7482fffec748ee8a65b60b778e5f7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "65c354b7cced46a984928ed323b24613" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39221 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:15:47.245496 23731 raft_consensus.cc:1261] T efc449133d4d417491e6279b57edddc7 P df49f927cd714342b5fc478cbc87cbec [term 1 FOLLOWER]: Refusing update from remote peer 4c7482fffec748ee8a65b60b778e5f7b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:15:47.246145 23950 consensus_queue.cc:1035] T efc449133d4d417491e6279b57edddc7 P 4c7482fffec748ee8a65b60b778e5f7b [LEADER]: Connected to new peer: Peer: permanent_uuid: "df49f927cd714342b5fc478cbc87cbec" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:15:47.254971 23953 mvcc.cc:205] Tried to move back new op lower bound from 7332592628700221440 to 7332592628541849600. Current Snapshot: MvccSnapshot[applied={T|T < 7332592628700221440}]
I20260923 17:15:47.261320 23954 mvcc.cc:205] Tried to move back new op lower bound from 7332592628700221440 to 7332592628541849600. Current Snapshot: MvccSnapshot[applied={T|T < 7332592628700221440 or (T in {7332592628700221440})}]
I20260923 17:15:47.262651 23956 mvcc.cc:205] Tried to move back new op lower bound from 7332592628700221440 to 7332592628541849600. Current Snapshot: MvccSnapshot[applied={T|T < 7332592628700221440}]
I20260923 17:15:47.266093 23432 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47080:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:15:47.266288 23432 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47080:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:15:47.269083 23432 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f14d55aa527846d8ae67e761aff55c4e: Sending DeleteTablet for 3 replicas of tablet efc449133d4d417491e6279b57edddc7
I20260923 17:15:47.270267 23717 tablet_service.cc:1514] Processing DeleteTablet for tablet efc449133d4d417491e6279b57edddc7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:15:47 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:42404
I20260923 17:15:47.270293 23574 tablet_service.cc:1514] Processing DeleteTablet for tablet efc449133d4d417491e6279b57edddc7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:15:47 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:36638
I20260923 17:15:47.271274 23843 tablet_service.cc:1514] Processing DeleteTablet for tablet efc449133d4d417491e6279b57edddc7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:15:47 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:56582
I20260923 17:15:47.272375 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 23514
I20260923 17:15:47.276533 23964 tablet_replica.cc:330] T efc449133d4d417491e6279b57edddc7 P 65c354b7cced46a984928ed323b24613: stopping tablet replica
I20260923 17:15:47.276618 23962 tablet_replica.cc:330] T efc449133d4d417491e6279b57edddc7 P df49f927cd714342b5fc478cbc87cbec: stopping tablet replica
I20260923 17:15:47.276925 23964 raft_consensus.cc:2229] T efc449133d4d417491e6279b57edddc7 P 65c354b7cced46a984928ed323b24613 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:15:47.276976 23962 raft_consensus.cc:2229] T efc449133d4d417491e6279b57edddc7 P df49f927cd714342b5fc478cbc87cbec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:15:47.277297 23964 raft_consensus.cc:2258] T efc449133d4d417491e6279b57edddc7 P 65c354b7cced46a984928ed323b24613 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:15:47.277336 23962 raft_consensus.cc:2258] T efc449133d4d417491e6279b57edddc7 P df49f927cd714342b5fc478cbc87cbec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:15:47.279330 23962 ts_tablet_manager.cc:1905] T efc449133d4d417491e6279b57edddc7 P df49f927cd714342b5fc478cbc87cbec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:15:47.280786 23964 ts_tablet_manager.cc:1905] T efc449133d4d417491e6279b57edddc7 P 65c354b7cced46a984928ed323b24613: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:15:47.282546 23962 ts_tablet_manager.cc:1918] T efc449133d4d417491e6279b57edddc7 P df49f927cd714342b5fc478cbc87cbec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 17:15:47.282661 23962 log.cc:1196] T efc449133d4d417491e6279b57edddc7 P df49f927cd714342b5fc478cbc87cbec: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-1/wal/wals/efc449133d4d417491e6279b57edddc7
I20260923 17:15:47.283031 23962 ts_tablet_manager.cc:1939] T efc449133d4d417491e6279b57edddc7 P df49f927cd714342b5fc478cbc87cbec: Deleting consensus metadata
I20260923 17:15:47.284113 23964 ts_tablet_manager.cc:1918] T efc449133d4d417491e6279b57edddc7 P 65c354b7cced46a984928ed323b24613: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 17:15:47.284219 23964 log.cc:1196] T efc449133d4d417491e6279b57edddc7 P 65c354b7cced46a984928ed323b24613: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790183633736342-12182-0/minicluster-data/ts-2/wal/wals/efc449133d4d417491e6279b57edddc7
I20260923 17:15:47.284543 23418 catalog_manager.cc:4841] TS df49f927cd714342b5fc478cbc87cbec (127.11.229.130:42943): tablet efc449133d4d417491e6279b57edddc7 (table test-table [id=91b0ebecc9754e44812c90cd37641d6f]) successfully deleted
I20260923 17:15:47.284929 23964 ts_tablet_manager.cc:1939] T efc449133d4d417491e6279b57edddc7 P 65c354b7cced46a984928ed323b24613: Deleting consensus metadata
I20260923 17:15:47.286111 23417 catalog_manager.cc:4841] TS 65c354b7cced46a984928ed323b24613 (127.11.229.131:39221): tablet efc449133d4d417491e6279b57edddc7 (table test-table [id=91b0ebecc9754e44812c90cd37641d6f]) successfully deleted
W20260923 17:15:47.291464 23418 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.229.129:43155 (error 108)
W20260923 17:15:47.292665 23929 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:15:47.292325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:43155 (local address 127.0.0.1:36648)
0923 17:15:47.292472 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0923 17:15:47.292546 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.129:43155: connect: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":57}
W20260923 17:15:47.292836 23418 catalog_manager.cc:4584] TS 4c7482fffec748ee8a65b60b778e5f7b (127.11.229.129:43155): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet efc449133d4d417491e6279b57edddc7: Network error: Client connection negotiation failed: client connection to 127.11.229.129:43155: connect: Connection reset by peer (error 104)
I20260923 17:15:47.293565 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 23653
I20260923 17:15:47.299661 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 23788
I20260923 17:15:47.306886 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 23401
I20260923 17:15:47.313441 12182 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260923 17:15:47.658356 12182 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260923 17:15:47.658520 12182 mini_ranger.cc:66] Stopping Ranger...
I20260923 17:15:48.003297 12182 mini_ranger.cc:68] Stopped Ranger
2026-09-23 17:15:48.003 UTC [22987] LOG: received smart shutdown request
2026-09-23 17:15:48.007 UTC [22987] LOG: background worker "logical replication launcher" (PID 22996) exited with exit code 1
2026-09-23 17:15:48.007 UTC [22991] LOG: shutting down
2026-09-23 17:15:48.209 UTC [22987] LOG: database system is shut down
2026-09-23T17:15:48Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (47406 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 17:15:48 dist-test-slave-1x1f krb5kdc[23974](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 17:15:48 dist-test-slave-1x1f krb5kdc[23974](info): set up 2 sockets
Sep 23 17:15:48 dist-test-slave-1x1f krb5kdc[23974](info): commencing operation
krb5kdc: starting...
W20260923 17:15:49.474803 12182 mini_kdc.cc:121] Time spent starting KDC: real 1.125s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Sep 23 17:15:49 dist-test-slave-1x1f krb5kdc[23974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183749, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T17:15:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:15:49Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.11.229.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.11.229.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.11.229.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/rangeradmin_127.11.229.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.11.229.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/rangeradmin_127.11.229.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.11.229.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.11.229.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.11.229.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/rangerlookup_127.11.229.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.11.229.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/rangerlookup_127.11.229.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.229.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.11.229.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.229.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/HTTP_127.11.229.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.229.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/HTTP_127.11.229.148@KRBTEST.COM.keytab.
I20260923 17:15:49.665647 12182 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskks427P/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/postgres -l logfile start
2026-09-23 17:15:52.702 UTC [24004] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-09-23 17:15:52.702 UTC [24004] LOG: listening on IPv4 address "127.11.229.148", port 51711
2026-09-23 17:15:52.706 UTC [24004] LOG: listening on Unix socket "/tmp/.s.PGSQL.51711"
2026-09-23 17:15:52.728 UTC [24007] LOG: database system was shut down at 2026-09-23 17:15:50 UTC
2026-09-23 17:15:52.732 UTC [24004] LOG: database system is ready to accept connections
I20260923 17:15:53.686558 12182 mini_postgres.cc:96] Postgres bound to 51711
2026-09-23 17:15:53.692 UTC [24015] FATAL: database "slave" does not exist
127.11.229.148:51711 - accepting connections
I20260923 17:15:53.693583 12182 mini_ranger.cc:161] Starting Ranger...
I20260923 17:15:53.709733 12182 mini_ranger.cc:84] Created miniranger Postgres user
I20260923 17:15:54.331835 12182 mini_ranger.cc:87] Created ranger Postgres database
I20260923 17:15:54.331936 12182 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ranger-admin
2026-09-23 17:15:54,629 [I] DB FLAVOR :POSTGRES
2026-09-23 17:15:54,629 [I] --------- Verifying Ranger DB connection ---------
2026-09-23 17:15:54,629 [I] Checking connection..
2026-09-23 17:15:54,629 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskks427P/build/debug/bin/postgresql.jar:/tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.229.148:51711/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-09-23 17:15:54,890 [I] Checking connection passed.
2026-09-23 17:15:54,890 [I] --------- Verifying version history table ---------
2026-09-23 17:15:54,890 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskks427P/build/debug/bin/postgresql.jar:/tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.229.148:51711/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-23 17:15:55,133 [I] Table x_db_version_h does not exist in database ranger
2026-09-23 17:15:55,134 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskks427P/build/debug/bin/postgresql.jar:/tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.229.148:51711/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-23 17:15:55,368 [I] Table x_db_version_h does not exist in database ranger
2026-09-23 17:15:55,368 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-09-23 17:15:55,368 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskks427P/build/debug/bin/postgresql.jar:/tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.229.148:51711/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-09-23 17:15:55.617 UTC [24079] WARNING: there is no transaction in progress
2026-09-23 17:15:55,625 [I] create_dbversion_catalog.sql file imported successfully
2026-09-23 17:15:55,625 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskks427P/build/debug/bin/postgresql.jar:/tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.229.148:51711/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-23 17:15:55,899 [I] Table x_db_version_h already exists in database 'ranger'
2026-09-23 17:15:55,899 [I] --------- Importing Ranger Core DB Schema ---------
2026-09-23 17:15:55,900 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskks427P/build/debug/bin/postgresql.jar:/tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.229.148:51711/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-09-23 17:15:56,166 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskks427P/build/debug/bin/postgresql.jar:/tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.229.148:51711/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-09-23 17:15:56,418 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskks427P/build/debug/bin/postgresql.jar:/tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.229.148:51711/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-1x1f.c.gcp-upstream.internal','N') ;"
2026-09-23 17:15:56,656 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskks427P/build/debug/bin/postgresql.jar:/tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.229.148:51711/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-23 17:15:56,921 [I] Table x_portal_user does not exist in database ranger
2026-09-23 17:15:56,922 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskks427P/build/debug/bin/postgresql.jar:/tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.229.148:51711/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-23 17:15:57,180 [I] Table x_policy_ref_group does not exist in database ranger
2026-09-23 17:15:57,180 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskks427P/build/debug/bin/postgresql.jar:/tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.229.148:51711/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-23 17:15:57,466 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskks427P/build/debug/bin/postgresql.jar:/tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.229.148:51711/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-23 17:15:57,719 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-09-23 17:15:57,719 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskks427P/build/debug/bin/postgresql.jar:/tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.229.148:51711/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-09-23 17:15:58.793 UTC [24187] WARNING: there is no transaction in progress
2026-09-23 17:15:58.812 UTC [24187] WARNING: there is no transaction in progress
2026-09-23 17:15:58.832 UTC [24187] WARNING: there is no transaction in progress
2026-09-23 17:15:58.850 UTC [24187] WARNING: there is no transaction in progress
2026-09-23 17:15:58.870 UTC [24187] WARNING: there is no transaction in progress
2026-09-23 17:15:58.891 UTC [24187] WARNING: there is no transaction in progress
2026-09-23 17:15:58.954 UTC [24187] WARNING: there is no transaction in progress
2026-09-23 17:15:58.964 UTC [24187] WARNING: there is no transaction in progress
2026-09-23 17:15:58.982 UTC [24187] WARNING: there is no transaction in progress
2026-09-23 17:15:58.994 UTC [24187] WARNING: there is no transaction in progress
2026-09-23 17:15:59.007 UTC [24187] WARNING: there is no transaction in progress
2026-09-23 17:15:59.024 UTC [24187] WARNING: there is no transaction in progress
2026-09-23 17:15:59.035 UTC [24187] WARNING: there is no transaction in progress
2026-09-23 17:15:59.043 UTC [24187] WARNING: there is no transaction in progress
2026-09-23 17:15:59.052 UTC [24187] WARNING: there is no transaction in progress
2026-09-23 17:15:59.062 UTC [24187] WARNING: there is no transaction in progress
2026-09-23 17:15:59,891 [I] ranger_core_db_postgres.sql file imported successfully
2026-09-23 17:15:59,891 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskks427P/build/debug/bin/postgresql.jar:/tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.229.148:51711/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-09-23 17:16:00,129 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-09-23 17:16:00,130 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskks427P/build/debug/bin/postgresql.jar:/tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.229.148:51711/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-23 17:16:00,360 [I] Table x_portal_user already exists in database 'ranger'
2026-09-23 17:16:00,360 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskks427P/build/debug/bin/postgresql.jar:/tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.229.148:51711/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-23 17:16:00,597 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-09-23 17:16:00,598 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskks427P/build/debug/bin/postgresql.jar:/tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.229.148:51711/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-23 17:16:00,844 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskks427P/build/debug/bin/postgresql.jar:/tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.229.148:51711/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-23 17:16:01,100 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskks427P/build/debug/bin/postgresql.jar:/tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.229.148:51711/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-1x1f.c.gcp-upstream.internal';"
2026-09-23 17:16:01,371 [I] CORE_DB_SCHEMA import status has been updated
2026-09-23 17:16:01,371 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskks427P/build/debug/bin/postgresql.jar:/tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.229.148:51711/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-09-23 17:16:01,626 [I] DB_PATCHES have already been applied
I20260923 17:16:01.632539 12182 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ranger-admin:/tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskks427P/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskks427P/build/debug/bin/postgresql.jar:/tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260923 17:16:01.632634 12182 mini_ranger.cc:193] Using host: 127.11.229.148
I20260923 17:16:01.636148 12182 mini_ranger.cc:227] Ranger admin URL: http://127.11.229.148:38279
Sep 23, 2026 5:16:01 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 23, 2026 5:16:01 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 23, 2026 5:16:02 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ranger-admin/ews/webapp
Sep 23, 2026 5:16:02 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Sep 23, 2026 5:16:02 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ranger-admin/ews/webapp] .....
Sep 23, 2026 5:16:02 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ranger-admin/ews/webapp].
Sep 23, 2026 5:16:02 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260923 17:16:02.781934 12182 mini_ranger.cc:160] Time spent starting Ranger: real 9.088s user 0.000s sys 0.010s
Sep 23, 2026 5:16:22 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Sep 23, 2026 5:16:22 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Sep 23, 2026 5:16:22 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Sep 23, 2026 5:16:22 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Sep 23, 2026 5:16:22 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Sep 23, 2026 5:16:22 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Sep 23, 2026 5:16:22 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Sep 23, 2026 5:16:22 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Sep 23, 2026 5:16:22 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Sep 23, 2026 5:16:22 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Sep 23, 2026 5:16:22 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Sep 23, 2026 5:16:22 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Sep 23, 2026 5:16:22 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Sep 23, 2026 5:16:22 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Sep 23, 2026 5:16:22 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Sep 23, 2026 5:16:22 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Sep 23, 2026 5:16:22 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Sep 23, 2026 5:16:23 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260923 17:16:23.850337 12182 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.11.229.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.11.229.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.11.229.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/rangerkms_127.11.229.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.11.229.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/rangerkms_127.11.229.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.229.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.11.229.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.229.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/HTTP_127.11.229.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.229.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/HTTP_127.11.229.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Sep 23 17:16:23 dist-test-slave-1x1f krb5kdc[23974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183783, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260923 17:16:23.941450 12182 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260923 17:16:23.950971 12182 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260923 17:16:24.944435 12182 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260923 17:16:24.944525 12182 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ranger-kms
I20260923 17:16:24.944547 12182 mini_ranger_kms.cc:227] Using postgres at 127.11.229.148:51711
2026-09-23 17:16:25,111 [I] DB FLAVOR :POSTGRES
2026-09-23 17:16:25,111 [I] --------- Verifying Ranger DB connection ---------
2026-09-23 17:16:25,111 [I] Checking connection
2026-09-23 17:16:25,111 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskks427P/build/debug/bin/postgresql.jar:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.229.148:51711/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-09-23 17:16:25,360 [I] connection success
2026-09-23 17:16:25,360 [I] --------- Verifying Ranger DB tables ---------
2026-09-23 17:16:25,360 [I] Verifying table ranger_masterkey in database rangerkms
2026-09-23 17:16:25,360 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskks427P/build/debug/bin/postgresql.jar:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.229.148:51711/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-09-23 17:16:25,597 [I] Table ranger_masterkey does not exist in database rangerkms
2026-09-23 17:16:25,597 [I] --------- Importing Ranger Core DB Schema ---------
2026-09-23 17:16:25,597 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-09-23 17:16:25,598 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskks427P/build/debug/bin/postgresql.jar:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.229.148:51711/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-09-23 17:16:25,862 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260923 17:16:26.349753 12182 mini_ranger_kms.cc:310] Created kms service
I20260923 17:16:26.566448 12182 mini_ranger_kms.cc:326] Created kudu user
I20260923 17:16:26.611694 12182 mini_ranger_kms.cc:343] Created rangerkms user
Sep 23 17:16:26 dist-test-slave-1x1f krb5kdc[23974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183783, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.11.229.148@KRBTEST.COM
I20260923 17:16:27.028265 12182 mini_ranger_kms.cc:384] Added ranger policy
I20260923 17:16:27.028414 12182 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ranger-kms:/tmp/dist-test-taskks427P/build/debug/bin/postgresql.jar:/tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskks427P/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260923 17:16:27.028435 12182 mini_ranger_kms.cc:240] Using host: 127.11.229.148
I20260923 17:16:27.032272 12182 mini_ranger_kms.cc:276] Ranger KMS PID: 24367
I20260923 17:16:27.032349 12182 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.11.229.148:59551
Sep 23, 2026 5:16:28 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 23, 2026 5:16:28 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 23, 2026 5:16:28 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Sep 23, 2026 5:16:28 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ranger-kms/ews/webapp] .....
Sep 23, 2026 5:16:28 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ranger-kms/ews/webapp].
Sep 23, 2026 5:16:28 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Sep 23 17:16:29 dist-test-slave-1x1f krb5kdc[23974](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790183789, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.229.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:16:29.357014 12182 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.416s user 0.002s sys 0.150s
I20260923 17:16:29.357110 12182 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260923 17:16:29.357187 12182 mini_ranger_kms.cc:401] 127.11.229.148:59551/kms/v1/keys
Sep 23 17:16:29 dist-test-slave-1x1f krb5kdc[23974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183789, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.229.148@KRBTEST.COM for HTTP/127.11.229.148@KRBTEST.COM
Sep 23 17:16:30 dist-test-slave-1x1f krb5kdc[23974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183789, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.229.148@KRBTEST.COM for HTTP/127.11.229.148@KRBTEST.COM
Sep 23 17:16:32 dist-test-slave-1x1f krb5kdc[23974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183792, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.11.229.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
I20260923 17:16:32.354341 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:43655
--webserver_interface=127.11.229.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:45411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:43655
--ranger_config_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.229.148:59551/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:16:32.464005 24418 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:16:32.464304 24418 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:16:32.464380 24418 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:16:32.468462 24418 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:16:32.468552 24418 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:16:32.468586 24418 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:16:32.468640 24418 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:16:32.468693 24418 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:16:32.474177 24418 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:45411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/master-0/wal
--ranger_kms_url=127.11.229.148:59551/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:43655
--ranger_config_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:43655
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.229.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24418
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:16:32.475284 24418 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:16:32.476284 24418 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:16:32.485309 24424 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:16:32.485378 24418 server_base.cc:1034] running on GCE node
W20260923 17:16:32.485316 24426 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:16:32.485636 24423 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:16:32.486316 24418 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:16:32.487632 24418 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:16:32.488830 24418 hybrid_clock.cc:648] HybridClock initialized: now 1790183792488802 us; error 40 us; skew 500 ppm
Sep 23 17:16:32 dist-test-slave-1x1f krb5kdc[23974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183792, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:16:32.499047 24418 init.cc:377] Logged in from keytab as kudu/127.11.229.190@KRBTEST.COM (short username kudu)
I20260923 17:16:32.500165 24418 webserver.cc:460] Webserver started at http://127.11.229.190:37069/ using document root <none> and password file <none>
I20260923 17:16:32.500824 24418 fs_manager.cc:359] Metadata directory not provided
I20260923 17:16:32.500895 24418 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:16:32.501102 24418 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 23 17:16:32 dist-test-slave-1x1f krb5kdc[23974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183792, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for HTTP/127.11.229.148@KRBTEST.COM
I20260923 17:16:32.555881 24418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "3dd901efa92e4e2eaaa1e13a16c796d8"
format_stamp: "Formatted at 2026-09-23 17:16:32 on dist-test-slave-1x1f"
server_key: "7df2f299a643b2edfff00d6cf8b4ab24"
server_key_iv: "4d3d2bf3c15c286eed840e0aaac480e1"
server_key_version: "kuduclusterkey@0"
I20260923 17:16:32.556522 24418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "3dd901efa92e4e2eaaa1e13a16c796d8"
format_stamp: "Formatted at 2026-09-23 17:16:32 on dist-test-slave-1x1f"
server_key: "7df2f299a643b2edfff00d6cf8b4ab24"
server_key_iv: "4d3d2bf3c15c286eed840e0aaac480e1"
server_key_version: "kuduclusterkey@0"
I20260923 17:16:32.560681 24418 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260923 17:16:32.578500 24433 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:16:32.580336 24418 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 17:16:32.580487 24418 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "3dd901efa92e4e2eaaa1e13a16c796d8"
format_stamp: "Formatted at 2026-09-23 17:16:32 on dist-test-slave-1x1f"
server_key: "7df2f299a643b2edfff00d6cf8b4ab24"
server_key_iv: "4d3d2bf3c15c286eed840e0aaac480e1"
server_key_version: "kuduclusterkey@0"
I20260923 17:16:32.580623 24418 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:16:32.625970 24418 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:16:32.629520 24418 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:16:32.629726 24418 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:16:32.638155 24418 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.190:43655
I20260923 17:16:32.638239 24485 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.190:43655 every 8 connection(s)
I20260923 17:16:32.639173 24418 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:16:32.641935 24486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:16:32.642445 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 24418
I20260923 17:16:32.642560 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:16:32.642875 12182 external_mini_cluster.cc:1428] Setting key 57d8d8b38c6998c7d5da2746d29e810e
I20260923 17:16:32.649261 24486 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3dd901efa92e4e2eaaa1e13a16c796d8: Bootstrap starting.
I20260923 17:16:32.651769 24486 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3dd901efa92e4e2eaaa1e13a16c796d8: Neither blocks nor log segments found. Creating new log.
I20260923 17:16:32.652549 24486 log.cc:824] T 00000000000000000000000000000000 P 3dd901efa92e4e2eaaa1e13a16c796d8: Log is configured to *not* fsync() on all Append() calls
Sep 23 17:16:32 dist-test-slave-1x1f krb5kdc[23974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183792, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:16:32.654799 24486 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3dd901efa92e4e2eaaa1e13a16c796d8: No bootstrap required, opened a new log
I20260923 17:16:32.658095 24486 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3dd901efa92e4e2eaaa1e13a16c796d8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3dd901efa92e4e2eaaa1e13a16c796d8" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43655 } }
I20260923 17:16:32.658422 24486 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3dd901efa92e4e2eaaa1e13a16c796d8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:16:32.658522 24486 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3dd901efa92e4e2eaaa1e13a16c796d8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dd901efa92e4e2eaaa1e13a16c796d8, State: Initialized, Role: FOLLOWER
I20260923 17:16:32.659052 24486 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3dd901efa92e4e2eaaa1e13a16c796d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3dd901efa92e4e2eaaa1e13a16c796d8" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43655 } }
I20260923 17:16:32.659210 24486 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3dd901efa92e4e2eaaa1e13a16c796d8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:16:32.659296 24486 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3dd901efa92e4e2eaaa1e13a16c796d8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:16:32.659391 24486 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3dd901efa92e4e2eaaa1e13a16c796d8 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:16:32.660037 24489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:32.644321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40284 (local address 127.11.229.190:43655)
0923 17:16:32.644768 (+ 447us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:32.644786 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:32.644828 (+ 42us) server_negotiation.cc:407] Connection header received
0923 17:16:32.645653 (+ 825us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:32.645675 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:32.646090 (+ 415us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:32.646489 (+ 399us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:16:32.647355 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:32.648804 (+ 1449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:32.650055 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:32.650765 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:32.650908 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:32.653929 (+ 3021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:16:32.653936 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:16:32.653953 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:16:32.653982 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:16:32.656643 (+ 2661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:32.657131 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:32.657137 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:32.657143 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:32.657263 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:32.657569 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:32.657572 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:32.657573 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:32.658051 (+ 478us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:16:32.658275 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:32.658890 (+ 615us) server_negotiation.cc:299] Negotiation successful
0923 17:16:32.659146 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288,"thread_start_us":130,"threads_started":1}
I20260923 17:16:32.660414 24486 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3dd901efa92e4e2eaaa1e13a16c796d8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3dd901efa92e4e2eaaa1e13a16c796d8" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43655 } }
I20260923 17:16:32.660746 24486 leader_election.cc:302] T 00000000000000000000000000000000 P 3dd901efa92e4e2eaaa1e13a16c796d8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3dd901efa92e4e2eaaa1e13a16c796d8; no voters:
I20260923 17:16:32.661053 24486 leader_election.cc:288] T 00000000000000000000000000000000 P 3dd901efa92e4e2eaaa1e13a16c796d8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 17:16:32.661118 24491 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3dd901efa92e4e2eaaa1e13a16c796d8 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:16:32.661386 24491 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3dd901efa92e4e2eaaa1e13a16c796d8 [term 1 LEADER]: Becoming Leader. State: Replica: 3dd901efa92e4e2eaaa1e13a16c796d8, State: Running, Role: LEADER
I20260923 17:16:32.661713 24491 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3dd901efa92e4e2eaaa1e13a16c796d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3dd901efa92e4e2eaaa1e13a16c796d8" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43655 } }
I20260923 17:16:32.662374 24486 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3dd901efa92e4e2eaaa1e13a16c796d8 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:16:32.662891 24491 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3dd901efa92e4e2eaaa1e13a16c796d8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3dd901efa92e4e2eaaa1e13a16c796d8. Latest consensus state: current_term: 1 leader_uuid: "3dd901efa92e4e2eaaa1e13a16c796d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3dd901efa92e4e2eaaa1e13a16c796d8" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43655 } } }
I20260923 17:16:32.663002 24491 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3dd901efa92e4e2eaaa1e13a16c796d8 [sys.catalog]: This master's current role is: LEADER
I20260923 17:16:32.663235 24491 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3dd901efa92e4e2eaaa1e13a16c796d8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3dd901efa92e4e2eaaa1e13a16c796d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3dd901efa92e4e2eaaa1e13a16c796d8" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43655 } } }
I20260923 17:16:32.663335 24491 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3dd901efa92e4e2eaaa1e13a16c796d8 [sys.catalog]: This master's current role is: LEADER
I20260923 17:16:32.663602 24496 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:16:32.666656 24496 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:16:32.667050 24486 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260923 17:16:32.677690 24496 catalog_manager.cc:1347] Generated new cluster ID: c4e3232862e44d0a9754052ca3ef5464
I20260923 17:16:32.677806 24496 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:16:32.704146 24496 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:16:32.706326 24496 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:16:32.712005 24496 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3dd901efa92e4e2eaaa1e13a16c796d8: Generated new TSK 0
I20260923 17:16:32.712828 24496 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.229.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab.
Entry for principal kudu/127.11.229.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab.
I20260923 17:16:33.394518 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.229.148:59551/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.129:0
--local_ip_for_outbound_sockets=127.11.229.129
--webserver_interface=127.11.229.129
--webserver_port=0
--tserver_master_addrs=127.11.229.190:43655
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab
--principal=kudu/127.11.229.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:45411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:16:33.510502 24531 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:16:33.510823 24531 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:16:33.510931 24531 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:16:33.515122 24531 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:16:33.515199 24531 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:16:33.515300 24531 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.129
I20260923 17:16:33.521026 24531 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:45411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.11.229.148:59551/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab
--principal=kudu/127.11.229.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.229.129
--webserver_port=0
--tserver_master_addrs=127.11.229.190:43655
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24531
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.129
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:16:33.522188 24531 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:16:33.523307 24531 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:16:33.535815 24539 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:16:33.535810 24537 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:16:33.536419 24536 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:16:33.537034 24531 server_base.cc:1034] running on GCE node
I20260923 17:16:33.537472 24531 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:16:33.538210 24531 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:16:33.539426 24531 hybrid_clock.cc:648] HybridClock initialized: now 1790183793539400 us; error 44 us; skew 500 ppm
Sep 23 17:16:33 dist-test-slave-1x1f krb5kdc[23974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183793, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:16:33.542928 24531 init.cc:377] Logged in from keytab as kudu/127.11.229.129@KRBTEST.COM (short username kudu)
I20260923 17:16:33.543964 24531 webserver.cc:460] Webserver started at http://127.11.229.129:46621/ using document root <none> and password file <none>
I20260923 17:16:33.544555 24531 fs_manager.cc:359] Metadata directory not provided
I20260923 17:16:33.544647 24531 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:16:33.544888 24531 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 23 17:16:33 dist-test-slave-1x1f krb5kdc[23974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183793, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.129@KRBTEST.COM for HTTP/127.11.229.148@KRBTEST.COM
I20260923 17:16:33.566098 24531 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-0/data/instance:
uuid: "daeece74cda34948ac76b14ec12a3e4d"
format_stamp: "Formatted at 2026-09-23 17:16:33 on dist-test-slave-1x1f"
server_key: "54f96fde2629a640c6112d6fbdf12f51"
server_key_iv: "e1cf067be557f603842192e513e599d2"
server_key_version: "kuduclusterkey@0"
I20260923 17:16:33.566916 24531 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance:
uuid: "daeece74cda34948ac76b14ec12a3e4d"
format_stamp: "Formatted at 2026-09-23 17:16:33 on dist-test-slave-1x1f"
server_key: "54f96fde2629a640c6112d6fbdf12f51"
server_key_iv: "e1cf067be557f603842192e513e599d2"
server_key_version: "kuduclusterkey@0"
I20260923 17:16:33.574678 24531 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.000s
I20260923 17:16:33.596999 24548 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:16:33.598770 24531 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260923 17:16:33.598896 24531 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-0/wal
uuid: "daeece74cda34948ac76b14ec12a3e4d"
format_stamp: "Formatted at 2026-09-23 17:16:33 on dist-test-slave-1x1f"
server_key: "54f96fde2629a640c6112d6fbdf12f51"
server_key_iv: "e1cf067be557f603842192e513e599d2"
server_key_version: "kuduclusterkey@0"
I20260923 17:16:33.599021 24531 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:16:33.627283 24531 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:16:33.631161 24531 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:16:33.631421 24531 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:16:33.632171 24531 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:16:33.633239 24531 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:16:33.633342 24531 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:16:33.633469 24531 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:16:33.633550 24531 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:16:33.657747 24531 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.129:40575
I20260923 17:16:33.659067 24531 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
I20260923 17:16:33.659900 24661 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.129:40575 every 8 connection(s)
I20260923 17:16:33.662060 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 24531
I20260923 17:16:33.662190 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance
I20260923 17:16:33.662670 12182 external_mini_cluster.cc:1428] Setting key 7ed345f40c038c6aec3b074597db057b
Sep 23 17:16:33 dist-test-slave-1x1f krb5kdc[23974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183793, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.129@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:16:33.678629 24667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:33.662647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:43655 (local address 127.11.229.129:48285)
0923 17:16:33.663151 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:33.663203 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0923 17:16:33.665086 (+ 1883us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:16:33.665942 (+ 856us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:16:33.665952 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:16:33.666341 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:16:33.667069 (+ 728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:33.667090 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:33.668280 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:33.668284 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:33.669657 (+ 1373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:33.669668 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:33.670446 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:33.670450 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:33.670645 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:33.671352 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:16:33.671371 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:16:33.673220 (+ 1849us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:16:33.675440 (+ 2220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:16:33.675445 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:16:33.675461 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:16:33.675807 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:16:33.676106 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:16:33.676109 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:16:33.676111 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:16:33.676281 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:16:33.676743 (+ 462us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:16:33.676749 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:16:33.677068 (+ 319us) client_negotiation.cc:769] Sending connection context
0923 17:16:33.677250 (+ 182us) client_negotiation.cc:240] Negotiation successful
0923 17:16:33.677576 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":135,"threads_started":1}
I20260923 17:16:33.679407 24666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:33.662116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:48285 (local address 127.11.229.190:43655)
0923 17:16:33.665011 (+ 2895us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:33.665021 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:33.665038 (+ 17us) server_negotiation.cc:407] Connection header received
0923 17:16:33.665531 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:33.665537 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:33.665610 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:33.665723 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:16:33.667259 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:33.668128 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:33.669808 (+ 1680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:33.670155 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:33.670269 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:33.673411 (+ 3142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:16:33.673415 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:16:33.673418 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:16:33.673444 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:16:33.675314 (+ 1870us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:33.675920 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:33.675923 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:33.675925 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:33.676007 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:33.676388 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:33.676391 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:33.676393 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:33.676605 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:16:33.676692 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:33.679107 (+ 2415us) server_negotiation.cc:299] Negotiation successful
0923 17:16:33.679241 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2811,"thread_start_us":134,"threads_started":1}
I20260923 17:16:33.681228 24663 heartbeater.cc:347] Connected to a master server at 127.11.229.190:43655
I20260923 17:16:33.681461 24663 heartbeater.cc:464] Registering TS with master...
I20260923 17:16:33.682006 24663 heartbeater.cc:511] Master 127.11.229.190:43655 requested a full tablet report, sending...
I20260923 17:16:33.683944 24450 ts_manager.cc:194] Registered new tserver with Master: daeece74cda34948ac76b14ec12a3e4d (127.11.229.129:40575)
I20260923 17:16:33.685424 24450 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.129@KRBTEST.COM'} at 127.11.229.129:48285
WARNING: no policy specified for kudu/127.11.229.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab.
Entry for principal kudu/127.11.229.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab.
I20260923 17:16:33.713773 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.229.148:59551/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.130:0
--local_ip_for_outbound_sockets=127.11.229.130
--webserver_interface=127.11.229.130
--webserver_port=0
--tserver_master_addrs=127.11.229.190:43655
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab
--principal=kudu/127.11.229.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:45411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 23 17:16:33 dist-test-slave-1x1f krb5kdc[23974](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790183793, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260923 17:16:33.836512 24670 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:16:33.836781 24670 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:16:33.836877 24670 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:16:33.841027 24670 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:16:33.841105 24670 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:16:33.841205 24670 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.130
I20260923 17:16:33.846503 24670 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:45411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.11.229.148:59551/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab
--principal=kudu/127.11.229.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.229.130
--webserver_port=0
--tserver_master_addrs=127.11.229.190:43655
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24670
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.130
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:16:33.847757 24670 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:16:33.849066 24670 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:16:33.859099 24676 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:16:33.859099 24677 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:16:33.859684 24679 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:16:33.859668 24670 server_base.cc:1034] running on GCE node
I20260923 17:16:33.860214 24670 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:16:33.860838 24670 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:16:33.862007 24670 hybrid_clock.cc:648] HybridClock initialized: now 1790183793861975 us; error 49 us; skew 500 ppm
Sep 23 17:16:33 dist-test-slave-1x1f krb5kdc[23974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183793, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:16:33.864818 24670 init.cc:377] Logged in from keytab as kudu/127.11.229.130@KRBTEST.COM (short username kudu)
I20260923 17:16:33.865765 24670 webserver.cc:460] Webserver started at http://127.11.229.130:34123/ using document root <none> and password file <none>
I20260923 17:16:33.866351 24670 fs_manager.cc:359] Metadata directory not provided
I20260923 17:16:33.866441 24670 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:16:33.866647 24670 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 23 17:16:33 dist-test-slave-1x1f krb5kdc[23974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183793, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.130@KRBTEST.COM for HTTP/127.11.229.148@KRBTEST.COM
I20260923 17:16:33.878427 24670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-1/data/instance:
uuid: "d904bee1570547aa85d156e988acd1c4"
format_stamp: "Formatted at 2026-09-23 17:16:33 on dist-test-slave-1x1f"
server_key: "2f10720816eb41219538fa1b4f7d584e"
server_key_iv: "95fda7d8337569280bcf365ab9300ddf"
server_key_version: "kuduclusterkey@0"
I20260923 17:16:33.879220 24670 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance:
uuid: "d904bee1570547aa85d156e988acd1c4"
format_stamp: "Formatted at 2026-09-23 17:16:33 on dist-test-slave-1x1f"
server_key: "2f10720816eb41219538fa1b4f7d584e"
server_key_iv: "95fda7d8337569280bcf365ab9300ddf"
server_key_version: "kuduclusterkey@0"
I20260923 17:16:33.883862 24670 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260923 17:16:33.908136 24686 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:16:33.909663 24670 fs_manager.cc:725] Time spent opening block manager: real 0.012s user 0.003s sys 0.000s
I20260923 17:16:33.909828 24670 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-1/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-1/wal
uuid: "d904bee1570547aa85d156e988acd1c4"
format_stamp: "Formatted at 2026-09-23 17:16:33 on dist-test-slave-1x1f"
server_key: "2f10720816eb41219538fa1b4f7d584e"
server_key_iv: "95fda7d8337569280bcf365ab9300ddf"
server_key_version: "kuduclusterkey@0"
I20260923 17:16:33.909984 24670 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:16:33.932019 24670 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:16:33.936673 24670 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:16:33.936939 24670 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:16:33.937589 24670 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:16:33.938496 24670 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:16:33.938563 24670 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:16:33.938658 24670 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:16:33.938700 24670 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:16:33.949213 24670 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.130:44693
I20260923 17:16:33.950198 24670 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
I20260923 17:16:33.950779 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 24670
I20260923 17:16:33.950917 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance
I20260923 17:16:33.951292 12182 external_mini_cluster.cc:1428] Setting key 053a58223cc16b0bbf12d03165577264
I20260923 17:16:33.953008 24799 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.130:44693 every 8 connection(s)
WARNING: no policy specified for kudu/127.11.229.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.131@KRBTEST.COM" created.
Sep 23 17:16:33 dist-test-slave-1x1f krb5kdc[23974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183793, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.130@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:16:33.972965 24666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:33.956421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:54919 (local address 127.11.229.190:43655)
0923 17:16:33.956566 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:33.956571 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:33.957666 (+ 1095us) server_negotiation.cc:407] Connection header received
0923 17:16:33.959113 (+ 1447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:33.959120 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:33.959186 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:33.959246 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:16:33.961040 (+ 1794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:33.961976 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:33.963808 (+ 1832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:33.964210 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:33.964287 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:33.968980 (+ 4693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:16:33.968987 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:16:33.968993 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:16:33.969030 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:16:33.970799 (+ 1769us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:33.971424 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:33.971428 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:33.971430 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:33.971512 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:33.971848 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:33.971852 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:33.971854 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:33.972045 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:16:33.972149 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:33.972657 (+ 508us) server_negotiation.cc:299] Negotiation successful
0923 17:16:33.972789 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260923 17:16:33.973949 24803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:33.957003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:43655 (local address 127.11.229.130:54919)
0923 17:16:33.957520 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:33.957572 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0923 17:16:33.958861 (+ 1289us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:16:33.959717 (+ 856us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:16:33.959730 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:16:33.960117 (+ 387us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:16:33.960835 (+ 718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:33.960856 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:33.962149 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:33.962152 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:33.963656 (+ 1504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:33.963669 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:33.964505 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:33.964509 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:33.964701 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:33.965381 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:16:33.965404 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:16:33.968739 (+ 3335us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:16:33.970945 (+ 2206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:16:33.970952 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:16:33.970970 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:16:33.971304 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:16:33.971601 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:16:33.971605 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:16:33.971607 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:16:33.971748 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:16:33.972146 (+ 398us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:16:33.972153 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:16:33.972417 (+ 264us) client_negotiation.cc:769] Sending connection context
0923 17:16:33.972602 (+ 185us) client_negotiation.cc:240] Negotiation successful
0923 17:16:33.972932 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":167,"threads_started":1}
I20260923 17:16:33.975178 24800 heartbeater.cc:347] Connected to a master server at 127.11.229.190:43655
I20260923 17:16:33.975409 24800 heartbeater.cc:464] Registering TS with master...
I20260923 17:16:33.975898 24800 heartbeater.cc:511] Master 127.11.229.190:43655 requested a full tablet report, sending...
I20260923 17:16:33.976872 24450 ts_manager.cc:194] Registered new tserver with Master: d904bee1570547aa85d156e988acd1c4 (127.11.229.130:44693)
I20260923 17:16:33.977432 24450 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.130@KRBTEST.COM'} at 127.11.229.130:54919
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab.
Entry for principal kudu/127.11.229.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab.
I20260923 17:16:33.997725 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.229.148:59551/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.131:0
--local_ip_for_outbound_sockets=127.11.229.131
--webserver_interface=127.11.229.131
--webserver_port=0
--tserver_master_addrs=127.11.229.190:43655
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab
--principal=kudu/127.11.229.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:45411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:16:34.140925 24805 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:16:34.141341 24805 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:16:34.141415 24805 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:16:34.147287 24805 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:16:34.147377 24805 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:16:34.147462 24805 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.131
I20260923 17:16:34.155427 24805 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:45411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.11.229.148:59551/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab
--principal=kudu/127.11.229.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.229.131
--webserver_port=0
--tserver_master_addrs=127.11.229.190:43655
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24805
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.131
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:16:34.156905 24805 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:16:34.158259 24805 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:16:34.169981 24811 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:16:34.170087 24810 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:16:34.170351 24813 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:16:34.171427 24805 server_base.cc:1034] running on GCE node
I20260923 17:16:34.171875 24805 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:16:34.172654 24805 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:16:34.173951 24805 hybrid_clock.cc:648] HybridClock initialized: now 1790183794173915 us; error 45 us; skew 500 ppm
Sep 23 17:16:34 dist-test-slave-1x1f krb5kdc[23974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183794, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:16:34.179126 24805 init.cc:377] Logged in from keytab as kudu/127.11.229.131@KRBTEST.COM (short username kudu)
I20260923 17:16:34.180344 24805 webserver.cc:460] Webserver started at http://127.11.229.131:42291/ using document root <none> and password file <none>
I20260923 17:16:34.181166 24805 fs_manager.cc:359] Metadata directory not provided
I20260923 17:16:34.181318 24805 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:16:34.181622 24805 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 23 17:16:34 dist-test-slave-1x1f krb5kdc[23974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183794, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.131@KRBTEST.COM for HTTP/127.11.229.148@KRBTEST.COM
Sep 23 17:16:34 dist-test-slave-1x1f krb5kdc[23974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183793, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for HTTP/127.11.229.148@KRBTEST.COM
I20260923 17:16:34.215137 24805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-2/data/instance:
uuid: "1bb7124f7f7f4bcdbe99e14350a5a884"
format_stamp: "Formatted at 2026-09-23 17:16:34 on dist-test-slave-1x1f"
server_key: "e167539d0201264f697c96c79b0dd616"
server_key_iv: "4a2a362049a037fdb05355a5c4f69511"
server_key_version: "kuduclusterkey@0"
I20260923 17:16:34.215922 24805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance:
uuid: "1bb7124f7f7f4bcdbe99e14350a5a884"
format_stamp: "Formatted at 2026-09-23 17:16:34 on dist-test-slave-1x1f"
server_key: "e167539d0201264f697c96c79b0dd616"
server_key_iv: "4a2a362049a037fdb05355a5c4f69511"
server_key_version: "kuduclusterkey@0"
I20260923 17:16:34.221410 24805 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260923 17:16:34.240636 24820 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:16:34.242443 24805 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.004s sys 0.000s
I20260923 17:16:34.242581 24805 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-2/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-2/wal
uuid: "1bb7124f7f7f4bcdbe99e14350a5a884"
format_stamp: "Formatted at 2026-09-23 17:16:34 on dist-test-slave-1x1f"
server_key: "e167539d0201264f697c96c79b0dd616"
server_key_iv: "4a2a362049a037fdb05355a5c4f69511"
server_key_version: "kuduclusterkey@0"
I20260923 17:16:34.242725 24805 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:16:34.260845 24805 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:16:34.264684 24805 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:16:34.264880 24805 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:16:34.265599 24805 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:16:34.266953 24805 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:16:34.267057 24805 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:16:34.267149 24805 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:16:34.267225 24805 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:16:34.277009 24805 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.131:33389
I20260923 17:16:34.278137 24805 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
I20260923 17:16:34.287358 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 24805
I20260923 17:16:34.287487 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance
I20260923 17:16:34.287817 12182 external_mini_cluster.cc:1428] Setting key cb4d79b7282b0c654356bcedb127fc3c
I20260923 17:16:34.288597 24933 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.131:33389 every 8 connection(s)
Sep 23 17:16:34 dist-test-slave-1x1f krb5kdc[23974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183794, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.131@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:16:34.303820 24666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:34.288616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:48647 (local address 127.11.229.190:43655)
0923 17:16:34.288862 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:34.288867 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:34.290766 (+ 1899us) server_negotiation.cc:407] Connection header received
0923 17:16:34.291935 (+ 1169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:34.291938 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:34.291989 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:34.292035 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:16:34.293578 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:34.294379 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:34.296027 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:34.296364 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:34.296444 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:34.299717 (+ 3273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:16:34.299721 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:16:34.299724 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:16:34.299751 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:16:34.301504 (+ 1753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:34.302104 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:34.302108 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:34.302110 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:34.302191 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:34.302596 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:34.302600 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:34.302602 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:34.302837 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:16:34.302947 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:34.303517 (+ 570us) server_negotiation.cc:299] Negotiation successful
0923 17:16:34.303653 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157}
I20260923 17:16:34.304921 24936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:34.287421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:43655 (local address 127.11.229.131:48647)
0923 17:16:34.290622 (+ 3201us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:34.290682 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0923 17:16:34.291690 (+ 1008us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:16:34.292428 (+ 738us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:16:34.292436 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:16:34.292773 (+ 337us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:16:34.293419 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:34.293438 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:34.294535 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:34.294538 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:34.295879 (+ 1341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:34.295900 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:34.296646 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:34.296650 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:34.296893 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:34.297714 (+ 821us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:16:34.297734 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:16:34.299532 (+ 1798us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:16:34.301634 (+ 2102us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:16:34.301641 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:16:34.301659 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:16:34.301993 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:16:34.302317 (+ 324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:16:34.302320 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:16:34.302322 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:16:34.302486 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:16:34.302949 (+ 463us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:16:34.302955 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:16:34.303256 (+ 301us) client_negotiation.cc:769] Sending connection context
0923 17:16:34.303457 (+ 201us) client_negotiation.cc:240] Negotiation successful
0923 17:16:34.303773 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2974,"thread_start_us":183,"threads_started":1}
I20260923 17:16:34.306114 24934 heartbeater.cc:347] Connected to a master server at 127.11.229.190:43655
I20260923 17:16:34.306421 24934 heartbeater.cc:464] Registering TS with master...
I20260923 17:16:34.306978 24934 heartbeater.cc:511] Master 127.11.229.190:43655 requested a full tablet report, sending...
I20260923 17:16:34.308161 24450 ts_manager.cc:194] Registered new tserver with Master: 1bb7124f7f7f4bcdbe99e14350a5a884 (127.11.229.131:33389)
I20260923 17:16:34.308948 24450 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.131@KRBTEST.COM'} at 127.11.229.131:48647
I20260923 17:16:34.313901 12182 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 17:16:34.314646 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 24531
I20260923 17:16:34.321825 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 24670
I20260923 17:16:34.328212 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 24805
I20260923 17:16:34.334388 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 24418
I20260923 17:16:34.341406 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:43655
--webserver_interface=127.11.229.190
--webserver_port=37069
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:45411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:43655
--ranger_config_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.229.148:59551/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.229.148:59551/kms with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:16:34.452073 24937 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:16:34.452338 24937 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:16:34.452378 24937 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:16:34.456416 24937 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:16:34.456475 24937 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:16:34.456493 24937 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:16:34.456509 24937 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:16:34.456524 24937 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:16:34.461848 24937 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:45411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.229.148:59551/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:43655
--ranger_config_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:43655
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.229.190
--webserver_port=37069
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24937
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:16:34.462883 24937 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:16:34.463816 24937 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:16:34.472191 24943 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:16:34.472198 24945 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:16:34.472177 24942 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:16:34.472230 24937 server_base.cc:1034] running on GCE node
I20260923 17:16:34.472867 24937 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:16:34.473991 24937 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:16:34.475175 24937 hybrid_clock.cc:648] HybridClock initialized: now 1790183794475117 us; error 70 us; skew 500 ppm
Sep 23 17:16:34 dist-test-slave-1x1f krb5kdc[23974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183794, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:16:34.477941 24937 init.cc:377] Logged in from keytab as kudu/127.11.229.190@KRBTEST.COM (short username kudu)
I20260923 17:16:34.478890 24937 webserver.cc:460] Webserver started at http://127.11.229.190:37069/ using document root <none> and password file <none>
I20260923 17:16:34.479418 24937 fs_manager.cc:359] Metadata directory not provided
I20260923 17:16:34.479506 24937 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 23 17:16:34 dist-test-slave-1x1f krb5kdc[23974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183794, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for HTTP/127.11.229.148@KRBTEST.COM
I20260923 17:16:34.554462 24937 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260923 17:16:34.556865 24953 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:16:34.558303 24937 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 17:16:34.558455 24937 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "3dd901efa92e4e2eaaa1e13a16c796d8"
format_stamp: "Formatted at 2026-09-23 17:16:32 on dist-test-slave-1x1f"
server_key: "7df2f299a643b2edfff00d6cf8b4ab24"
server_key_iv: "4d3d2bf3c15c286eed840e0aaac480e1"
server_key_version: "kuduclusterkey@0"
I20260923 17:16:34.559022 24937 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:16:34.598435 24937 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:16:34.601284 24937 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:16:34.601516 24937 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:16:34.608582 24937 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.190:43655
I20260923 17:16:34.608587 25005 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.190:43655 every 8 connection(s)
I20260923 17:16:34.609630 24937 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:16:34.613791 25006 sys_catalog.cc:263] Verifying existing consensus state
I20260923 17:16:34.615362 25006 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3dd901efa92e4e2eaaa1e13a16c796d8: Bootstrap starting.
I20260923 17:16:34.619652 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 24937
I20260923 17:16:34.620067 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.229.148:59551/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.129:40575
--local_ip_for_outbound_sockets=127.11.229.129
--tserver_master_addrs=127.11.229.190:43655
--webserver_port=46621
--webserver_interface=127.11.229.129
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab
--principal=kudu/127.11.229.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:45411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.229.148:59551/kms with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 17:16:34.631657 25006 log.cc:824] T 00000000000000000000000000000000 P 3dd901efa92e4e2eaaa1e13a16c796d8: Log is configured to *not* fsync() on all Append() calls
I20260923 17:16:34.638120 25006 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3dd901efa92e4e2eaaa1e13a16c796d8: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260923 17:16:34.638535 25006 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3dd901efa92e4e2eaaa1e13a16c796d8: Bootstrap complete.
I20260923 17:16:34.642592 25006 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3dd901efa92e4e2eaaa1e13a16c796d8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3dd901efa92e4e2eaaa1e13a16c796d8" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43655 } }
I20260923 17:16:34.642977 25006 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3dd901efa92e4e2eaaa1e13a16c796d8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dd901efa92e4e2eaaa1e13a16c796d8, State: Initialized, Role: FOLLOWER
I20260923 17:16:34.643494 25006 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3dd901efa92e4e2eaaa1e13a16c796d8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3dd901efa92e4e2eaaa1e13a16c796d8" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43655 } }
I20260923 17:16:34.643610 25006 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3dd901efa92e4e2eaaa1e13a16c796d8 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:16:34.643700 25006 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3dd901efa92e4e2eaaa1e13a16c796d8 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:16:34.643842 25006 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3dd901efa92e4e2eaaa1e13a16c796d8 [term 1 FOLLOWER]: Advancing to term 2
I20260923 17:16:34.645640 25006 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3dd901efa92e4e2eaaa1e13a16c796d8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3dd901efa92e4e2eaaa1e13a16c796d8" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43655 } }
I20260923 17:16:34.645963 25006 leader_election.cc:302] T 00000000000000000000000000000000 P 3dd901efa92e4e2eaaa1e13a16c796d8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3dd901efa92e4e2eaaa1e13a16c796d8; no voters:
I20260923 17:16:34.646296 25006 leader_election.cc:288] T 00000000000000000000000000000000 P 3dd901efa92e4e2eaaa1e13a16c796d8 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260923 17:16:34.646379 25010 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3dd901efa92e4e2eaaa1e13a16c796d8 [term 2 FOLLOWER]: Leader election won for term 2
I20260923 17:16:34.646623 25010 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3dd901efa92e4e2eaaa1e13a16c796d8 [term 2 LEADER]: Becoming Leader. State: Replica: 3dd901efa92e4e2eaaa1e13a16c796d8, State: Running, Role: LEADER
I20260923 17:16:34.647012 25010 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3dd901efa92e4e2eaaa1e13a16c796d8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3dd901efa92e4e2eaaa1e13a16c796d8" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43655 } }
I20260923 17:16:34.647516 25006 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3dd901efa92e4e2eaaa1e13a16c796d8 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:16:34.648428 25011 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3dd901efa92e4e2eaaa1e13a16c796d8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "3dd901efa92e4e2eaaa1e13a16c796d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3dd901efa92e4e2eaaa1e13a16c796d8" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43655 } } }
I20260923 17:16:34.648547 25011 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3dd901efa92e4e2eaaa1e13a16c796d8 [sys.catalog]: This master's current role is: LEADER
I20260923 17:16:34.648813 25012 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3dd901efa92e4e2eaaa1e13a16c796d8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3dd901efa92e4e2eaaa1e13a16c796d8. Latest consensus state: current_term: 2 leader_uuid: "3dd901efa92e4e2eaaa1e13a16c796d8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3dd901efa92e4e2eaaa1e13a16c796d8" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43655 } } }
I20260923 17:16:34.648957 25012 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3dd901efa92e4e2eaaa1e13a16c796d8 [sys.catalog]: This master's current role is: LEADER
I20260923 17:16:34.649392 25019 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:16:34.649714 25006 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260923 17:16:34.655412 25019 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:16:34.656441 25019 catalog_manager.cc:1259] Loaded cluster ID: c4e3232862e44d0a9754052ca3ef5464
I20260923 17:16:34.656546 25019 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:16:34.659153 25019 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:16:34.659919 25019 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 3dd901efa92e4e2eaaa1e13a16c796d8: Loaded TSK: 0
I20260923 17:16:34.661229 25019 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260923 17:16:34.760303 25008 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:16:34.760571 25008 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:16:34.760636 25008 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:16:34.765401 25008 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:16:34.765488 25008 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:16:34.765587 25008 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.129
I20260923 17:16:34.771106 25008 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:45411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.229.148:59551/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab
--principal=kudu/127.11.229.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.129:40575
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.229.129
--webserver_port=46621
--tserver_master_addrs=127.11.229.190:43655
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25008
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.129
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:16:34.772173 25008 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:16:34.773301 25008 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:16:34.783349 25044 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:16:34.783388 25043 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:16:34.783814 25046 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:16:34.784085 25008 server_base.cc:1034] running on GCE node
I20260923 17:16:34.784518 25008 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:16:34.785291 25008 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:16:34.788600 25008 hybrid_clock.cc:648] HybridClock initialized: now 1790183794788524 us; error 85 us; skew 500 ppm
Sep 23 17:16:34 dist-test-slave-1x1f krb5kdc[23974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183794, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:16:34.792384 25008 init.cc:377] Logged in from keytab as kudu/127.11.229.129@KRBTEST.COM (short username kudu)
I20260923 17:16:34.793566 25008 webserver.cc:460] Webserver started at http://127.11.229.129:46621/ using document root <none> and password file <none>
I20260923 17:16:34.794463 25008 fs_manager.cc:359] Metadata directory not provided
I20260923 17:16:34.794649 25008 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 23 17:16:34 dist-test-slave-1x1f krb5kdc[23974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183794, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.129@KRBTEST.COM for HTTP/127.11.229.148@KRBTEST.COM
I20260923 17:16:34.827710 25008 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.000s
I20260923 17:16:34.834177 25054 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:16:34.835974 25008 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.001s sys 0.001s
I20260923 17:16:34.836119 25008 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-0/wal
uuid: "daeece74cda34948ac76b14ec12a3e4d"
format_stamp: "Formatted at 2026-09-23 17:16:33 on dist-test-slave-1x1f"
server_key: "54f96fde2629a640c6112d6fbdf12f51"
server_key_iv: "e1cf067be557f603842192e513e599d2"
server_key_version: "kuduclusterkey@0"
I20260923 17:16:34.836861 25008 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:16:34.870056 25008 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:16:34.873930 25008 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:16:34.874217 25008 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:16:34.875063 25008 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:16:34.876211 25008 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:16:34.876313 25008 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:16:34.876432 25008 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:16:34.876503 25008 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:16:34.890754 25008 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.129:40575
I20260923 17:16:34.892203 25008 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
I20260923 17:16:34.892658 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 25008
I20260923 17:16:34.893144 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.229.148:59551/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.130:44693
--local_ip_for_outbound_sockets=127.11.229.130
--tserver_master_addrs=127.11.229.190:43655
--webserver_port=34123
--webserver_interface=127.11.229.130
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab
--principal=kudu/127.11.229.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:45411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.229.148:59551/kms with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 17:16:34.893787 25167 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.129:40575 every 8 connection(s)
Sep 23 17:16:34 dist-test-slave-1x1f krb5kdc[23974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183794, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.129@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:16:34.921921 25172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:34.899931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:43655 (local address 127.11.229.129:60517)
0923 17:16:34.905335 (+ 5404us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:34.905379 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0923 17:16:34.906506 (+ 1127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:16:34.907908 (+ 1402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:16:34.907917 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:16:34.908263 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:16:34.908864 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:34.908879 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:34.910317 (+ 1438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:34.910321 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:34.911697 (+ 1376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:34.911709 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:34.913020 (+ 1311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:34.913024 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:34.913206 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:34.913860 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:16:34.913881 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:16:34.915671 (+ 1790us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:16:34.918303 (+ 2632us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:16:34.918310 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:16:34.918324 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:16:34.918662 (+ 338us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:16:34.919103 (+ 441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:16:34.919106 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:16:34.919108 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:16:34.919277 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:16:34.920062 (+ 785us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:16:34.920068 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:16:34.920362 (+ 294us) client_negotiation.cc:769] Sending connection context
0923 17:16:34.920552 (+ 190us) client_negotiation.cc:240] Negotiation successful
0923 17:16:34.920880 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5220,"thread_start_us":145,"threads_started":1}
I20260923 17:16:34.923475 25171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:34.899688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:60517 (local address 127.11.229.190:43655)
0923 17:16:34.904071 (+ 4383us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:34.904096 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:34.905517 (+ 1421us) server_negotiation.cc:407] Connection header received
0923 17:16:34.907094 (+ 1577us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:34.907104 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:34.907416 (+ 312us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:34.907843 (+ 427us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:16:34.909028 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:34.910126 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:34.911857 (+ 1731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:34.912622 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:34.912796 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:34.915910 (+ 3114us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:16:34.915916 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:16:34.915933 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:16:34.915964 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:16:34.918140 (+ 2176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:34.918844 (+ 704us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:34.918851 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:34.918856 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:34.918993 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:34.919397 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:34.919401 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:34.919403 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:34.919881 (+ 478us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:16:34.920009 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:34.922319 (+ 2310us) server_negotiation.cc:299] Negotiation successful
0923 17:16:34.922606 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4202,"thread_start_us":122,"threads_started":1}
I20260923 17:16:34.927971 25168 heartbeater.cc:347] Connected to a master server at 127.11.229.190:43655
I20260923 17:16:34.928202 25168 heartbeater.cc:464] Registering TS with master...
I20260923 17:16:34.928757 25168 heartbeater.cc:511] Master 127.11.229.190:43655 requested a full tablet report, sending...
W20260923 17:16:34.930991 25168 heartbeater.cc:644] Failed to heartbeat to 127.11.229.190:43655 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260923 17:16:34.931108 25168 heartbeater.cc:464] Registering TS with master...
I20260923 17:16:34.931308 25168 heartbeater.cc:511] Master 127.11.229.190:43655 requested a full tablet report, sending...
I20260923 17:16:34.932204 25168 heartbeater.cc:464] Registering TS with master...
I20260923 17:16:34.932382 25168 heartbeater.cc:511] Master 127.11.229.190:43655 requested a full tablet report, sending...
W20260923 17:16:34.933168 25168 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260923 17:16:35.037624 25170 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:16:35.037945 25170 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:16:35.038048 25170 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:16:35.042420 25170 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:16:35.042541 25170 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:16:35.042665 25170 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.130
I20260923 17:16:35.048417 25170 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:45411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.229.148:59551/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab
--principal=kudu/127.11.229.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.130:44693
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.229.130
--webserver_port=34123
--tserver_master_addrs=127.11.229.190:43655
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25170
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.130
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:16:35.049676 25170 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:16:35.050981 25170 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:16:35.062196 25177 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:16:35.062242 25178 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:16:35.062197 25180 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:16:35.063019 25170 server_base.cc:1034] running on GCE node
I20260923 17:16:35.063529 25170 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:16:35.064396 25170 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:16:35.065608 25170 hybrid_clock.cc:648] HybridClock initialized: now 1790183795065582 us; error 32 us; skew 500 ppm
Sep 23 17:16:35 dist-test-slave-1x1f krb5kdc[23974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183795, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:16:35.069795 25170 init.cc:377] Logged in from keytab as kudu/127.11.229.130@KRBTEST.COM (short username kudu)
I20260923 17:16:35.070861 25170 webserver.cc:460] Webserver started at http://127.11.229.130:34123/ using document root <none> and password file <none>
I20260923 17:16:35.071533 25170 fs_manager.cc:359] Metadata directory not provided
I20260923 17:16:35.071653 25170 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 23 17:16:35 dist-test-slave-1x1f krb5kdc[23974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183795, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.130@KRBTEST.COM for HTTP/127.11.229.148@KRBTEST.COM
I20260923 17:16:35.095686 25170 fs_manager.cc:709] Time spent opening directory manager: real 0.007s user 0.003s sys 0.000s
I20260923 17:16:35.098960 25188 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:16:35.100663 25170 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260923 17:16:35.100793 25170 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-1/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-1/wal
uuid: "d904bee1570547aa85d156e988acd1c4"
format_stamp: "Formatted at 2026-09-23 17:16:33 on dist-test-slave-1x1f"
server_key: "2f10720816eb41219538fa1b4f7d584e"
server_key_iv: "95fda7d8337569280bcf365ab9300ddf"
server_key_version: "kuduclusterkey@0"
I20260923 17:16:35.101569 25170 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:16:35.121717 25170 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:16:35.129760 25170 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:16:35.130054 25170 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:16:35.130877 25170 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:16:35.132002 25170 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:16:35.132117 25170 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:16:35.132225 25170 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:16:35.132323 25170 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:16:35.144657 25170 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.130:44693
I20260923 17:16:35.144754 25301 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.130:44693 every 8 connection(s)
I20260923 17:16:35.146157 25170 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
I20260923 17:16:35.151432 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 25170
I20260923 17:16:35.151890 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.229.148:59551/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.131:33389
--local_ip_for_outbound_sockets=127.11.229.131
--tserver_master_addrs=127.11.229.190:43655
--webserver_port=42291
--webserver_interface=127.11.229.131
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab
--principal=kudu/127.11.229.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:45411
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.229.148:59551/kms with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 23 17:16:35 dist-test-slave-1x1f krb5kdc[23974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183795, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.130@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:16:35.164075 25171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:35.148302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:46567 (local address 127.11.229.190:43655)
0923 17:16:35.148430 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:35.148434 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:35.149733 (+ 1299us) server_negotiation.cc:407] Connection header received
0923 17:16:35.150759 (+ 1026us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:35.150763 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:35.150826 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:35.150904 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:16:35.152342 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:35.153206 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:35.154970 (+ 1764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:35.155370 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:35.155458 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:35.158780 (+ 3322us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:16:35.158787 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:16:35.158793 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:16:35.158826 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:16:35.160880 (+ 2054us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:35.161611 (+ 731us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:35.161615 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:35.161616 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:35.161710 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:35.162462 (+ 752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:35.162468 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:35.162471 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:35.162766 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:16:35.162863 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:35.163639 (+ 776us) server_negotiation.cc:299] Negotiation successful
0923 17:16:35.163817 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260923 17:16:35.166267 25304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:35.148944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:43655 (local address 127.11.229.130:46567)
0923 17:16:35.149583 (+ 639us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:35.149626 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0923 17:16:35.150552 (+ 926us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:16:35.151072 (+ 520us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:16:35.151079 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:16:35.151463 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:16:35.152161 (+ 698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:35.152183 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:35.153389 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:35.153394 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:35.154800 (+ 1406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:35.154811 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:35.155749 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:35.155753 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:35.155956 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:35.156636 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:16:35.156658 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:16:35.158572 (+ 1914us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:16:35.161039 (+ 2467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:16:35.161049 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:16:35.161071 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:16:35.161474 (+ 403us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:16:35.161879 (+ 405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:16:35.161885 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:16:35.161889 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:16:35.162337 (+ 448us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:16:35.162961 (+ 624us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:16:35.162969 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:16:35.163325 (+ 356us) client_negotiation.cc:769] Sending connection context
0923 17:16:35.164650 (+ 1325us) client_negotiation.cc:240] Negotiation successful
0923 17:16:35.165051 (+ 401us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":197,"threads_started":1}
I20260923 17:16:35.168126 25302 heartbeater.cc:347] Connected to a master server at 127.11.229.190:43655
I20260923 17:16:35.168365 25302 heartbeater.cc:464] Registering TS with master...
I20260923 17:16:35.168920 25302 heartbeater.cc:511] Master 127.11.229.190:43655 requested a full tablet report, sending...
W20260923 17:16:35.170579 25302 heartbeater.cc:644] Failed to heartbeat to 127.11.229.190:43655 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260923 17:16:35.170692 25302 heartbeater.cc:464] Registering TS with master...
I20260923 17:16:35.170851 25302 heartbeater.cc:511] Master 127.11.229.190:43655 requested a full tablet report, sending...
I20260923 17:16:35.171635 25302 heartbeater.cc:464] Registering TS with master...
I20260923 17:16:35.171787 25302 heartbeater.cc:511] Master 127.11.229.190:43655 requested a full tablet report, sending...
W20260923 17:16:35.172492 25302 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260923 17:16:35.290741 25305 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:16:35.291062 25305 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:16:35.291139 25305 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:16:35.295385 25305 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:16:35.295460 25305 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:16:35.295562 25305 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.131
I20260923 17:16:35.302842 25305 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:45411
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.229.148:59551/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab
--principal=kudu/127.11.229.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.131:33389
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.229.131
--webserver_port=42291
--tserver_master_addrs=127.11.229.190:43655
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25305
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.131
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:16:35.304203 25305 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:16:35.305203 25305 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:16:35.316037 25314 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:16:35.316045 25312 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:16:35.316049 25311 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:16:35.318447 25305 server_base.cc:1034] running on GCE node
I20260923 17:16:35.318919 25305 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:16:35.319728 25305 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:16:35.320915 25305 hybrid_clock.cc:648] HybridClock initialized: now 1790183795320888 us; error 43 us; skew 500 ppm
Sep 23 17:16:35 dist-test-slave-1x1f krb5kdc[23974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183795, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:16:35.325166 25305 init.cc:377] Logged in from keytab as kudu/127.11.229.131@KRBTEST.COM (short username kudu)
I20260923 17:16:35.326295 25305 webserver.cc:460] Webserver started at http://127.11.229.131:42291/ using document root <none> and password file <none>
I20260923 17:16:35.327056 25305 fs_manager.cc:359] Metadata directory not provided
I20260923 17:16:35.327224 25305 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 23 17:16:35 dist-test-slave-1x1f krb5kdc[23974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183795, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.131@KRBTEST.COM for HTTP/127.11.229.148@KRBTEST.COM
I20260923 17:16:35.346436 25305 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260923 17:16:35.351095 25322 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:16:35.352788 25305 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260923 17:16:35.353053 25305 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-2/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-2/wal
uuid: "1bb7124f7f7f4bcdbe99e14350a5a884"
format_stamp: "Formatted at 2026-09-23 17:16:34 on dist-test-slave-1x1f"
server_key: "e167539d0201264f697c96c79b0dd616"
server_key_iv: "4a2a362049a037fdb05355a5c4f69511"
server_key_version: "kuduclusterkey@0"
I20260923 17:16:35.353824 25305 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:16:35.372653 25305 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:16:35.375866 25305 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:16:35.376086 25305 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:16:35.376813 25305 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:16:35.377737 25305 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:16:35.377802 25305 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:16:35.377854 25305 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:16:35.377923 25305 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:16:35.388717 25305 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.131:33389
I20260923 17:16:35.388797 25435 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.131:33389 every 8 connection(s)
I20260923 17:16:35.389714 25305 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
I20260923 17:16:35.392472 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 25305
Sep 23 17:16:35 dist-test-slave-1x1f krb5kdc[23974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183795, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.131@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:16:35.405864 25171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:35.391682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:34031 (local address 127.11.229.190:43655)
0923 17:16:35.391834 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:35.391839 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:35.392638 (+ 799us) server_negotiation.cc:407] Connection header received
0923 17:16:35.393803 (+ 1165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:35.393807 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:35.393861 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:35.393951 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:16:35.396012 (+ 2061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:35.396597 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:35.398433 (+ 1836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:35.398783 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:35.398859 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:35.401765 (+ 2906us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:16:35.401769 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:16:35.401771 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:16:35.401796 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:16:35.403468 (+ 1672us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:35.404110 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:35.404114 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:35.404116 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:35.404202 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:35.404621 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:35.404624 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:35.404626 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:35.404841 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:16:35.404909 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:35.405574 (+ 665us) server_negotiation.cc:299] Negotiation successful
0923 17:16:35.405713 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58,"spinlock_wait_cycles":3712}
I20260923 17:16:35.406888 25439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:35.393119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40300 (local address 127.11.229.190:43655)
0923 17:16:35.393726 (+ 607us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:35.393731 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:35.393745 (+ 14us) server_negotiation.cc:407] Connection header received
0923 17:16:35.393788 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:35.393791 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:35.393842 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:35.393954 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:16:35.394818 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:35.395347 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:35.396338 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:35.396676 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:35.397980 (+ 1304us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:35.400054 (+ 2074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:16:35.400058 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:16:35.400061 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:16:35.400086 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:16:35.404926 (+ 4840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:35.405470 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:35.405476 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:35.405479 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:35.405569 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:35.405892 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:35.405897 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:35.405901 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:35.406094 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:16:35.406331 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:35.406601 (+ 270us) server_negotiation.cc:299] Negotiation successful
0923 17:16:35.406715 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":527,"spinlock_wait_cycles":2816,"thread_start_us":88,"threads_started":1}
I20260923 17:16:35.407429 25438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:35.392043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:43655 (local address 127.11.229.131:34031)
0923 17:16:35.392492 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:35.392541 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0923 17:16:35.393575 (+ 1034us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:16:35.394324 (+ 749us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:16:35.394333 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:16:35.394666 (+ 333us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:16:35.395845 (+ 1179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:35.395865 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:35.396717 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:35.396722 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:35.397882 (+ 1160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:35.397894 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:35.399042 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:35.399046 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:35.399237 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:35.399837 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:16:35.399857 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:16:35.401582 (+ 1725us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:16:35.403609 (+ 2027us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:16:35.403615 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:16:35.403632 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:16:35.403974 (+ 342us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:16:35.404314 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:16:35.404317 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:16:35.404319 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:16:35.404506 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:16:35.404991 (+ 485us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:16:35.404997 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:16:35.405291 (+ 294us) client_negotiation.cc:769] Sending connection context
0923 17:16:35.406037 (+ 746us) client_negotiation.cc:240] Negotiation successful
0923 17:16:35.406404 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":133,"threads_started":1}
I20260923 17:16:35.408492 25436 heartbeater.cc:347] Connected to a master server at 127.11.229.190:43655
I20260923 17:16:35.408721 25436 heartbeater.cc:464] Registering TS with master...
I20260923 17:16:35.409255 25436 heartbeater.cc:511] Master 127.11.229.190:43655 requested a full tablet report, sending...
W20260923 17:16:35.410739 25436 heartbeater.cc:644] Failed to heartbeat to 127.11.229.190:43655 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260923 17:16:35.410869 25436 heartbeater.cc:464] Registering TS with master...
I20260923 17:16:35.411047 25436 heartbeater.cc:511] Master 127.11.229.190:43655 requested a full tablet report, sending...
I20260923 17:16:35.411803 25436 heartbeater.cc:464] Registering TS with master...
I20260923 17:16:35.411974 25436 heartbeater.cc:511] Master 127.11.229.190:43655 requested a full tablet report, sending...
W20260923 17:16:35.412714 25436 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Sep 23 17:16:35 dist-test-slave-1x1f krb5kdc[23974](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790183795, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:16:35.933429 25168 heartbeater.cc:464] Registering TS with master...
I20260923 17:16:35.933784 25168 heartbeater.cc:511] Master 127.11.229.190:43655 requested a full tablet report, sending...
I20260923 17:16:35.935214 24967 ts_manager.cc:194] Registered new tserver with Master: daeece74cda34948ac76b14ec12a3e4d (127.11.229.129:40575)
I20260923 17:16:35.937363 24967 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.129@KRBTEST.COM'} at 127.11.229.129:60517
I20260923 17:16:36.172744 25302 heartbeater.cc:464] Registering TS with master...
I20260923 17:16:36.173082 25302 heartbeater.cc:511] Master 127.11.229.190:43655 requested a full tablet report, sending...
I20260923 17:16:36.173969 24967 ts_manager.cc:194] Registered new tserver with Master: d904bee1570547aa85d156e988acd1c4 (127.11.229.130:44693)
I20260923 17:16:36.174791 24967 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.130@KRBTEST.COM'} at 127.11.229.130:46567
Sep 23 17:16:36 dist-test-slave-1x1f krb5kdc[23974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183795, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for HTTP/127.11.229.148@KRBTEST.COM
I20260923 17:16:36.412972 25436 heartbeater.cc:464] Registering TS with master...
I20260923 17:16:36.413275 25436 heartbeater.cc:511] Master 127.11.229.190:43655 requested a full tablet report, sending...
I20260923 17:16:36.414153 24967 ts_manager.cc:194] Registered new tserver with Master: 1bb7124f7f7f4bcdbe99e14350a5a884 (127.11.229.131:33389)
I20260923 17:16:36.414973 24967 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.131@KRBTEST.COM'} at 127.11.229.131:34031
I20260923 17:16:36.417744 12182 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 17:16:36.429200 25459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:36.419340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40306 (local address 127.11.229.190:43655)
0923 17:16:36.419899 (+ 559us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:36.419903 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:36.419915 (+ 12us) server_negotiation.cc:407] Connection header received
0923 17:16:36.419951 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:36.419954 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:36.419996 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:36.420080 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:16:36.420958 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:36.421745 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:36.422927 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:36.423252 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:36.423351 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:36.425046 (+ 1695us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:16:36.425050 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:16:36.425053 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:16:36.425079 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:16:36.427139 (+ 2060us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:36.427655 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:36.427659 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:36.427661 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:36.427790 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:36.428097 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:36.428101 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:36.428103 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:36.428333 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:16:36.428469 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:36.428785 (+ 316us) server_negotiation.cc:299] Negotiation successful
0923 17:16:36.429009 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":490,"thread_start_us":75,"threads_started":1}
I20260923 17:16:36.433743 24967 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40306:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 17:16:36.439064 24967 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 17:16:36.466509 25464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:36.453767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:40575 (local address 127.0.0.1:57012)
0923 17:16:36.458381 (+ 4614us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:36.458394 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 17:16:36.458494 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:16:36.459053 (+ 559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:16:36.459059 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:16:36.459082 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:16:36.459432 (+ 350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:36.459442 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:36.462143 (+ 2701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:36.462146 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:36.463824 (+ 1678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:36.463834 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:36.465940 (+ 2106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:36.465944 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:36.466048 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:36.466083 (+ 35us) client_negotiation.cc:769] Sending connection context
0923 17:16:36.466191 (+ 108us) client_negotiation.cc:240] Negotiation successful
0923 17:16:36.466328 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4544,"thread_start_us":85,"threads_started":1}
I20260923 17:16:36.467239 25468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:36.454157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57012 (local address 127.11.229.129:40575)
0923 17:16:36.455159 (+ 1002us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:36.455166 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:36.458599 (+ 3433us) server_negotiation.cc:407] Connection header received
0923 17:16:36.458700 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:36.458707 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:36.458911 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:36.459068 (+ 157us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:16:36.459571 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:36.461989 (+ 2418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:36.463963 (+ 1974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:36.465581 (+ 1618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:36.465714 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:36.465877 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:36.466966 (+ 1089us) server_negotiation.cc:299] Negotiation successful
0923 17:16:36.467080 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":899,"thread_start_us":104,"threads_started":1}
I20260923 17:16:36.469491 25465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:36.452182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36860 (local address 127.11.229.131:33389)
0923 17:16:36.459798 (+ 7616us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:36.459805 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:36.459829 (+ 24us) server_negotiation.cc:407] Connection header received
0923 17:16:36.459917 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:36.459923 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:36.460104 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:36.460259 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:16:36.462137 (+ 1878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:36.463368 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:36.467867 (+ 4499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:36.468685 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:36.468786 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:36.468895 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:36.469246 (+ 351us) server_negotiation.cc:299] Negotiation successful
0923 17:16:36.469356 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":328,"thread_start_us":105,"threads_started":1}
I20260923 17:16:36.470055 25467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:36.452032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.131:33389 (local address 127.0.0.1:36860)
0923 17:16:36.454710 (+ 2678us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:36.454763 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0923 17:16:36.454888 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:16:36.460359 (+ 5471us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:16:36.460362 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:16:36.460380 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:16:36.460482 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:36.460489 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:36.466610 (+ 6121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:36.466614 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:36.467704 (+ 1090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:36.467716 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:36.468997 (+ 1281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:36.469000 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:36.469094 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:36.469115 (+ 21us) client_negotiation.cc:769] Sending connection context
0923 17:16:36.469848 (+ 733us) client_negotiation.cc:240] Negotiation successful
0923 17:16:36.469927 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2502,"thread_start_us":124,"threads_started":1}
I20260923 17:16:36.470561 25469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:36.454743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47680 (local address 127.11.229.130:44693)
0923 17:16:36.462466 (+ 7723us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:36.462473 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:36.462497 (+ 24us) server_negotiation.cc:407] Connection header received
0923 17:16:36.462579 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:36.462585 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:36.462785 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:36.462948 (+ 163us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:16:36.463324 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:36.464441 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:36.465739 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:36.466517 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:36.466646 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:36.466761 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:36.470320 (+ 3559us) server_negotiation.cc:299] Negotiation successful
0923 17:16:36.470424 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7598,"thread_start_us":104,"threads_started":1}
I20260923 17:16:36.467235 25466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:36.453154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.130:44693 (local address 127.0.0.1:47680)
0923 17:16:36.455290 (+ 2136us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:36.455303 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 17:16:36.455384 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:16:36.463094 (+ 7710us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:16:36.463097 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:16:36.463115 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:16:36.463203 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:36.463208 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:36.464570 (+ 1362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:36.464574 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:36.465615 (+ 1041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:36.465627 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:36.466830 (+ 1203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:36.466833 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:36.466946 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:36.466968 (+ 22us) client_negotiation.cc:769] Sending connection context
0923 17:16:36.467037 (+ 69us) client_negotiation.cc:240] Negotiation successful
0923 17:16:36.467095 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2080,"thread_start_us":88,"threads_started":1}
I20260923 17:16:36.470826 25102 tablet_service.cc:1467] Processing CreateTablet for tablet 7f4e77811bec428482ecfdeb574ffe9b (DEFAULT_TABLE table=test-table [id=7ef17149d80147248ff81c19901b8f80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:16:36.473121 25370 tablet_service.cc:1467] Processing CreateTablet for tablet 7f4e77811bec428482ecfdeb574ffe9b (DEFAULT_TABLE table=test-table [id=7ef17149d80147248ff81c19901b8f80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:16:36.473457 25235 tablet_service.cc:1467] Processing CreateTablet for tablet 7f4e77811bec428482ecfdeb574ffe9b (DEFAULT_TABLE table=test-table [id=7ef17149d80147248ff81c19901b8f80]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:16:36.474187 25370 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f4e77811bec428482ecfdeb574ffe9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:16:36.474411 25235 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f4e77811bec428482ecfdeb574ffe9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:16:36.481822 25102 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f4e77811bec428482ecfdeb574ffe9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:16:36.491693 25472 tablet_bootstrap.cc:492] T 7f4e77811bec428482ecfdeb574ffe9b P d904bee1570547aa85d156e988acd1c4: Bootstrap starting.
I20260923 17:16:36.492714 25471 tablet_bootstrap.cc:492] T 7f4e77811bec428482ecfdeb574ffe9b P 1bb7124f7f7f4bcdbe99e14350a5a884: Bootstrap starting.
Sep 23 17:16:36 dist-test-slave-1x1f krb5kdc[23974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183795, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for HTTP/127.11.229.148@KRBTEST.COM
I20260923 17:16:36.494937 25472 tablet_bootstrap.cc:654] T 7f4e77811bec428482ecfdeb574ffe9b P d904bee1570547aa85d156e988acd1c4: Neither blocks nor log segments found. Creating new log.
I20260923 17:16:36.495309 25473 tablet_bootstrap.cc:492] T 7f4e77811bec428482ecfdeb574ffe9b P daeece74cda34948ac76b14ec12a3e4d: Bootstrap starting.
I20260923 17:16:36.501840 25471 tablet_bootstrap.cc:654] T 7f4e77811bec428482ecfdeb574ffe9b P 1bb7124f7f7f4bcdbe99e14350a5a884: Neither blocks nor log segments found. Creating new log.
I20260923 17:16:36.502795 25471 log.cc:824] T 7f4e77811bec428482ecfdeb574ffe9b P 1bb7124f7f7f4bcdbe99e14350a5a884: Log is configured to *not* fsync() on all Append() calls
I20260923 17:16:36.503873 25473 tablet_bootstrap.cc:654] T 7f4e77811bec428482ecfdeb574ffe9b P daeece74cda34948ac76b14ec12a3e4d: Neither blocks nor log segments found. Creating new log.
I20260923 17:16:36.504300 25472 log.cc:824] T 7f4e77811bec428482ecfdeb574ffe9b P d904bee1570547aa85d156e988acd1c4: Log is configured to *not* fsync() on all Append() calls
I20260923 17:16:36.504703 25473 log.cc:824] T 7f4e77811bec428482ecfdeb574ffe9b P daeece74cda34948ac76b14ec12a3e4d: Log is configured to *not* fsync() on all Append() calls
I20260923 17:16:36.508208 25471 tablet_bootstrap.cc:492] T 7f4e77811bec428482ecfdeb574ffe9b P 1bb7124f7f7f4bcdbe99e14350a5a884: No bootstrap required, opened a new log
I20260923 17:16:36.508432 25471 ts_tablet_manager.cc:1397] T 7f4e77811bec428482ecfdeb574ffe9b P 1bb7124f7f7f4bcdbe99e14350a5a884: Time spent bootstrapping tablet: real 0.016s user 0.006s sys 0.000s
I20260923 17:16:36.510941 25472 tablet_bootstrap.cc:492] T 7f4e77811bec428482ecfdeb574ffe9b P d904bee1570547aa85d156e988acd1c4: No bootstrap required, opened a new log
I20260923 17:16:36.511176 25472 ts_tablet_manager.cc:1397] T 7f4e77811bec428482ecfdeb574ffe9b P d904bee1570547aa85d156e988acd1c4: Time spent bootstrapping tablet: real 0.020s user 0.006s sys 0.000s
I20260923 17:16:36.513049 25471 raft_consensus.cc:348] T 7f4e77811bec428482ecfdeb574ffe9b P 1bb7124f7f7f4bcdbe99e14350a5a884 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bb7124f7f7f4bcdbe99e14350a5a884" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 33389 } } peers { permanent_uuid: "d904bee1570547aa85d156e988acd1c4" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44693 } } peers { permanent_uuid: "daeece74cda34948ac76b14ec12a3e4d" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 40575 } }
I20260923 17:16:36.513514 25471 raft_consensus.cc:374] T 7f4e77811bec428482ecfdeb574ffe9b P 1bb7124f7f7f4bcdbe99e14350a5a884 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:16:36.513625 25471 raft_consensus.cc:729] T 7f4e77811bec428482ecfdeb574ffe9b P 1bb7124f7f7f4bcdbe99e14350a5a884 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bb7124f7f7f4bcdbe99e14350a5a884, State: Initialized, Role: FOLLOWER
I20260923 17:16:36.514186 25471 consensus_queue.cc:260] T 7f4e77811bec428482ecfdeb574ffe9b P 1bb7124f7f7f4bcdbe99e14350a5a884 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bb7124f7f7f4bcdbe99e14350a5a884" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 33389 } } peers { permanent_uuid: "d904bee1570547aa85d156e988acd1c4" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44693 } } peers { permanent_uuid: "daeece74cda34948ac76b14ec12a3e4d" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 40575 } }
I20260923 17:16:36.515118 25472 raft_consensus.cc:348] T 7f4e77811bec428482ecfdeb574ffe9b P d904bee1570547aa85d156e988acd1c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bb7124f7f7f4bcdbe99e14350a5a884" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 33389 } } peers { permanent_uuid: "d904bee1570547aa85d156e988acd1c4" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44693 } } peers { permanent_uuid: "daeece74cda34948ac76b14ec12a3e4d" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 40575 } }
I20260923 17:16:36.515410 25472 raft_consensus.cc:374] T 7f4e77811bec428482ecfdeb574ffe9b P d904bee1570547aa85d156e988acd1c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:16:36.515462 25471 ts_tablet_manager.cc:1428] T 7f4e77811bec428482ecfdeb574ffe9b P 1bb7124f7f7f4bcdbe99e14350a5a884: Time spent starting tablet: real 0.007s user 0.003s sys 0.004s
I20260923 17:16:36.515501 25472 raft_consensus.cc:729] T 7f4e77811bec428482ecfdeb574ffe9b P d904bee1570547aa85d156e988acd1c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d904bee1570547aa85d156e988acd1c4, State: Initialized, Role: FOLLOWER
I20260923 17:16:36.515884 25436 heartbeater.cc:503] Master 127.11.229.190:43655 was elected leader, sending a full tablet report...
I20260923 17:16:36.515959 25472 consensus_queue.cc:260] T 7f4e77811bec428482ecfdeb574ffe9b P d904bee1570547aa85d156e988acd1c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bb7124f7f7f4bcdbe99e14350a5a884" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 33389 } } peers { permanent_uuid: "d904bee1570547aa85d156e988acd1c4" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44693 } } peers { permanent_uuid: "daeece74cda34948ac76b14ec12a3e4d" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 40575 } }
I20260923 17:16:36.516883 25472 ts_tablet_manager.cc:1428] T 7f4e77811bec428482ecfdeb574ffe9b P d904bee1570547aa85d156e988acd1c4: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260923 17:16:36.517230 25302 heartbeater.cc:503] Master 127.11.229.190:43655 was elected leader, sending a full tablet report...
I20260923 17:16:36.520349 25473 tablet_bootstrap.cc:492] T 7f4e77811bec428482ecfdeb574ffe9b P daeece74cda34948ac76b14ec12a3e4d: No bootstrap required, opened a new log
I20260923 17:16:36.520562 25473 ts_tablet_manager.cc:1397] T 7f4e77811bec428482ecfdeb574ffe9b P daeece74cda34948ac76b14ec12a3e4d: Time spent bootstrapping tablet: real 0.025s user 0.000s sys 0.005s
I20260923 17:16:36.524536 25473 raft_consensus.cc:348] T 7f4e77811bec428482ecfdeb574ffe9b P daeece74cda34948ac76b14ec12a3e4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bb7124f7f7f4bcdbe99e14350a5a884" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 33389 } } peers { permanent_uuid: "d904bee1570547aa85d156e988acd1c4" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44693 } } peers { permanent_uuid: "daeece74cda34948ac76b14ec12a3e4d" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 40575 } }
I20260923 17:16:36.524843 25473 raft_consensus.cc:374] T 7f4e77811bec428482ecfdeb574ffe9b P daeece74cda34948ac76b14ec12a3e4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:16:36.524937 25473 raft_consensus.cc:729] T 7f4e77811bec428482ecfdeb574ffe9b P daeece74cda34948ac76b14ec12a3e4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: daeece74cda34948ac76b14ec12a3e4d, State: Initialized, Role: FOLLOWER
I20260923 17:16:36.525419 25473 consensus_queue.cc:260] T 7f4e77811bec428482ecfdeb574ffe9b P daeece74cda34948ac76b14ec12a3e4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bb7124f7f7f4bcdbe99e14350a5a884" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 33389 } } peers { permanent_uuid: "d904bee1570547aa85d156e988acd1c4" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44693 } } peers { permanent_uuid: "daeece74cda34948ac76b14ec12a3e4d" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 40575 } }
I20260923 17:16:36.526592 25473 ts_tablet_manager.cc:1428] T 7f4e77811bec428482ecfdeb574ffe9b P daeece74cda34948ac76b14ec12a3e4d: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260923 17:16:36.526976 25168 heartbeater.cc:503] Master 127.11.229.190:43655 was elected leader, sending a full tablet report...
I20260923 17:16:36.594982 25477 raft_consensus.cc:482] T 7f4e77811bec428482ecfdeb574ffe9b P 1bb7124f7f7f4bcdbe99e14350a5a884 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 17:16:36.595201 25477 raft_consensus.cc:504] T 7f4e77811bec428482ecfdeb574ffe9b P 1bb7124f7f7f4bcdbe99e14350a5a884 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bb7124f7f7f4bcdbe99e14350a5a884" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 33389 } } peers { permanent_uuid: "d904bee1570547aa85d156e988acd1c4" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44693 } } peers { permanent_uuid: "daeece74cda34948ac76b14ec12a3e4d" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 40575 } }
I20260923 17:16:36.596570 25477 leader_election.cc:288] T 7f4e77811bec428482ecfdeb574ffe9b P 1bb7124f7f7f4bcdbe99e14350a5a884 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d904bee1570547aa85d156e988acd1c4 (127.11.229.130:44693), daeece74cda34948ac76b14ec12a3e4d (127.11.229.129:40575)
I20260923 17:16:36.611359 25469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:36.597452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:42635 (local address 127.11.229.130:44693)
0923 17:16:36.597574 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:36.597580 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:36.606706 (+ 9126us) server_negotiation.cc:407] Connection header received
0923 17:16:36.606997 (+ 291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:36.607001 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:36.607051 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:36.607099 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:16:36.607571 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:36.608410 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:36.610053 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:36.610661 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:36.610758 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:36.610809 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:36.611135 (+ 326us) server_negotiation.cc:299] Negotiation successful
0923 17:16:36.611213 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260923 17:16:36.612004 25482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:36.596843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.130:44693 (local address 127.11.229.131:42635)
0923 17:16:36.606531 (+ 9688us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:36.606552 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0923 17:16:36.606808 (+ 256us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:16:36.607268 (+ 460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:16:36.607271 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:16:36.607290 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:16:36.607441 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:36.607448 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:36.608588 (+ 1140us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:36.608591 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:36.609909 (+ 1318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:36.609921 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:36.610904 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:36.610907 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:36.611003 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:36.611026 (+ 23us) client_negotiation.cc:769] Sending connection context
0923 17:16:36.611774 (+ 748us) client_negotiation.cc:240] Negotiation successful
0923 17:16:36.611857 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9578,"thread_start_us":99,"threads_started":1}
I20260923 17:16:36.612833 25253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f4e77811bec428482ecfdeb574ffe9b" candidate_uuid: "1bb7124f7f7f4bcdbe99e14350a5a884" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d904bee1570547aa85d156e988acd1c4" is_pre_election: true
I20260923 17:16:36.613175 25253 raft_consensus.cc:2454] T 7f4e77811bec428482ecfdeb574ffe9b P d904bee1570547aa85d156e988acd1c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1bb7124f7f7f4bcdbe99e14350a5a884 in term 0.
I20260923 17:16:36.613654 25325 leader_election.cc:302] T 7f4e77811bec428482ecfdeb574ffe9b P 1bb7124f7f7f4bcdbe99e14350a5a884 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bb7124f7f7f4bcdbe99e14350a5a884, d904bee1570547aa85d156e988acd1c4; no voters:
I20260923 17:16:36.613993 25477 raft_consensus.cc:2781] T 7f4e77811bec428482ecfdeb574ffe9b P 1bb7124f7f7f4bcdbe99e14350a5a884 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 17:16:36.614068 25477 raft_consensus.cc:482] T 7f4e77811bec428482ecfdeb574ffe9b P 1bb7124f7f7f4bcdbe99e14350a5a884 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 17:16:36.614107 25477 raft_consensus.cc:3037] T 7f4e77811bec428482ecfdeb574ffe9b P 1bb7124f7f7f4bcdbe99e14350a5a884 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:16:36.615645 25477 raft_consensus.cc:504] T 7f4e77811bec428482ecfdeb574ffe9b P 1bb7124f7f7f4bcdbe99e14350a5a884 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bb7124f7f7f4bcdbe99e14350a5a884" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 33389 } } peers { permanent_uuid: "d904bee1570547aa85d156e988acd1c4" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44693 } } peers { permanent_uuid: "daeece74cda34948ac76b14ec12a3e4d" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 40575 } }
I20260923 17:16:36.616019 25477 leader_election.cc:288] T 7f4e77811bec428482ecfdeb574ffe9b P 1bb7124f7f7f4bcdbe99e14350a5a884 [CANDIDATE]: Term 1 election: Requested vote from peers d904bee1570547aa85d156e988acd1c4 (127.11.229.130:44693), daeece74cda34948ac76b14ec12a3e4d (127.11.229.129:40575)
I20260923 17:16:36.616581 25253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f4e77811bec428482ecfdeb574ffe9b" candidate_uuid: "1bb7124f7f7f4bcdbe99e14350a5a884" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d904bee1570547aa85d156e988acd1c4"
I20260923 17:16:36.616707 25253 raft_consensus.cc:3037] T 7f4e77811bec428482ecfdeb574ffe9b P d904bee1570547aa85d156e988acd1c4 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:16:36.617981 25253 raft_consensus.cc:2454] T 7f4e77811bec428482ecfdeb574ffe9b P d904bee1570547aa85d156e988acd1c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bb7124f7f7f4bcdbe99e14350a5a884 in term 1.
I20260923 17:16:36.618476 25325 leader_election.cc:302] T 7f4e77811bec428482ecfdeb574ffe9b P 1bb7124f7f7f4bcdbe99e14350a5a884 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bb7124f7f7f4bcdbe99e14350a5a884, d904bee1570547aa85d156e988acd1c4; no voters:
I20260923 17:16:36.618749 25477 raft_consensus.cc:2781] T 7f4e77811bec428482ecfdeb574ffe9b P 1bb7124f7f7f4bcdbe99e14350a5a884 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:16:36.619025 25477 raft_consensus.cc:686] T 7f4e77811bec428482ecfdeb574ffe9b P 1bb7124f7f7f4bcdbe99e14350a5a884 [term 1 LEADER]: Becoming Leader. State: Replica: 1bb7124f7f7f4bcdbe99e14350a5a884, State: Running, Role: LEADER
I20260923 17:16:36.619349 25479 raft_consensus.cc:482] T 7f4e77811bec428482ecfdeb574ffe9b P daeece74cda34948ac76b14ec12a3e4d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 17:16:36.619529 25479 raft_consensus.cc:504] T 7f4e77811bec428482ecfdeb574ffe9b P daeece74cda34948ac76b14ec12a3e4d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bb7124f7f7f4bcdbe99e14350a5a884" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 33389 } } peers { permanent_uuid: "d904bee1570547aa85d156e988acd1c4" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44693 } } peers { permanent_uuid: "daeece74cda34948ac76b14ec12a3e4d" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 40575 } }
I20260923 17:16:36.619815 25477 consensus_queue.cc:237] T 7f4e77811bec428482ecfdeb574ffe9b P 1bb7124f7f7f4bcdbe99e14350a5a884 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bb7124f7f7f4bcdbe99e14350a5a884" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 33389 } } peers { permanent_uuid: "d904bee1570547aa85d156e988acd1c4" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44693 } } peers { permanent_uuid: "daeece74cda34948ac76b14ec12a3e4d" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 40575 } }
I20260923 17:16:36.620712 25479 leader_election.cc:288] T 7f4e77811bec428482ecfdeb574ffe9b P daeece74cda34948ac76b14ec12a3e4d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1bb7124f7f7f4bcdbe99e14350a5a884 (127.11.229.131:33389), d904bee1570547aa85d156e988acd1c4 (127.11.229.130:44693)
I20260923 17:16:36.623548 24967 catalog_manager.cc:5495] T 7f4e77811bec428482ecfdeb574ffe9b P 1bb7124f7f7f4bcdbe99e14350a5a884 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1bb7124f7f7f4bcdbe99e14350a5a884 (127.11.229.131). New cstate: current_term: 1 leader_uuid: "1bb7124f7f7f4bcdbe99e14350a5a884" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bb7124f7f7f4bcdbe99e14350a5a884" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 33389 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d904bee1570547aa85d156e988acd1c4" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "daeece74cda34948ac76b14ec12a3e4d" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 40575 } health_report { overall_health: UNKNOWN } } }
I20260923 17:16:36.629331 25468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:36.597464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:49029 (local address 127.11.229.129:40575)
0923 17:16:36.597591 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:36.597597 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:36.612686 (+ 15089us) server_negotiation.cc:407] Connection header received
0923 17:16:36.612960 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:36.612963 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:36.613013 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:36.613059 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:16:36.624770 (+ 11711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:36.625515 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:36.627998 (+ 2483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:36.628645 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:36.628769 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:36.628822 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:36.629122 (+ 300us) server_negotiation.cc:299] Negotiation successful
0923 17:16:36.629202 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260923 17:16:36.629907 25482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:36.597027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:40575 (local address 127.11.229.131:49029)
0923 17:16:36.612609 (+ 15582us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:36.612624 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 17:16:36.612756 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:16:36.613318 (+ 562us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:16:36.613321 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:16:36.613350 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:16:36.624622 (+ 11272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:36.624631 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:36.626002 (+ 1371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:36.626005 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:36.627852 (+ 1847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:36.627864 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:36.628884 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:36.628888 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:36.628982 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:36.629006 (+ 24us) client_negotiation.cc:769] Sending connection context
0923 17:16:36.629690 (+ 684us) client_negotiation.cc:240] Negotiation successful
0923 17:16:36.629775 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15524,"thread_start_us":98,"threads_started":1}
I20260923 17:16:36.630709 25120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f4e77811bec428482ecfdeb574ffe9b" candidate_uuid: "1bb7124f7f7f4bcdbe99e14350a5a884" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "daeece74cda34948ac76b14ec12a3e4d" is_pre_election: true
I20260923 17:16:36.630951 25120 raft_consensus.cc:2454] T 7f4e77811bec428482ecfdeb574ffe9b P daeece74cda34948ac76b14ec12a3e4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1bb7124f7f7f4bcdbe99e14350a5a884 in term 0.
I20260923 17:16:36.631255 25118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f4e77811bec428482ecfdeb574ffe9b" candidate_uuid: "1bb7124f7f7f4bcdbe99e14350a5a884" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "daeece74cda34948ac76b14ec12a3e4d"
I20260923 17:16:36.631364 25118 raft_consensus.cc:3037] T 7f4e77811bec428482ecfdeb574ffe9b P daeece74cda34948ac76b14ec12a3e4d [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:16:36.632665 25118 raft_consensus.cc:2454] T 7f4e77811bec428482ecfdeb574ffe9b P daeece74cda34948ac76b14ec12a3e4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bb7124f7f7f4bcdbe99e14350a5a884 in term 1.
I20260923 17:16:36.635305 25465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:36.621591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:42667 (local address 127.11.229.131:33389)
0923 17:16:36.621717 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:36.621721 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:36.630697 (+ 8976us) server_negotiation.cc:407] Connection header received
0923 17:16:36.630860 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:36.630863 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:36.630913 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:36.630985 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:16:36.631428 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:36.632213 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:36.633933 (+ 1720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:36.634643 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:36.634732 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:36.634781 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:36.635105 (+ 324us) server_negotiation.cc:299] Negotiation successful
0923 17:16:36.635184 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260923 17:16:36.635722 25485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:36.621526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.131:33389 (local address 127.11.229.129:42667)
0923 17:16:36.630616 (+ 9090us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:36.630629 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 17:16:36.630758 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:16:36.631127 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:16:36.631131 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:16:36.631145 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:16:36.631287 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:36.631296 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:36.632361 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:36.632365 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:36.633790 (+ 1425us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:36.633801 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:36.634873 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:36.634876 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:36.634975 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:36.634996 (+ 21us) client_negotiation.cc:769] Sending connection context
0923 17:16:36.635472 (+ 476us) client_negotiation.cc:240] Negotiation successful
0923 17:16:36.635556 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9031,"mutex_wait_us":132,"thread_start_us":99,"threads_started":1}
I20260923 17:16:36.636837 25390 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f4e77811bec428482ecfdeb574ffe9b" candidate_uuid: "daeece74cda34948ac76b14ec12a3e4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bb7124f7f7f4bcdbe99e14350a5a884" is_pre_election: true
I20260923 17:16:36.637993 25484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:36.621102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.130:44693 (local address 127.11.229.129:49297)
0923 17:16:36.630382 (+ 9280us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:36.630398 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 17:16:36.630890 (+ 492us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:16:36.631243 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:16:36.631247 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:16:36.631263 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:16:36.631380 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:36.631387 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:36.632361 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:36.632365 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:36.636600 (+ 4235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:36.636609 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:36.637549 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:36.637553 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:36.637659 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:36.637701 (+ 42us) client_negotiation.cc:769] Sending connection context
0923 17:16:36.637778 (+ 77us) client_negotiation.cc:240] Negotiation successful
0923 17:16:36.637853 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9211,"mutex_wait_us":3156,"thread_start_us":126,"threads_started":1}
I20260923 17:16:36.638456 25469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:36.621147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:49297 (local address 127.11.229.130:44693)
0923 17:16:36.621292 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:36.621297 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:36.630479 (+ 9182us) server_negotiation.cc:407] Connection header received
0923 17:16:36.631016 (+ 537us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:36.631019 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:36.631073 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:36.631121 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:16:36.631493 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:36.632219 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:36.636729 (+ 4510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:36.637329 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:36.637573 (+ 244us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:36.637628 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:36.638242 (+ 614us) server_negotiation.cc:299] Negotiation successful
0923 17:16:36.638335 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260923 17:16:36.638860 25253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f4e77811bec428482ecfdeb574ffe9b" candidate_uuid: "daeece74cda34948ac76b14ec12a3e4d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d904bee1570547aa85d156e988acd1c4" is_pre_election: true
I20260923 17:16:36.639115 25253 raft_consensus.cc:2379] T 7f4e77811bec428482ecfdeb574ffe9b P d904bee1570547aa85d156e988acd1c4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate daeece74cda34948ac76b14ec12a3e4d in current term 1: Already voted for candidate 1bb7124f7f7f4bcdbe99e14350a5a884 in this term.
I20260923 17:16:36.639611 25057 leader_election.cc:302] T 7f4e77811bec428482ecfdeb574ffe9b P daeece74cda34948ac76b14ec12a3e4d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: daeece74cda34948ac76b14ec12a3e4d; no voters: 1bb7124f7f7f4bcdbe99e14350a5a884, d904bee1570547aa85d156e988acd1c4
I20260923 17:16:36.639866 25479 raft_consensus.cc:2726] T 7f4e77811bec428482ecfdeb574ffe9b P daeece74cda34948ac76b14ec12a3e4d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260923 17:16:36.641546 25437 tablet.cc:2369] T 7f4e77811bec428482ecfdeb574ffe9b P 1bb7124f7f7f4bcdbe99e14350a5a884: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 17:16:36.645443 25169 tablet.cc:2369] T 7f4e77811bec428482ecfdeb574ffe9b P daeece74cda34948ac76b14ec12a3e4d: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 17:16:36.648366 25303 tablet.cc:2369] T 7f4e77811bec428482ecfdeb574ffe9b P d904bee1570547aa85d156e988acd1c4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 17:16:36.659899 25465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:36.656180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36872 (local address 127.11.229.131:33389)
0923 17:16:36.656312 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:36.656317 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:36.656331 (+ 14us) server_negotiation.cc:407] Connection header received
0923 17:16:36.656513 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:36.656515 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:36.656568 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:36.656678 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 17:16:36.656925 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:36.657436 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:36.658332 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:36.658565 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:36.658673 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:36.658994 (+ 321us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 17:16:36.659497 (+ 503us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 17:16:36.659614 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:36.659680 (+ 66us) server_negotiation.cc:299] Negotiation successful
0923 17:16:36.659734 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260923 17:16:36.666674 25253 raft_consensus.cc:1261] T 7f4e77811bec428482ecfdeb574ffe9b P d904bee1570547aa85d156e988acd1c4 [term 1 FOLLOWER]: Refusing update from remote peer 1bb7124f7f7f4bcdbe99e14350a5a884: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:16:36.666718 25118 raft_consensus.cc:1261] T 7f4e77811bec428482ecfdeb574ffe9b P daeece74cda34948ac76b14ec12a3e4d [term 1 FOLLOWER]: Refusing update from remote peer 1bb7124f7f7f4bcdbe99e14350a5a884: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:16:36.667344 25483 consensus_queue.cc:1035] T 7f4e77811bec428482ecfdeb574ffe9b P 1bb7124f7f7f4bcdbe99e14350a5a884 [LEADER]: Connected to new peer: Peer: permanent_uuid: "daeece74cda34948ac76b14ec12a3e4d" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 40575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:16:36.667551 25477 consensus_queue.cc:1035] T 7f4e77811bec428482ecfdeb574ffe9b P 1bb7124f7f7f4bcdbe99e14350a5a884 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d904bee1570547aa85d156e988acd1c4" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:16:36.680135 25490 mvcc.cc:205] Tried to move back new op lower bound from 7332592831137562624 to 7332592830958755840. Current Snapshot: MvccSnapshot[applied={T|T < 7332592831137562624}]
I20260923 17:16:36.681558 25491 mvcc.cc:205] Tried to move back new op lower bound from 7332592831137562624 to 7332592830958755840. Current Snapshot: MvccSnapshot[applied={T|T < 7332592831137562624}]
I20260923 17:16:36.695358 24967 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40306:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:16:36.695546 24967 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40306:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:16:36.698532 24967 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3dd901efa92e4e2eaaa1e13a16c796d8: Sending DeleteTablet for 3 replicas of tablet 7f4e77811bec428482ecfdeb574ffe9b
I20260923 17:16:36.700065 25370 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f4e77811bec428482ecfdeb574ffe9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:16:36 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:36860
I20260923 17:16:36.700587 25102 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f4e77811bec428482ecfdeb574ffe9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:16:36 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:57012
I20260923 17:16:36.701254 25235 tablet_service.cc:1514] Processing DeleteTablet for tablet 7f4e77811bec428482ecfdeb574ffe9b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:16:36 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:47680
I20260923 17:16:36.702734 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 25008
I20260923 17:16:36.707939 25500 tablet_replica.cc:330] T 7f4e77811bec428482ecfdeb574ffe9b P d904bee1570547aa85d156e988acd1c4: stopping tablet replica
I20260923 17:16:36.708216 25498 tablet_replica.cc:330] T 7f4e77811bec428482ecfdeb574ffe9b P 1bb7124f7f7f4bcdbe99e14350a5a884: stopping tablet replica
I20260923 17:16:36.708650 25498 raft_consensus.cc:2229] T 7f4e77811bec428482ecfdeb574ffe9b P 1bb7124f7f7f4bcdbe99e14350a5a884 [term 1 LEADER]: Raft consensus shutting down.
I20260923 17:16:36.709033 25500 raft_consensus.cc:2229] T 7f4e77811bec428482ecfdeb574ffe9b P d904bee1570547aa85d156e988acd1c4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:16:36.709589 25498 raft_consensus.cc:2258] T 7f4e77811bec428482ecfdeb574ffe9b P 1bb7124f7f7f4bcdbe99e14350a5a884 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:16:36.709965 25500 raft_consensus.cc:2258] T 7f4e77811bec428482ecfdeb574ffe9b P d904bee1570547aa85d156e988acd1c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:16:36.711862 25500 ts_tablet_manager.cc:1905] T 7f4e77811bec428482ecfdeb574ffe9b P d904bee1570547aa85d156e988acd1c4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:16:36.713161 25498 ts_tablet_manager.cc:1905] T 7f4e77811bec428482ecfdeb574ffe9b P 1bb7124f7f7f4bcdbe99e14350a5a884: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:16:36.719256 25498 ts_tablet_manager.cc:1918] T 7f4e77811bec428482ecfdeb574ffe9b P 1bb7124f7f7f4bcdbe99e14350a5a884: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 17:16:36.722049 25500 ts_tablet_manager.cc:1918] T 7f4e77811bec428482ecfdeb574ffe9b P d904bee1570547aa85d156e988acd1c4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260923 17:16:36.723188 24957 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.229.129:40575 (error 108)
I20260923 17:16:36.724021 25500 log.cc:1196] T 7f4e77811bec428482ecfdeb574ffe9b P d904bee1570547aa85d156e988acd1c4: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-1/wal/wals/7f4e77811bec428482ecfdeb574ffe9b
I20260923 17:16:36.724296 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 25170
I20260923 17:16:36.728334 25498 log.cc:1196] T 7f4e77811bec428482ecfdeb574ffe9b P 1bb7124f7f7f4bcdbe99e14350a5a884: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790183633736342-12182-0/minicluster-data/ts-2/wal/wals/7f4e77811bec428482ecfdeb574ffe9b
I20260923 17:16:36.731256 25464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:36.730890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:40575 (local address 127.0.0.1:57014)
0923 17:16:36.731091 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:36.731163 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.129:40575: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122}
W20260923 17:16:36.731523 24957 catalog_manager.cc:4584] TS daeece74cda34948ac76b14ec12a3e4d (127.11.229.129:40575): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7f4e77811bec428482ecfdeb574ffe9b: Network error: Client connection negotiation failed: client connection to 127.11.229.129:40575: connect: Connection refused (error 111)
I20260923 17:16:36.732159 25498 ts_tablet_manager.cc:1939] T 7f4e77811bec428482ecfdeb574ffe9b P 1bb7124f7f7f4bcdbe99e14350a5a884: Deleting consensus metadata
I20260923 17:16:36.733557 24957 catalog_manager.cc:4841] TS 1bb7124f7f7f4bcdbe99e14350a5a884 (127.11.229.131:33389): tablet 7f4e77811bec428482ecfdeb574ffe9b (table test-table [id=7ef17149d80147248ff81c19901b8f80]) successfully deleted
W20260923 17:16:36.738209 25464 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:16:36.737639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.130:44693 (local address 127.0.0.1:47684)
0923 17:16:36.737813 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:36.737828 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 17:16:36.737917 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:16:36.738098 (+ 181us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.130:44693: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":88}
I20260923 17:16:36.738934 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 25305
I20260923 17:16:36.744894 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 24937
I20260923 17:16:36.753593 12182 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260923 17:16:37.088613 12182 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260923 17:16:37.088740 12182 mini_ranger.cc:66] Stopping Ranger...
I20260923 17:16:37.434137 12182 mini_ranger.cc:68] Stopped Ranger
2026-09-23 17:16:37.434 UTC [24004] LOG: received smart shutdown request
2026-09-23 17:16:37.439 UTC [24004] LOG: background worker "logical replication launcher" (PID 24013) exited with exit code 1
2026-09-23 17:16:37.439 UTC [24008] LOG: shutting down
2026-09-23 17:16:37.640 UTC [24004] LOG: database system is shut down
2026-09-23T17:16:37Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (49438 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 17:16:37 dist-test-slave-1x1f krb5kdc[25510](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 17:16:37 dist-test-slave-1x1f krb5kdc[25510](info): set up 2 sockets
Sep 23 17:16:37 dist-test-slave-1x1f krb5kdc[25510](info): commencing operation
krb5kdc: starting...
W20260923 17:16:38.818854 12182 mini_kdc.cc:121] Time spent starting KDC: real 1.030s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Sep 23 17:16:38 dist-test-slave-1x1f krb5kdc[25510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183798, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T17:16:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:16:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.229.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
I20260923 17:16:38.943428 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:42633
--webserver_interface=127.11.229.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:38289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:42633,127.11.229.189:32779,127.11.229.188:45817
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:16:39.056717 25523 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:16:39.057025 25523 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:16:39.057098 25523 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:16:39.061053 25523 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:16:39.061141 25523 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:16:39.061177 25523 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:16:39.061240 25523 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:16:39.061291 25523 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:16:39.066591 25523 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:38289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:42633,127.11.229.189:32779,127.11.229.188:45817
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:42633
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.229.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25523
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:16:39.067713 25523 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:16:39.068710 25523 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:16:39.076970 25531 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:16:39.076992 25528 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:16:39.077085 25523 server_base.cc:1034] running on GCE node
W20260923 17:16:39.076973 25529 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:16:39.077775 25523 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:16:39.078938 25523 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:16:39.080129 25523 hybrid_clock.cc:648] HybridClock initialized: now 1790183799080133 us; error 56 us; skew 500 ppm
Sep 23 17:16:39 dist-test-slave-1x1f krb5kdc[25510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183799, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:16:39.082954 25523 init.cc:377] Logged in from keytab as kudu/127.11.229.190@KRBTEST.COM (short username kudu)
I20260923 17:16:39.083909 25523 webserver.cc:460] Webserver started at http://127.11.229.190:44901/ using document root <none> and password file <none>
I20260923 17:16:39.084512 25523 fs_manager.cc:359] Metadata directory not provided
I20260923 17:16:39.084606 25523 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:16:39.084851 25523 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:16:39.087042 25523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "3e859e04d1ae4e14b11b4f277eab0c4a"
format_stamp: "Formatted at 2026-09-23 17:16:39 on dist-test-slave-1x1f"
server_key: "93c5c24e114f03b6f67b0b34a43204d9"
server_key_iv: "0c92a70f2bfd6b6e7b41fa8d6066dc19"
server_key_version: "encryptionkey@0"
I20260923 17:16:39.087668 25523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "3e859e04d1ae4e14b11b4f277eab0c4a"
format_stamp: "Formatted at 2026-09-23 17:16:39 on dist-test-slave-1x1f"
server_key: "93c5c24e114f03b6f67b0b34a43204d9"
server_key_iv: "0c92a70f2bfd6b6e7b41fa8d6066dc19"
server_key_version: "encryptionkey@0"
I20260923 17:16:39.091775 25523 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260923 17:16:39.094336 25539 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:16:39.095608 25523 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 17:16:39.095752 25523 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "3e859e04d1ae4e14b11b4f277eab0c4a"
format_stamp: "Formatted at 2026-09-23 17:16:39 on dist-test-slave-1x1f"
server_key: "93c5c24e114f03b6f67b0b34a43204d9"
server_key_iv: "0c92a70f2bfd6b6e7b41fa8d6066dc19"
server_key_version: "encryptionkey@0"
I20260923 17:16:39.095870 25523 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:16:39.121325 25523 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:16:39.124637 25523 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:16:39.124899 25523 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:16:39.132378 25523 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.190:42633
I20260923 17:16:39.132725 25591 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.190:42633 every 8 connection(s)
I20260923 17:16:39.133416 25523 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:16:39.136199 25592 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:16:39.140087 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 25523
I20260923 17:16:39.140336 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:16:39.140043 25592 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.229.190" port: 42633 } has no permanent_uuid. Determining permanent_uuid...
I20260923 17:16:39.140703 12182 external_mini_cluster.cc:1428] Setting key b9efe8643b65299cdc51211e8e182ef3
WARNING: no policy specified for kudu/127.11.229.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.189@KRBTEST.COM" created.
Sep 23 17:16:39 dist-test-slave-1x1f krb5kdc[25510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183799, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:16:39.159360 25596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:39.142646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:42633 (local address 127.0.0.1:51784)
0923 17:16:39.143259 (+ 613us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:39.143317 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0923 17:16:39.144533 (+ 1216us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:16:39.145269 (+ 736us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:16:39.145276 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:16:39.145758 (+ 482us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:16:39.146035 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:39.146048 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:39.148120 (+ 2072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:39.148123 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:39.148948 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:39.148958 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:39.149972 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:39.149980 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:39.150108 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:39.150744 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:16:39.150764 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:16:39.154076 (+ 3312us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:16:39.156169 (+ 2093us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:16:39.156180 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:16:39.156191 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:16:39.156438 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:16:39.156779 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:16:39.156782 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:16:39.156784 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:16:39.156900 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:16:39.157525 (+ 625us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:16:39.157533 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:16:39.157680 (+ 147us) client_negotiation.cc:769] Sending connection context
0923 17:16:39.157862 (+ 182us) client_negotiation.cc:240] Negotiation successful
0923 17:16:39.158308 (+ 446us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":429,"mutex_wait_us":107,"spinlock_wait_cycles":36736,"thread_start_us":147,"threads_started":1}
I20260923 17:16:39.159360 25595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:39.142646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51784 (local address 127.11.229.190:42633)
0923 17:16:39.143178 (+ 532us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:39.143208 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:39.143428 (+ 220us) server_negotiation.cc:407] Connection header received
0923 17:16:39.144863 (+ 1435us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:39.144868 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:39.145055 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:39.145231 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:16:39.146211 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:39.147955 (+ 1744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:39.149090 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:39.149774 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:39.149983 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:39.154276 (+ 4293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:16:39.154289 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:16:39.154299 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:16:39.154320 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:16:39.156049 (+ 1729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:39.156554 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:39.156560 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:39.156562 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:39.156673 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:39.157001 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:39.157004 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:39.157006 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:39.157408 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:16:39.157557 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:39.157927 (+ 370us) server_negotiation.cc:299] Negotiation successful
0923 17:16:39.158194 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":147,"threads_started":1}
I20260923 17:16:39.161805 25592 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.229.189" port: 32779 } has no permanent_uuid. Determining permanent_uuid...
I20260923 17:16:39.162672 25596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:39.162381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.189:32779 (local address 127.0.0.1:43722)
0923 17:16:39.162503 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:39.162584 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.189:32779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260923 17:16:39.162890 25541 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.229.189:32779: connect: Connection refused (error 111)
I20260923 17:16:39.163793 25596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:39.163590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.189:32779 (local address 127.0.0.1:43738)
0923 17:16:39.163692 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:39.163740 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.189:32779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260923 17:16:39.163944 25592 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.229.189:32779: Network error: Client connection negotiation failed: client connection to 127.11.229.189:32779: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.189.keytab.
Entry for principal kudu/127.11.229.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.189.keytab.
I20260923 17:16:39.170113 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.189:32779
--webserver_interface=127.11.229.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.189.keytab
--principal=kudu/127.11.229.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:38289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:42633,127.11.229.189:32779,127.11.229.188:45817
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 17:16:39.213219 25592 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.229.189" port: 32779 } attempt: 1
I20260923 17:16:39.214151 25596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:39.213835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.189:32779 (local address 127.0.0.1:43754)
0923 17:16:39.213998 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:39.214065 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.189:32779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260923 17:16:39.214941 25596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:39.214710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.189:32779 (local address 127.0.0.1:43768)
0923 17:16:39.214829 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:39.214883 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.189:32779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260923 17:16:39.215075 25592 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.229.189:32779: Network error: Client connection negotiation failed: client connection to 127.11.229.189:32779: connect: Connection refused (error 111)
W20260923 17:16:39.279318 25599 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:16:39.279597 25599 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:16:39.279666 25599 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260923 17:16:39.283241 25592 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.229.189" port: 32779 } attempt: 2
W20260923 17:16:39.283710 25599 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:16:39.283777 25599 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:16:39.283833 25599 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:16:39.283910 25599 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:16:39.283944 25599 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:16:39.284149 25596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:39.283763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.189:32779 (local address 127.0.0.1:43772)
0923 17:16:39.283991 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:39.284062 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.189:32779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
I20260923 17:16:39.284886 25596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:39.284668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.189:32779 (local address 127.0.0.1:43774)
0923 17:16:39.284767 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:39.284826 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.189:32779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260923 17:16:39.285018 25592 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.229.189:32779: Network error: Client connection negotiation failed: client connection to 127.11.229.189:32779: connect: Connection refused (error 111)
I20260923 17:16:39.289553 25599 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:38289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:42633,127.11.229.189:32779,127.11.229.188:45817
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.189.keytab
--principal=kudu/127.11.229.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.189:32779
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.229.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25599
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:16:39.290539 25599 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:16:39.291458 25599 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:16:39.299558 25607 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:16:39.299530 25604 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:16:39.299626 25599 server_base.cc:1034] running on GCE node
W20260923 17:16:39.299518 25605 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:16:39.300376 25599 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:16:39.301476 25599 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:16:39.302637 25599 hybrid_clock.cc:648] HybridClock initialized: now 1790183799302605 us; error 45 us; skew 500 ppm
Sep 23 17:16:39 dist-test-slave-1x1f krb5kdc[25510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183799, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:16:39.305691 25599 init.cc:377] Logged in from keytab as kudu/127.11.229.189@KRBTEST.COM (short username kudu)
I20260923 17:16:39.306818 25599 webserver.cc:460] Webserver started at http://127.11.229.189:46591/ using document root <none> and password file <none>
I20260923 17:16:39.307371 25599 fs_manager.cc:359] Metadata directory not provided
I20260923 17:16:39.307448 25599 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:16:39.307643 25599 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:16:39.309743 25599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/minicluster-data/master-1/data/instance:
uuid: "68185cfcba7342d1810babb4e2e47898"
format_stamp: "Formatted at 2026-09-23 17:16:39 on dist-test-slave-1x1f"
server_key: "b9b2a34678c913ea310250dd98671b29"
server_key_iv: "4f4da162b919a09c33e406d0c906b1c1"
server_key_version: "encryptionkey@0"
I20260923 17:16:39.310359 25599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/minicluster-data/master-1/wal/instance:
uuid: "68185cfcba7342d1810babb4e2e47898"
format_stamp: "Formatted at 2026-09-23 17:16:39 on dist-test-slave-1x1f"
server_key: "b9b2a34678c913ea310250dd98671b29"
server_key_iv: "4f4da162b919a09c33e406d0c906b1c1"
server_key_version: "encryptionkey@0"
I20260923 17:16:39.314117 25599 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260923 17:16:39.316560 25614 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:16:39.317797 25599 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 17:16:39.317934 25599 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/minicluster-data/master-1/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/minicluster-data/master-1/wal
uuid: "68185cfcba7342d1810babb4e2e47898"
format_stamp: "Formatted at 2026-09-23 17:16:39 on dist-test-slave-1x1f"
server_key: "b9b2a34678c913ea310250dd98671b29"
server_key_iv: "4f4da162b919a09c33e406d0c906b1c1"
server_key_version: "encryptionkey@0"
I20260923 17:16:39.318046 25599 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:16:39.334893 25599 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:16:39.337903 25599 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:16:39.338093 25599 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:16:39.344987 25599 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.189:32779
I20260923 17:16:39.345269 25667 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.189:32779 every 8 connection(s)
I20260923 17:16:39.345973 25599 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/minicluster-data/master-1/data/info.pb
I20260923 17:16:39.346458 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 25599
I20260923 17:16:39.346598 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/minicluster-data/master-1/wal/instance
I20260923 17:16:39.346903 12182 external_mini_cluster.cc:1428] Setting key 9398896c52e339c01b287af7b24d3103
I20260923 17:16:39.348877 25668 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:16:39.352494 25668 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.229.190" port: 42633 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.11.229.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.188@KRBTEST.COM" created.
Sep 23 17:16:39 dist-test-slave-1x1f krb5kdc[25510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183799, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.189@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:16:39.366055 25595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:39.354508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51792 (local address 127.11.229.190:42633)
0923 17:16:39.354667 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:39.354672 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:39.355412 (+ 740us) server_negotiation.cc:407] Connection header received
0923 17:16:39.356255 (+ 843us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:39.356258 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:39.356351 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:39.356445 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:16:39.357651 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:39.358415 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:39.359500 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:39.359732 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:39.359848 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:39.362541 (+ 2693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:16:39.362549 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:16:39.362551 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:16:39.362573 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:16:39.363979 (+ 1406us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:39.364472 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:39.364479 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:39.364481 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:39.364551 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:39.364923 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:39.364928 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:39.364930 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:39.365098 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:16:39.365216 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:39.365766 (+ 550us) server_negotiation.cc:299] Negotiation successful
0923 17:16:39.365887 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260923 17:16:39.366842 25671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:39.354770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:42633 (local address 127.0.0.1:51792)
0923 17:16:39.355264 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:39.355305 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0923 17:16:39.356075 (+ 770us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:16:39.356631 (+ 556us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:16:39.356642 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:16:39.357038 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:16:39.357507 (+ 469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:39.357520 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:39.358537 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:39.358540 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:39.359379 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:39.359388 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:39.359882 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:39.359886 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:39.360080 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:39.360665 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:16:39.360681 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:16:39.362390 (+ 1709us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:16:39.364090 (+ 1700us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:16:39.364096 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:16:39.364109 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:16:39.364365 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:16:39.364693 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:16:39.364696 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:16:39.364698 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:16:39.364831 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:16:39.365215 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:16:39.365221 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:16:39.365507 (+ 286us) client_negotiation.cc:769] Sending connection context
0923 17:16:39.365686 (+ 179us) client_negotiation.cc:240] Negotiation successful
0923 17:16:39.365989 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":116,"threads_started":1}
I20260923 17:16:39.368124 25668 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.229.189" port: 32779 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.188.keytab.
Entry for principal kudu/127.11.229.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.188.keytab.
Sep 23 17:16:39 dist-test-slave-1x1f krb5kdc[25510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183799, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.189@KRBTEST.COM for kudu/127.11.229.189@KRBTEST.COM
I20260923 17:16:39.374018 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.188:45817
--webserver_interface=127.11.229.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.188.keytab
--principal=kudu/127.11.229.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:38289
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:42633,127.11.229.189:32779,127.11.229.188:45817
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 17:16:39.376200 25592 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.229.189" port: 32779 } attempt: 3
I20260923 17:16:39.377908 25671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:39.368595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.189:32779 (local address 127.0.0.1:43786)
0923 17:16:39.368780 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:39.368796 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 17:16:39.368909 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:16:39.369618 (+ 709us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:16:39.369624 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:16:39.369832 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:16:39.369977 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:39.369984 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:39.371013 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:39.371019 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:39.371539 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:39.371545 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:39.372118 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:39.372121 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:39.372289 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:39.372734 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:16:39.372755 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:16:39.373917 (+ 1162us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:16:39.376271 (+ 2354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:16:39.376275 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:16:39.376277 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:16:39.376526 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:16:39.376854 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:16:39.376857 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:16:39.376858 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:16:39.376943 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:16:39.377428 (+ 485us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:16:39.377431 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:16:39.377511 (+ 80us) client_negotiation.cc:769] Sending connection context
0923 17:16:39.377608 (+ 97us) client_negotiation.cc:240] Negotiation successful
0923 17:16:39.377734 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62,"mutex_wait_us":49}
I20260923 17:16:39.378605 25673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:39.368766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43786 (local address 127.11.229.189:32779)
0923 17:16:39.369119 (+ 353us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:39.369133 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:39.369157 (+ 24us) server_negotiation.cc:407] Connection header received
0923 17:16:39.369202 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:39.369221 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:39.369487 (+ 266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:39.369632 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:16:39.370084 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:39.370899 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:39.371646 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:39.372003 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:39.372110 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:39.374041 (+ 1931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:16:39.374050 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:16:39.374068 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:16:39.374086 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:16:39.376052 (+ 1966us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:39.376648 (+ 596us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:39.376655 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:39.376656 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:39.376751 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:39.377043 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:39.377048 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:39.377053 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:39.377327 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:16:39.377464 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:39.378372 (+ 908us) server_negotiation.cc:299] Negotiation successful
0923 17:16:39.378482 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":24,"server-negotiator.queue_time_us":239,"thread_start_us":156,"threads_started":1}
I20260923 17:16:39.380991 25668 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.229.188" port: 45817 } has no permanent_uuid. Determining permanent_uuid...
I20260923 17:16:39.381800 25671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:39.381488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:45817 (local address 127.0.0.1:40668)
0923 17:16:39.381628 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:39.381718 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.188:45817: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
Sep 23 17:16:39 dist-test-slave-1x1f krb5kdc[25510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183799, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for kudu/127.11.229.189@KRBTEST.COM
W20260923 17:16:39.382848 25618 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.229.188:45817: connect: Connection refused (error 111)
I20260923 17:16:39.384208 25671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:39.383927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:45817 (local address 127.0.0.1:40674)
0923 17:16:39.384065 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:39.384127 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.188:45817: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260923 17:16:39.384426 25668 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.229.188:45817: Network error: Client connection negotiation failed: client connection to 127.11.229.188:45817: connect: Connection refused (error 111)
I20260923 17:16:39.386701 25596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:39.376688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.189:32779 (local address 127.0.0.1:43790)
0923 17:16:39.376852 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:39.376869 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 17:16:39.376955 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:16:39.377577 (+ 622us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:16:39.377583 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:16:39.377767 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:16:39.377887 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:39.377894 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:39.379070 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:39.379073 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:39.380158 (+ 1085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:39.380168 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:39.380656 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:39.380660 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:39.380779 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:39.381223 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:16:39.381236 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:16:39.382676 (+ 1440us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:16:39.385267 (+ 2591us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:16:39.385269 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:16:39.385271 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:16:39.385493 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:16:39.385799 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:16:39.385801 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:16:39.385803 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:16:39.385872 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:16:39.386302 (+ 430us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:16:39.386304 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:16:39.386409 (+ 105us) client_negotiation.cc:769] Sending connection context
0923 17:16:39.386493 (+ 84us) client_negotiation.cc:240] Negotiation successful
0923 17:16:39.386594 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":57}
I20260923 17:16:39.386821 25675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:39.376943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43790 (local address 127.11.229.189:32779)
0923 17:16:39.377297 (+ 354us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:39.377308 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:39.377323 (+ 15us) server_negotiation.cc:407] Connection header received
0923 17:16:39.377359 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:39.377365 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:39.377416 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:39.377549 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:16:39.378014 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:39.378954 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:39.380298 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:39.380549 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:39.380653 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:39.382855 (+ 2202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:16:39.382861 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:16:39.382864 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:16:39.382897 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:16:39.385149 (+ 2252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:39.385592 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:39.385597 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:39.385601 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:39.385699 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:39.385949 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:39.385952 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:39.385954 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:39.386154 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:16:39.386298 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:39.386560 (+ 262us) server_negotiation.cc:299] Negotiation successful
0923 17:16:39.386668 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":267,"thread_start_us":101,"threads_started":1}
I20260923 17:16:39.387445 25592 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.229.188" port: 45817 } has no permanent_uuid. Determining permanent_uuid...
I20260923 17:16:39.388113 25596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:39.387863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:45817 (local address 127.0.0.1:40690)
0923 17:16:39.387996 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:39.388050 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.188:45817: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260923 17:16:39.388759 25596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:39.388528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:45817 (local address 127.0.0.1:40696)
0923 17:16:39.388655 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:39.388703 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.188:45817: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
W20260923 17:16:39.388924 25592 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.229.188:45817: Network error: Client connection negotiation failed: client connection to 127.11.229.188:45817: connect: Connection refused (error 111)
I20260923 17:16:39.420107 25592 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.229.188" port: 45817 } attempt: 1
I20260923 17:16:39.421057 25596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:39.420745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:45817 (local address 127.0.0.1:40712)
0923 17:16:39.420908 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:39.420975 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.188:45817: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260923 17:16:39.421969 25596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:39.421734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:45817 (local address 127.0.0.1:40726)
0923 17:16:39.421852 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:39.421907 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.188:45817: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260923 17:16:39.422111 25592 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.229.188:45817: Network error: Client connection negotiation failed: client connection to 127.11.229.188:45817: connect: Connection refused (error 111)
I20260923 17:16:39.433693 25668 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.229.188" port: 45817 } attempt: 1
I20260923 17:16:39.434556 25671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:39.434205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:45817 (local address 127.0.0.1:40736)
0923 17:16:39.434396 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:39.434462 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.188:45817: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
I20260923 17:16:39.435391 25671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:39.435051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:45817 (local address 127.0.0.1:40744)
0923 17:16:39.435270 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:39.435326 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.188:45817: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260923 17:16:39.435532 25668 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.229.188:45817: Network error: Client connection negotiation failed: client connection to 127.11.229.188:45817: connect: Connection refused (error 111)
W20260923 17:16:39.487986 25674 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:16:39.488299 25674 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:16:39.488375 25674 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:16:39.492374 25674 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:16:39.492426 25674 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:16:39.492445 25674 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:16:39.492462 25674 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:16:39.492517 25674 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:16:39.497288 25592 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.229.188" port: 45817 } attempt: 2
I20260923 17:16:39.497764 25674 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:38289
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:42633,127.11.229.189:32779,127.11.229.188:45817
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.188.keytab
--principal=kudu/127.11.229.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.188:45817
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.229.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25674
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:16:39.498067 25596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:39.497786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:45817 (local address 127.0.0.1:40746)
0923 17:16:39.497930 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:39.497996 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.188:45817: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260923 17:16:39.498843 25596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:39.498615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:45817 (local address 127.0.0.1:40750)
0923 17:16:39.498718 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:39.498769 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.188:45817: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260923 17:16:39.499048 25674 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
W20260923 17:16:39.499078 25592 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.229.188:45817: Network error: Client connection negotiation failed: client connection to 127.11.229.188:45817: connect: Connection refused (error 111)
I20260923 17:16:39.500084 25674 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260923 17:16:39.503731 25668 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.229.188" port: 45817 } attempt: 2
I20260923 17:16:39.504536 25671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:39.504139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:45817 (local address 127.0.0.1:40754)
0923 17:16:39.504422 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:39.504468 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.188:45817: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183}
I20260923 17:16:39.505259 25671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:39.505021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:45817 (local address 127.0.0.1:40764)
0923 17:16:39.505124 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:39.505170 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.188:45817: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260923 17:16:39.505370 25668 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.229.188:45817: Network error: Client connection negotiation failed: client connection to 127.11.229.188:45817: connect: Connection refused (error 111)
W20260923 17:16:39.508388 25684 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:16:39.508441 25674 server_base.cc:1034] running on GCE node
W20260923 17:16:39.508452 25681 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:16:39.508482 25682 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:16:39.509137 25674 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:16:39.510337 25674 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:16:39.511511 25674 hybrid_clock.cc:648] HybridClock initialized: now 1790183799511486 us; error 28 us; skew 500 ppm
Sep 23 17:16:39 dist-test-slave-1x1f krb5kdc[25510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183799, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:16:39.514362 25674 init.cc:377] Logged in from keytab as kudu/127.11.229.188@KRBTEST.COM (short username kudu)
I20260923 17:16:39.515172 25674 webserver.cc:460] Webserver started at http://127.11.229.188:40363/ using document root <none> and password file <none>
I20260923 17:16:39.515678 25674 fs_manager.cc:359] Metadata directory not provided
I20260923 17:16:39.515735 25674 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:16:39.515897 25674 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:16:39.517864 25674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/minicluster-data/master-2/data/instance:
uuid: "7f88375f39664fb4882be0078dcf92c5"
format_stamp: "Formatted at 2026-09-23 17:16:39 on dist-test-slave-1x1f"
server_key: "fbd2c1779cf3a24b26386e300fef2c72"
server_key_iv: "8d0cf121c5de28ca502f0ea840873a13"
server_key_version: "encryptionkey@0"
I20260923 17:16:39.518476 25674 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/minicluster-data/master-2/wal/instance:
uuid: "7f88375f39664fb4882be0078dcf92c5"
format_stamp: "Formatted at 2026-09-23 17:16:39 on dist-test-slave-1x1f"
server_key: "fbd2c1779cf3a24b26386e300fef2c72"
server_key_iv: "8d0cf121c5de28ca502f0ea840873a13"
server_key_version: "encryptionkey@0"
I20260923 17:16:39.522113 25674 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s
I20260923 17:16:39.524705 25691 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:16:39.525894 25674 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260923 17:16:39.526047 25674 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/minicluster-data/master-2/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/minicluster-data/master-2/wal
uuid: "7f88375f39664fb4882be0078dcf92c5"
format_stamp: "Formatted at 2026-09-23 17:16:39 on dist-test-slave-1x1f"
server_key: "fbd2c1779cf3a24b26386e300fef2c72"
server_key_iv: "8d0cf121c5de28ca502f0ea840873a13"
server_key_version: "encryptionkey@0"
I20260923 17:16:39.526180 25674 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:16:39.548918 25674 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:16:39.552131 25674 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:16:39.552318 25674 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:16:39.559528 25674 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.188:45817
I20260923 17:16:39.559815 25743 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.188:45817 every 8 connection(s)
I20260923 17:16:39.560482 25674 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/minicluster-data/master-2/data/info.pb
I20260923 17:16:39.561154 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 25674
I20260923 17:16:39.561292 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790183633736342-12182-0/minicluster-data/master-2/wal/instance
I20260923 17:16:39.561587 12182 external_mini_cluster.cc:1428] Setting key d1f8eb5db6d988610c12441a25c50658
I20260923 17:16:39.563681 25744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:16:39.568164 25744 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.229.190" port: 42633 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 17:16:39 dist-test-slave-1x1f krb5kdc[25510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183798, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.229.188@KRBTEST.COM
Sep 23 17:16:39 dist-test-slave-1x1f krb5kdc[25510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183799, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.188@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:16:39.576879 25747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:39.562984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40774 (local address 127.11.229.188:45817)
0923 17:16:39.563358 (+ 374us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:39.563378 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:39.563422 (+ 44us) server_negotiation.cc:407] Connection header received
0923 17:16:39.564234 (+ 812us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:39.564256 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:39.564644 (+ 388us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:39.564991 (+ 347us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:16:39.565694 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:39.567228 (+ 1534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:39.568193 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:39.568858 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:39.569014 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:39.572094 (+ 3080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:16:39.572099 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:16:39.572108 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:16:39.572132 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:16:39.573880 (+ 1748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:39.574384 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:39.574390 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:39.574395 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:39.574624 (+ 229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:39.574914 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:39.574917 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:39.574919 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:39.575397 (+ 478us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:16:39.575549 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:39.575903 (+ 354us) server_negotiation.cc:299] Negotiation successful
0923 17:16:39.576194 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":238,"thread_start_us":95,"threads_started":1}
I20260923 17:16:39.579945 25749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:39.569928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:42633 (local address 127.0.0.1:51796)
0923 17:16:39.570320 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:39.570366 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0923 17:16:39.570513 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:16:39.570891 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:16:39.570900 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:16:39.571389 (+ 489us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:16:39.571513 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:39.571518 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:39.572430 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:39.572432 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:39.573441 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:39.573452 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:39.573893 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:39.573896 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:39.574018 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:39.574544 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:16:39.574558 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:16:39.576208 (+ 1650us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:16:39.578161 (+ 1953us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:16:39.578167 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:16:39.578170 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:16:39.578550 (+ 380us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:16:39.578833 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:16:39.578835 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:16:39.578837 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:16:39.578908 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:16:39.579352 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:16:39.579359 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:16:39.579463 (+ 104us) client_negotiation.cc:769] Sending connection context
0923 17:16:39.579585 (+ 122us) client_negotiation.cc:240] Negotiation successful
0923 17:16:39.579754 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":91,"threads_started":1}
I20260923 17:16:39.579978 25595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:39.569994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51796 (local address 127.11.229.190:42633)
0923 17:16:39.570152 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:39.570156 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:39.570433 (+ 277us) server_negotiation.cc:407] Connection header received
0923 17:16:39.570648 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:39.570653 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:39.570714 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:39.570829 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:16:39.571637 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:39.572294 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:39.573562 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:39.573768 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:39.573862 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:39.576423 (+ 2561us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:16:39.576426 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:16:39.576428 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:16:39.576452 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:16:39.578056 (+ 1604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:39.578648 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:39.578651 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:39.578653 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:39.578739 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:39.579009 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:39.579012 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:39.579014 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:39.579261 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:16:39.579354 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:39.579656 (+ 302us) server_negotiation.cc:299] Negotiation successful
0923 17:16:39.579836 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":43,"server-negotiator.queue_time_us":54}
I20260923 17:16:39.580890 25744 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.229.189" port: 32779 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 17:16:39 dist-test-slave-1x1f krb5kdc[25510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183798, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
Sep 23 17:16:39 dist-test-slave-1x1f krb5kdc[25510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183799, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.188@KRBTEST.COM for kudu/127.11.229.189@KRBTEST.COM
I20260923 17:16:39.587775 25750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:39.579095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51798 (local address 127.11.229.190:42633)
0923 17:16:39.579460 (+ 365us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:39.579467 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:39.579477 (+ 10us) server_negotiation.cc:407] Connection header received
0923 17:16:39.579504 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:39.579506 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:39.579535 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:39.579630 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:16:39.580278 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:39.580922 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:39.581882 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:39.582133 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:39.582233 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:39.584484 (+ 2251us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:16:39.584487 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:16:39.584489 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:16:39.584508 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:16:39.585947 (+ 1439us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:39.586503 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:39.586509 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:39.586511 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:39.586592 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:39.586891 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:39.586894 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:39.586896 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:39.587107 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:16:39.587342 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:39.587451 (+ 109us) server_negotiation.cc:299] Negotiation successful
0923 17:16:39.587573 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":24,"server-negotiator.queue_time_us":303,"thread_start_us":107,"threads_started":1}
I20260923 17:16:39.589107 25749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:39.581322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.189:32779 (local address 127.0.0.1:43798)
0923 17:16:39.581423 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:39.581436 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 17:16:39.581502 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:16:39.581825 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:16:39.581827 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:16:39.581983 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:16:39.582061 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:39.582066 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:39.582816 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:39.582822 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:39.583321 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:39.583329 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:39.583801 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:39.583805 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:39.583898 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:39.584339 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:16:39.584349 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:16:39.585447 (+ 1098us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:16:39.587518 (+ 2071us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:16:39.587522 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:16:39.587527 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:16:39.587754 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:16:39.588082 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:16:39.588084 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:16:39.588086 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:16:39.588155 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:16:39.588603 (+ 448us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:16:39.588606 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:16:39.588698 (+ 92us) client_negotiation.cc:769] Sending connection context
0923 17:16:39.588826 (+ 128us) client_negotiation.cc:240] Negotiation successful
0923 17:16:39.588956 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260923 17:16:39.589128 25675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:39.581494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43798 (local address 127.11.229.189:32779)
0923 17:16:39.581631 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:39.581636 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:39.581653 (+ 17us) server_negotiation.cc:407] Connection header received
0923 17:16:39.581692 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:39.581694 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:39.581729 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:39.581813 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:16:39.582170 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:39.582715 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:39.583436 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:39.583693 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:39.583799 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:39.585613 (+ 1814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:16:39.585617 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:16:39.585620 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:16:39.585647 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:16:39.587405 (+ 1758us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:39.587872 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:39.587877 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:39.587880 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:39.587971 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:39.588257 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:39.588264 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:39.588267 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:39.588498 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:16:39.588588 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:39.588905 (+ 317us) server_negotiation.cc:299] Negotiation successful
0923 17:16:39.589025 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260923 17:16:39.589906 25744 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.229.188" port: 45817 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 17:16:39 dist-test-slave-1x1f krb5kdc[25510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183798, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.229.189@KRBTEST.COM
Sep 23 17:16:39 dist-test-slave-1x1f krb5kdc[25510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183799, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.188@KRBTEST.COM for kudu/127.11.229.188@KRBTEST.COM
I20260923 17:16:39.596524 25668 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.229.188" port: 45817 } attempt: 3
I20260923 17:16:39.597954 25749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:39.590394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:45817 (local address 127.0.0.1:40780)
0923 17:16:39.590530 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:39.590540 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0923 17:16:39.590592 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:16:39.590799 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:16:39.590801 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:16:39.590921 (+ 120us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:16:39.590983 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:39.590987 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:39.591654 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:39.591657 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:39.592329 (+ 672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:39.592342 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:39.592747 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:39.592751 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:39.592815 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:39.593234 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:16:39.593244 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:16:39.594898 (+ 1654us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:16:39.596568 (+ 1670us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:16:39.596572 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:16:39.596574 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:16:39.596800 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:16:39.597097 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:16:39.597102 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:16:39.597106 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:16:39.597193 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:16:39.597581 (+ 388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:16:39.597584 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:16:39.597668 (+ 84us) client_negotiation.cc:769] Sending connection context
0923 17:16:39.597749 (+ 81us) client_negotiation.cc:240] Negotiation successful
0923 17:16:39.597851 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":78}
I20260923 17:16:39.598100 25747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:39.590416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40780 (local address 127.11.229.188:45817)
0923 17:16:39.590555 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:39.590559 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:39.590572 (+ 13us) server_negotiation.cc:407] Connection header received
0923 17:16:39.590650 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:39.590653 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:39.590695 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:39.590778 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:16:39.591080 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:39.591554 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:39.592428 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:39.592650 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:39.592748 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:39.595000 (+ 2252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:16:39.595008 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:16:39.595010 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:16:39.595028 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:16:39.596348 (+ 1320us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:39.596905 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:39.596911 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:39.596914 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:39.597003 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:39.597285 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:39.597288 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:39.597289 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:39.597466 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:16:39.597560 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:39.597836 (+ 276us) server_negotiation.cc:299] Negotiation successful
0923 17:16:39.597946 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260923 17:16:39.598172 25673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:39.588926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43808 (local address 127.11.229.189:32779)
0923 17:16:39.589033 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:39.589037 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:39.589185 (+ 148us) server_negotiation.cc:407] Connection header received
0923 17:16:39.589483 (+ 298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:39.589486 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:39.589525 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:39.589601 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:16:39.590301 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:39.591004 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:39.591792 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:39.592013 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:39.592099 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:39.594643 (+ 2544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:16:39.594647 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:16:39.594650 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:16:39.594674 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:16:39.596292 (+ 1618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:39.596766 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:39.596771 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:39.596772 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:39.596854 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:39.597163 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:39.597167 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:39.597168 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:39.597381 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:16:39.597563 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:39.597917 (+ 354us) server_negotiation.cc:299] Negotiation successful
0923 17:16:39.598021 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260923 17:16:39.598241 25592 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.229.188" port: 45817 } attempt: 3
I20260923 17:16:39.601645 25744 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f88375f39664fb4882be0078dcf92c5: Bootstrap starting.
I20260923 17:16:39.602062 12182 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 17:16:39.605368 25744 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7f88375f39664fb4882be0078dcf92c5: Neither blocks nor log segments found. Creating new log.
Sep 23 17:16:39 dist-test-slave-1x1f krb5kdc[25510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183799, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.189@KRBTEST.COM for kudu/127.11.229.188@KRBTEST.COM
I20260923 17:16:39.607419 25744 log.cc:824] T 00000000000000000000000000000000 P 7f88375f39664fb4882be0078dcf92c5: Log is configured to *not* fsync() on all Append() calls
Sep 23 17:16:39 dist-test-slave-1x1f krb5kdc[25510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183799, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for kudu/127.11.229.188@KRBTEST.COM
I20260923 17:16:39.609747 25744 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f88375f39664fb4882be0078dcf92c5: No bootstrap required, opened a new log
I20260923 17:16:39.610069 25671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:39.596907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:45817 (local address 127.0.0.1:40784)
0923 17:16:39.597083 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:39.597098 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 17:16:39.597178 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:16:39.598505 (+ 1327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:16:39.598508 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:16:39.598671 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:16:39.598739 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:39.598744 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:39.603179 (+ 4435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:39.603183 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:39.603976 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:39.603988 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:39.604538 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:39.604542 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:39.604622 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:39.605090 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:16:39.605104 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:16:39.606544 (+ 1440us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:16:39.608535 (+ 1991us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:16:39.608538 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:16:39.608540 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:16:39.608779 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:16:39.609085 (+ 306us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:16:39.609088 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:16:39.609090 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:16:39.609175 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:16:39.609590 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:16:39.609593 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:16:39.609697 (+ 104us) client_negotiation.cc:769] Sending connection context
0923 17:16:39.609784 (+ 87us) client_negotiation.cc:240] Negotiation successful
0923 17:16:39.609912 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103}
I20260923 17:16:39.610842 25747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:39.597434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40784 (local address 127.11.229.188:45817)
0923 17:16:39.598281 (+ 847us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:39.598286 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:39.598300 (+ 14us) server_negotiation.cc:407] Connection header received
0923 17:16:39.598334 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:39.598337 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:39.598375 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:39.602314 (+ 3939us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:16:39.602398 (+ 84us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:39.603044 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:39.604123 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:39.604410 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:39.604833 (+ 423us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:39.606671 (+ 1838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:16:39.606685 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:16:39.606689 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:16:39.606717 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:16:39.608415 (+ 1698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:39.608893 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:39.608896 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:39.608898 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:39.608978 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:39.609285 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:39.609288 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:39.609290 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:39.609481 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:16:39.610502 (+ 1021us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:39.610574 (+ 72us) server_negotiation.cc:299] Negotiation successful
0923 17:16:39.610705 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":760,"thread_start_us":105,"threads_started":1}
I20260923 17:16:39.612192 25596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:39.598582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:45817 (local address 127.0.0.1:40800)
0923 17:16:39.598730 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:39.598744 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 17:16:39.598820 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:16:39.599579 (+ 759us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:16:39.599583 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:16:39.599801 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:16:39.599905 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:39.599913 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:39.600892 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:39.600895 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:39.601614 (+ 719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:39.601627 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:39.602203 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:39.602207 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:39.602317 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:39.602768 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:16:39.602781 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:16:39.608148 (+ 5367us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:16:39.610483 (+ 2335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:16:39.610486 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:16:39.610488 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:16:39.610751 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:16:39.611100 (+ 349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:16:39.611104 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:16:39.611107 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:16:39.611208 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:16:39.611674 (+ 466us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:16:39.611678 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:16:39.611785 (+ 107us) client_negotiation.cc:769] Sending connection context
0923 17:16:39.611882 (+ 97us) client_negotiation.cc:240] Negotiation successful
0923 17:16:39.612029 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":86}
I20260923 17:16:39.612864 25751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:39.599210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40800 (local address 127.11.229.188:45817)
0923 17:16:39.599323 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:39.599335 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:39.599348 (+ 13us) server_negotiation.cc:407] Connection header received
0923 17:16:39.599381 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:39.599384 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:39.599443 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:39.600012 (+ 569us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:16:39.600091 (+ 79us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:39.600803 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:39.601720 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:39.602071 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:39.602527 (+ 456us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:39.608306 (+ 5779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:16:39.608311 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:16:39.608315 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:16:39.608345 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:16:39.610379 (+ 2034us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:39.610881 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:39.610887 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:39.610892 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:39.610982 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:39.611342 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:39.611345 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:39.611347 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:39.611553 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:16:39.612464 (+ 911us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:39.612538 (+ 74us) server_negotiation.cc:299] Negotiation successful
0923 17:16:39.612657 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260923 17:16:39.614126 25668 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68185cfcba7342d1810babb4e2e47898: Bootstrap starting.
I20260923 17:16:39.614040 25744 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7f88375f39664fb4882be0078dcf92c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e859e04d1ae4e14b11b4f277eab0c4a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 42633 } } peers { permanent_uuid: "68185cfcba7342d1810babb4e2e47898" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 32779 } } peers { permanent_uuid: "7f88375f39664fb4882be0078dcf92c5" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 45817 } }
I20260923 17:16:39.614300 25744 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7f88375f39664fb4882be0078dcf92c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:16:39.614367 25744 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7f88375f39664fb4882be0078dcf92c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f88375f39664fb4882be0078dcf92c5, State: Initialized, Role: FOLLOWER
I20260923 17:16:39.614814 25744 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7f88375f39664fb4882be0078dcf92c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e859e04d1ae4e14b11b4f277eab0c4a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 42633 } } peers { permanent_uuid: "68185cfcba7342d1810babb4e2e47898" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 32779 } } peers { permanent_uuid: "7f88375f39664fb4882be0078dcf92c5" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 45817 } }
I20260923 17:16:39.615268 25761 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f88375f39664fb4882be0078dcf92c5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e859e04d1ae4e14b11b4f277eab0c4a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 42633 } } peers { permanent_uuid: "68185cfcba7342d1810babb4e2e47898" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 32779 } } peers { permanent_uuid: "7f88375f39664fb4882be0078dcf92c5" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 45817 } } }
I20260923 17:16:39.615399 25761 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f88375f39664fb4882be0078dcf92c5 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 17:16:39.615765 25592 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e859e04d1ae4e14b11b4f277eab0c4a: Bootstrap starting.
I20260923 17:16:39.616101 25744 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7f88375f39664fb4882be0078dcf92c5 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:16:39.616843 25668 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 68185cfcba7342d1810babb4e2e47898: Neither blocks nor log segments found. Creating new log.
I20260923 17:16:39.617776 25592 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3e859e04d1ae4e14b11b4f277eab0c4a: Neither blocks nor log segments found. Creating new log.
I20260923 17:16:39.617758 25668 log.cc:824] T 00000000000000000000000000000000 P 68185cfcba7342d1810babb4e2e47898: Log is configured to *not* fsync() on all Append() calls
I20260923 17:16:39.619892 25668 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68185cfcba7342d1810babb4e2e47898: No bootstrap required, opened a new log
W20260923 17:16:39.621317 25772 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7f88375f39664fb4882be0078dcf92c5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 17:16:39.621390 25772 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 17:16:39.620476 25674 master_runner.cc:186] Error getting master registration for 127.11.229.190:42633: OK, instance_id { permanent_uuid: "3e859e04d1ae4e14b11b4f277eab0c4a" instance_seqno: 1790183799130337 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260923 17:16:39.623862 25674 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260923 17:16:39.624269 25592 log.cc:824] T 00000000000000000000000000000000 P 3e859e04d1ae4e14b11b4f277eab0c4a: Log is configured to *not* fsync() on all Append() calls
I20260923 17:16:39.624197 25668 raft_consensus.cc:348] T 00000000000000000000000000000000 P 68185cfcba7342d1810babb4e2e47898 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e859e04d1ae4e14b11b4f277eab0c4a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 42633 } } peers { permanent_uuid: "68185cfcba7342d1810babb4e2e47898" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 32779 } } peers { permanent_uuid: "7f88375f39664fb4882be0078dcf92c5" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 45817 } }
I20260923 17:16:39.624418 25668 raft_consensus.cc:374] T 00000000000000000000000000000000 P 68185cfcba7342d1810babb4e2e47898 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:16:39.624476 25668 raft_consensus.cc:729] T 00000000000000000000000000000000 P 68185cfcba7342d1810babb4e2e47898 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68185cfcba7342d1810babb4e2e47898, State: Initialized, Role: FOLLOWER
I20260923 17:16:39.624939 25668 consensus_queue.cc:260] T 00000000000000000000000000000000 P 68185cfcba7342d1810babb4e2e47898 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e859e04d1ae4e14b11b4f277eab0c4a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 42633 } } peers { permanent_uuid: "68185cfcba7342d1810babb4e2e47898" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 32779 } } peers { permanent_uuid: "7f88375f39664fb4882be0078dcf92c5" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 45817 } }
I20260923 17:16:39.626190 25668 sys_catalog.cc:564] T 00000000000000000000000000000000 P 68185cfcba7342d1810babb4e2e47898 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:16:39.626513 25592 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e859e04d1ae4e14b11b4f277eab0c4a: No bootstrap required, opened a new log
I20260923 17:16:39.626742 25750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:39.605096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51800 (local address 127.11.229.190:42633)
0923 17:16:39.605224 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:39.605231 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:39.605743 (+ 512us) server_negotiation.cc:407] Connection header received
0923 17:16:39.605886 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:39.605889 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:39.605943 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:39.606038 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:16:39.607191 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:39.608261 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:39.609957 (+ 1696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:39.610369 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:39.610456 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:39.612432 (+ 1976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:16:39.612436 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:16:39.612438 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:16:39.612461 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:16:39.619142 (+ 6681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:39.625233 (+ 6091us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:39.625236 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:39.625238 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:39.625327 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:39.625644 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:39.625648 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:39.625649 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:39.625906 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:16:39.626030 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:39.626471 (+ 441us) server_negotiation.cc:299] Negotiation successful
0923 17:16:39.626607 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260923 17:16:39.631263 25592 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3e859e04d1ae4e14b11b4f277eab0c4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e859e04d1ae4e14b11b4f277eab0c4a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 42633 } } peers { permanent_uuid: "68185cfcba7342d1810babb4e2e47898" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 32779 } } peers { permanent_uuid: "7f88375f39664fb4882be0078dcf92c5" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 45817 } }
I20260923 17:16:39.631613 25592 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3e859e04d1ae4e14b11b4f277eab0c4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:16:39.631731 25592 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3e859e04d1ae4e14b11b4f277eab0c4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e859e04d1ae4e14b11b4f277eab0c4a, State: Initialized, Role: FOLLOWER
I20260923 17:16:39.632247 25592 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3e859e04d1ae4e14b11b4f277eab0c4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e859e04d1ae4e14b11b4f277eab0c4a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 42633 } } peers { permanent_uuid: "68185cfcba7342d1810babb4e2e47898" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 32779 } } peers { permanent_uuid: "7f88375f39664fb4882be0078dcf92c5" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 45817 } }
I20260923 17:16:39.633829 25592 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3e859e04d1ae4e14b11b4f277eab0c4a [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:16:39.637811 25673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:39.613338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43818 (local address 127.11.229.189:32779)
0923 17:16:39.613454 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:39.613460 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:39.628525 (+ 15065us) server_negotiation.cc:407] Connection header received
0923 17:16:39.628640 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:39.628644 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:39.628694 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:39.628764 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:16:39.629533 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:39.630328 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:39.631419 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:39.631789 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:39.631870 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:39.633865 (+ 1995us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:16:39.634080 (+ 215us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:16:39.634084 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:16:39.634111 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:16:39.635942 (+ 1831us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:39.636441 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:39.636447 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:39.636451 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:39.636540 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:39.636867 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:39.636870 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:39.636872 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:39.637081 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:16:39.637180 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:39.637536 (+ 356us) server_negotiation.cc:299] Negotiation successful
0923 17:16:39.637650 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260923 17:16:39.635150 25599 master_runner.cc:186] Error getting master registration for 127.11.229.190:42633: OK, instance_id { permanent_uuid: "3e859e04d1ae4e14b11b4f277eab0c4a" instance_seqno: 1790183799130337 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260923 17:16:39.638444 25599 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260923 17:16:39.638432 25776 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68185cfcba7342d1810babb4e2e47898 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e859e04d1ae4e14b11b4f277eab0c4a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 42633 } } peers { permanent_uuid: "68185cfcba7342d1810babb4e2e47898" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 32779 } } peers { permanent_uuid: "7f88375f39664fb4882be0078dcf92c5" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 45817 } } }
I20260923 17:16:39.638635 25776 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68185cfcba7342d1810babb4e2e47898 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 17:16:39.641741 25747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:39.609387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40808 (local address 127.11.229.188:45817)
0923 17:16:39.611368 (+ 1981us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:39.611372 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:39.628156 (+ 16784us) server_negotiation.cc:407] Connection header received
0923 17:16:39.628266 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:39.628269 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:39.628320 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:39.628411 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:16:39.629323 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:39.630174 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:39.631325 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:39.631656 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:39.631756 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:39.633613 (+ 1857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:16:39.633620 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:16:39.633624 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:16:39.633651 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:16:39.639719 (+ 6068us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:39.640196 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:39.640199 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:39.640201 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:39.640279 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:39.640544 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:39.640547 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:39.640549 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:39.640742 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:16:39.640874 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:39.641468 (+ 594us) server_negotiation.cc:299] Negotiation successful
0923 17:16:39.641580 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1930,"thread_start_us":83,"threads_started":1}
W20260923 17:16:39.642455 25799 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3e859e04d1ae4e14b11b4f277eab0c4a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 17:16:39.642521 25799 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 17:16:39.642700 25788 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e859e04d1ae4e14b11b4f277eab0c4a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e859e04d1ae4e14b11b4f277eab0c4a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 42633 } } peers { permanent_uuid: "68185cfcba7342d1810babb4e2e47898" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 32779 } } peers { permanent_uuid: "7f88375f39664fb4882be0078dcf92c5" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 45817 } } }
I20260923 17:16:39.642818 25788 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e859e04d1ae4e14b11b4f277eab0c4a [sys.catalog]: This master's current role is: FOLLOWER
I20260923 17:16:39.643743 25523 master_runner.cc:263] No leader master found from master 3e859e04d1ae4e14b11b4f277eab0c4a
I20260923 17:16:39.643824 25523 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260923 17:16:39.645164 25787 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 68185cfcba7342d1810babb4e2e47898: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 17:16:39.645234 25787 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 17:16:39.703255 25761 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7f88375f39664fb4882be0078dcf92c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 17:16:39.703457 25761 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7f88375f39664fb4882be0078dcf92c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e859e04d1ae4e14b11b4f277eab0c4a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 42633 } } peers { permanent_uuid: "68185cfcba7342d1810babb4e2e47898" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 32779 } } peers { permanent_uuid: "7f88375f39664fb4882be0078dcf92c5" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 45817 } }
I20260923 17:16:39.704547 25761 leader_election.cc:288] T 00000000000000000000000000000000 P 7f88375f39664fb4882be0078dcf92c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e859e04d1ae4e14b11b4f277eab0c4a (127.11.229.190:42633), 68185cfcba7342d1810babb4e2e47898 (127.11.229.189:32779)
I20260923 17:16:39.705251 25566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7f88375f39664fb4882be0078dcf92c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e859e04d1ae4e14b11b4f277eab0c4a" is_pre_election: true
I20260923 17:16:39.705574 25566 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3e859e04d1ae4e14b11b4f277eab0c4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f88375f39664fb4882be0078dcf92c5 in term 0.
I20260923 17:16:39.706076 25692 leader_election.cc:302] T 00000000000000000000000000000000 P 7f88375f39664fb4882be0078dcf92c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e859e04d1ae4e14b11b4f277eab0c4a, 7f88375f39664fb4882be0078dcf92c5; no voters:
I20260923 17:16:39.706483 25761 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7f88375f39664fb4882be0078dcf92c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 17:16:39.706571 25761 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7f88375f39664fb4882be0078dcf92c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 17:16:39.706625 25761 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7f88375f39664fb4882be0078dcf92c5 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:16:39.707933 25761 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7f88375f39664fb4882be0078dcf92c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e859e04d1ae4e14b11b4f277eab0c4a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 42633 } } peers { permanent_uuid: "68185cfcba7342d1810babb4e2e47898" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 32779 } } peers { permanent_uuid: "7f88375f39664fb4882be0078dcf92c5" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 45817 } }
I20260923 17:16:39.708257 25761 leader_election.cc:288] T 00000000000000000000000000000000 P 7f88375f39664fb4882be0078dcf92c5 [CANDIDATE]: Term 1 election: Requested vote from peers 3e859e04d1ae4e14b11b4f277eab0c4a (127.11.229.190:42633), 68185cfcba7342d1810babb4e2e47898 (127.11.229.189:32779)
I20260923 17:16:39.708719 25566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7f88375f39664fb4882be0078dcf92c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e859e04d1ae4e14b11b4f277eab0c4a"
I20260923 17:16:39.708839 25566 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3e859e04d1ae4e14b11b4f277eab0c4a [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:16:39.710050 25566 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3e859e04d1ae4e14b11b4f277eab0c4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f88375f39664fb4882be0078dcf92c5 in term 1.
I20260923 17:16:39.710402 25692 leader_election.cc:302] T 00000000000000000000000000000000 P 7f88375f39664fb4882be0078dcf92c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e859e04d1ae4e14b11b4f277eab0c4a, 7f88375f39664fb4882be0078dcf92c5; no voters:
I20260923 17:16:39.711464 25641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7f88375f39664fb4882be0078dcf92c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68185cfcba7342d1810babb4e2e47898"
I20260923 17:16:39.711710 25641 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 68185cfcba7342d1810babb4e2e47898 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:16:39.712960 25641 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 68185cfcba7342d1810babb4e2e47898 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f88375f39664fb4882be0078dcf92c5 in term 1.
I20260923 17:16:39.713233 25642 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7f88375f39664fb4882be0078dcf92c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "68185cfcba7342d1810babb4e2e47898" is_pre_election: true
I20260923 17:16:39.713373 25642 raft_consensus.cc:2362] T 00000000000000000000000000000000 P 68185cfcba7342d1810babb4e2e47898 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7f88375f39664fb4882be0078dcf92c5 in term 1. Re-sending same reply.
I20260923 17:16:39.716626 25761 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7f88375f39664fb4882be0078dcf92c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:16:39.716917 25761 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7f88375f39664fb4882be0078dcf92c5 [term 1 LEADER]: Becoming Leader. State: Replica: 7f88375f39664fb4882be0078dcf92c5, State: Running, Role: LEADER
I20260923 17:16:39.717373 25761 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7f88375f39664fb4882be0078dcf92c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e859e04d1ae4e14b11b4f277eab0c4a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 42633 } } peers { permanent_uuid: "68185cfcba7342d1810babb4e2e47898" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 32779 } } peers { permanent_uuid: "7f88375f39664fb4882be0078dcf92c5" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 45817 } }
I20260923 17:16:39.719383 25761 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f88375f39664fb4882be0078dcf92c5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7f88375f39664fb4882be0078dcf92c5. Latest consensus state: current_term: 1 leader_uuid: "7f88375f39664fb4882be0078dcf92c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e859e04d1ae4e14b11b4f277eab0c4a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 42633 } } peers { permanent_uuid: "68185cfcba7342d1810babb4e2e47898" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 32779 } } peers { permanent_uuid: "7f88375f39664fb4882be0078dcf92c5" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 45817 } } }
I20260923 17:16:39.719496 25761 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f88375f39664fb4882be0078dcf92c5 [sys.catalog]: This master's current role is: LEADER
I20260923 17:16:39.719899 25804 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:16:39.720851 25804 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:16:39.728765 25642 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 68185cfcba7342d1810babb4e2e47898 [term 1 FOLLOWER]: Refusing update from remote peer 7f88375f39664fb4882be0078dcf92c5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:16:39.729544 25566 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3e859e04d1ae4e14b11b4f277eab0c4a [term 1 FOLLOWER]: Refusing update from remote peer 7f88375f39664fb4882be0078dcf92c5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:16:39.732512 25761 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7f88375f39664fb4882be0078dcf92c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e859e04d1ae4e14b11b4f277eab0c4a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 42633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:16:39.732925 25761 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7f88375f39664fb4882be0078dcf92c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "68185cfcba7342d1810babb4e2e47898" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 32779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:16:39.737305 25788 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e859e04d1ae4e14b11b4f277eab0c4a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7f88375f39664fb4882be0078dcf92c5. Latest consensus state: current_term: 1 leader_uuid: "7f88375f39664fb4882be0078dcf92c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e859e04d1ae4e14b11b4f277eab0c4a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 42633 } } peers { permanent_uuid: "68185cfcba7342d1810babb4e2e47898" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 32779 } } peers { permanent_uuid: "7f88375f39664fb4882be0078dcf92c5" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 45817 } } }
I20260923 17:16:39.737434 25788 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e859e04d1ae4e14b11b4f277eab0c4a [sys.catalog]: This master's current role is: FOLLOWER
I20260923 17:16:39.740940 25776 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68185cfcba7342d1810babb4e2e47898 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7f88375f39664fb4882be0078dcf92c5. Latest consensus state: current_term: 1 leader_uuid: "7f88375f39664fb4882be0078dcf92c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e859e04d1ae4e14b11b4f277eab0c4a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 42633 } } peers { permanent_uuid: "68185cfcba7342d1810babb4e2e47898" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 32779 } } peers { permanent_uuid: "7f88375f39664fb4882be0078dcf92c5" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 45817 } } }
I20260923 17:16:39.741070 25776 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68185cfcba7342d1810babb4e2e47898 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 17:16:39.749881 25761 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f88375f39664fb4882be0078dcf92c5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7f88375f39664fb4882be0078dcf92c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e859e04d1ae4e14b11b4f277eab0c4a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 42633 } } peers { permanent_uuid: "68185cfcba7342d1810babb4e2e47898" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 32779 } } peers { permanent_uuid: "7f88375f39664fb4882be0078dcf92c5" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 45817 } } }
I20260923 17:16:39.750017 25761 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f88375f39664fb4882be0078dcf92c5 [sys.catalog]: This master's current role is: LEADER
I20260923 17:16:39.750885 25776 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68185cfcba7342d1810babb4e2e47898 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7f88375f39664fb4882be0078dcf92c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e859e04d1ae4e14b11b4f277eab0c4a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 42633 } } peers { permanent_uuid: "68185cfcba7342d1810babb4e2e47898" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 32779 } } peers { permanent_uuid: "7f88375f39664fb4882be0078dcf92c5" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 45817 } } }
I20260923 17:16:39.751000 25776 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68185cfcba7342d1810babb4e2e47898 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 17:16:39.751372 25805 mvcc.cc:205] Tried to move back new op lower bound from 7332592843677962240 to 7332592843646377984. Current Snapshot: MvccSnapshot[applied={T|T < 7332592843677962240}]
I20260923 17:16:39.754112 25761 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f88375f39664fb4882be0078dcf92c5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "7f88375f39664fb4882be0078dcf92c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e859e04d1ae4e14b11b4f277eab0c4a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 42633 } } peers { permanent_uuid: "68185cfcba7342d1810babb4e2e47898" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 32779 } } peers { permanent_uuid: "7f88375f39664fb4882be0078dcf92c5" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 45817 } } }
I20260923 17:16:39.754246 25761 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f88375f39664fb4882be0078dcf92c5 [sys.catalog]: This master's current role is: LEADER
I20260923 17:16:39.755357 25788 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e859e04d1ae4e14b11b4f277eab0c4a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "7f88375f39664fb4882be0078dcf92c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e859e04d1ae4e14b11b4f277eab0c4a" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 42633 } } peers { permanent_uuid: "68185cfcba7342d1810babb4e2e47898" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 32779 } } peers { permanent_uuid: "7f88375f39664fb4882be0078dcf92c5" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 45817 } } }
I20260923 17:16:39.755481 25788 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e859e04d1ae4e14b11b4f277eab0c4a [sys.catalog]: This master's current role is: FOLLOWER
I20260923 17:16:39.756147 25808 mvcc.cc:205] Tried to move back new op lower bound from 7332592843677962240 to 7332592843646377984. Current Snapshot: MvccSnapshot[applied={T|T < 7332592843677962240}]
I20260923 17:16:39.756513 25806 mvcc.cc:205] Tried to move back new op lower bound from 7332592843677962240 to 7332592843646377984. Current Snapshot: MvccSnapshot[applied={T|T < 7332592843677962240}]
I20260923 17:16:39.763499 25804 catalog_manager.cc:1347] Generated new cluster ID: afabaff54cde4a3b8b191ef0fec92bbf
I20260923 17:16:39.763571 25804 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:16:39.811029 25804 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:16:39.812390 25804 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:16:39.832544 25804 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7f88375f39664fb4882be0078dcf92c5: Generated new TSK 0
I20260923 17:16:39.833452 25804 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 17:16:40.643815 25799 catalog_manager.cc:1259] Loaded cluster ID: afabaff54cde4a3b8b191ef0fec92bbf
I20260923 17:16:40.643911 25799 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3e859e04d1ae4e14b11b4f277eab0c4a: loading cluster ID for follower catalog manager: success
I20260923 17:16:40.645604 25799 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3e859e04d1ae4e14b11b4f277eab0c4a: acquiring CA information for follower catalog manager: success
I20260923 17:16:40.646363 25787 catalog_manager.cc:1259] Loaded cluster ID: afabaff54cde4a3b8b191ef0fec92bbf
I20260923 17:16:40.646417 25787 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 68185cfcba7342d1810babb4e2e47898: loading cluster ID for follower catalog manager: success
I20260923 17:16:40.646916 25799 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3e859e04d1ae4e14b11b4f277eab0c4a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260923 17:16:40.647996 25787 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 68185cfcba7342d1810babb4e2e47898: acquiring CA information for follower catalog manager: success
I20260923 17:16:40.648968 25787 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 68185cfcba7342d1810babb4e2e47898: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260923 17:16:40.892673 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 25523
I20260923 17:16:40.898948 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 25599
I20260923 17:16:40.904562 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 25674
2026-09-23T17:16:40Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3137 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790183633736342-12182-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 17:16:40 dist-test-slave-1x1f krb5kdc[25819](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 17:16:40 dist-test-slave-1x1f krb5kdc[25819](info): set up 2 sockets
Sep 23 17:16:40 dist-test-slave-1x1f krb5kdc[25819](info): commencing operation
krb5kdc: starting...
W20260923 17:16:41.983425 12182 mini_kdc.cc:121] Time spent starting KDC: real 1.057s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Sep 23 17:16:42 dist-test-slave-1x1f krb5kdc[25819](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183802, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T17:16:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:16:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.229.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
I20260923 17:16:42.106552 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:40085
--webserver_interface=127.11.229.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:43623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:40085
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:16:42.219064 25832 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:16:42.219416 25832 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:16:42.219496 25832 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:16:42.223563 25832 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:16:42.223660 25832 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:16:42.223706 25832 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:16:42.223767 25832 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:16:42.223805 25832 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:16:42.229176 25832 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:43623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:40085
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:40085
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.229.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25832
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:16:42.230302 25832 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:16:42.231331 25832 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:16:42.239621 25840 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:16:42.239672 25837 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:16:42.239634 25838 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:16:42.240000 25832 server_base.cc:1034] running on GCE node
I20260923 17:16:42.240576 25832 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:16:42.241678 25832 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:16:42.242872 25832 hybrid_clock.cc:648] HybridClock initialized: now 1790183802242851 us; error 46 us; skew 500 ppm
Sep 23 17:16:42 dist-test-slave-1x1f krb5kdc[25819](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183802, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:16:42.245630 25832 init.cc:377] Logged in from keytab as kudu/127.11.229.190@KRBTEST.COM (short username kudu)
I20260923 17:16:42.246613 25832 webserver.cc:460] Webserver started at http://127.11.229.190:45633/ using document root <none> and password file <none>
I20260923 17:16:42.247196 25832 fs_manager.cc:359] Metadata directory not provided
I20260923 17:16:42.247275 25832 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:16:42.247498 25832 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:16:42.249502 25832 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "0f2a82010aa643f3a1b155e78c7c077f"
format_stamp: "Formatted at 2026-09-23 17:16:42 on dist-test-slave-1x1f"
server_key: "c00d7733d406e3f28013b4fc70fbacbd"
server_key_iv: "5e51f2a4bd6f0fe3b2a3adc6455c51bb"
server_key_version: "encryptionkey@0"
I20260923 17:16:42.250053 25832 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "0f2a82010aa643f3a1b155e78c7c077f"
format_stamp: "Formatted at 2026-09-23 17:16:42 on dist-test-slave-1x1f"
server_key: "c00d7733d406e3f28013b4fc70fbacbd"
server_key_iv: "5e51f2a4bd6f0fe3b2a3adc6455c51bb"
server_key_version: "encryptionkey@0"
I20260923 17:16:42.253706 25832 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260923 17:16:42.256282 25847 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:16:42.257622 25832 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 17:16:42.257766 25832 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "0f2a82010aa643f3a1b155e78c7c077f"
format_stamp: "Formatted at 2026-09-23 17:16:42 on dist-test-slave-1x1f"
server_key: "c00d7733d406e3f28013b4fc70fbacbd"
server_key_iv: "5e51f2a4bd6f0fe3b2a3adc6455c51bb"
server_key_version: "encryptionkey@0"
I20260923 17:16:42.257879 25832 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:16:42.273986 25832 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:16:42.277037 25832 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:16:42.277318 25832 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:16:42.284572 25832 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.190:40085
I20260923 17:16:42.284597 25899 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.190:40085 every 8 connection(s)
I20260923 17:16:42.285538 25832 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:16:42.288380 25900 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:16:42.292943 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 25832
I20260923 17:16:42.293076 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:16:42.293395 12182 external_mini_cluster.cc:1428] Setting key ea275d19fe2cc9d8aa399ed65ad18697
I20260923 17:16:42.294057 25900 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f2a82010aa643f3a1b155e78c7c077f: Bootstrap starting.
I20260923 17:16:42.296388 25900 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0f2a82010aa643f3a1b155e78c7c077f: Neither blocks nor log segments found. Creating new log.
I20260923 17:16:42.297102 25900 log.cc:824] T 00000000000000000000000000000000 P 0f2a82010aa643f3a1b155e78c7c077f: Log is configured to *not* fsync() on all Append() calls
I20260923 17:16:42.298909 25900 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f2a82010aa643f3a1b155e78c7c077f: No bootstrap required, opened a new log
Sep 23 17:16:42 dist-test-slave-1x1f krb5kdc[25819](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183802, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:16:42.302353 25900 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0f2a82010aa643f3a1b155e78c7c077f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f2a82010aa643f3a1b155e78c7c077f" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 40085 } }
I20260923 17:16:42.302591 25900 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0f2a82010aa643f3a1b155e78c7c077f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:16:42.302655 25900 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0f2a82010aa643f3a1b155e78c7c077f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f2a82010aa643f3a1b155e78c7c077f, State: Initialized, Role: FOLLOWER
I20260923 17:16:42.303112 25900 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0f2a82010aa643f3a1b155e78c7c077f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f2a82010aa643f3a1b155e78c7c077f" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 40085 } }
I20260923 17:16:42.303232 25900 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0f2a82010aa643f3a1b155e78c7c077f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:16:42.303339 25900 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0f2a82010aa643f3a1b155e78c7c077f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:16:42.303452 25900 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0f2a82010aa643f3a1b155e78c7c077f [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:16:42.304306 25900 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0f2a82010aa643f3a1b155e78c7c077f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f2a82010aa643f3a1b155e78c7c077f" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 40085 } }
I20260923 17:16:42.304625 25900 leader_election.cc:302] T 00000000000000000000000000000000 P 0f2a82010aa643f3a1b155e78c7c077f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0f2a82010aa643f3a1b155e78c7c077f; no voters:
I20260923 17:16:42.304921 25900 leader_election.cc:288] T 00000000000000000000000000000000 P 0f2a82010aa643f3a1b155e78c7c077f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 17:16:42.305038 25905 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0f2a82010aa643f3a1b155e78c7c077f [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:16:42.305264 25905 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0f2a82010aa643f3a1b155e78c7c077f [term 1 LEADER]: Becoming Leader. State: Replica: 0f2a82010aa643f3a1b155e78c7c077f, State: Running, Role: LEADER
I20260923 17:16:42.305615 25905 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0f2a82010aa643f3a1b155e78c7c077f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f2a82010aa643f3a1b155e78c7c077f" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 40085 } }
I20260923 17:16:42.306250 25900 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0f2a82010aa643f3a1b155e78c7c077f [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:16:42.307417 25903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:42.294795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41128 (local address 127.11.229.190:40085)
0923 17:16:42.295213 (+ 418us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:42.295229 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:42.295264 (+ 35us) server_negotiation.cc:407] Connection header received
0923 17:16:42.295916 (+ 652us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:42.295932 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:42.296248 (+ 316us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:42.296591 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:16:42.297391 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:42.298404 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:42.299294 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:42.299749 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:42.299913 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:42.302309 (+ 2396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:16:42.302314 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:16:42.302327 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:16:42.302354 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:16:42.304150 (+ 1796us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:42.304634 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:42.304638 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:42.304642 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:42.304773 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:42.305065 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:42.305068 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:42.305071 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:42.305602 (+ 531us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:16:42.305785 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:42.306085 (+ 300us) server_negotiation.cc:299] Negotiation successful
0923 17:16:42.306424 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":130,"threads_started":1}
I20260923 17:16:42.307480 25907 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f2a82010aa643f3a1b155e78c7c077f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0f2a82010aa643f3a1b155e78c7c077f. Latest consensus state: current_term: 1 leader_uuid: "0f2a82010aa643f3a1b155e78c7c077f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f2a82010aa643f3a1b155e78c7c077f" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 40085 } } }
I20260923 17:16:42.307574 25907 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f2a82010aa643f3a1b155e78c7c077f [sys.catalog]: This master's current role is: LEADER
I20260923 17:16:42.307909 25906 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f2a82010aa643f3a1b155e78c7c077f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0f2a82010aa643f3a1b155e78c7c077f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f2a82010aa643f3a1b155e78c7c077f" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 40085 } } }
I20260923 17:16:42.307993 25906 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f2a82010aa643f3a1b155e78c7c077f [sys.catalog]: This master's current role is: LEADER
I20260923 17:16:42.310745 12182 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260923 17:16:42.311087 25920 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0f2a82010aa643f3a1b155e78c7c077f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 17:16:42.311157 25920 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 17:16:42.311554 25915 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:16:42.312485 25915 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:16:42.317836 25915 catalog_manager.cc:1347] Generated new cluster ID: 4382f2a303984ee88397af13543522c4
I20260923 17:16:42.317905 25915 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:16:42.358937 25915 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:16:42.359985 25915 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:16:42.367115 25915 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0f2a82010aa643f3a1b155e78c7c077f: Generated new TSK 0
I20260923 17:16:42.367882 25915 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 17:16:42.418190 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 25832
2026-09-23T17:16:42Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1512 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 17:16:42 dist-test-slave-1x1f krb5kdc[25928](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 17:16:42 dist-test-slave-1x1f krb5kdc[25928](info): set up 2 sockets
Sep 23 17:16:42 dist-test-slave-1x1f krb5kdc[25928](info): commencing operation
krb5kdc: starting...
W20260923 17:16:43.470956 12182 mini_kdc.cc:121] Time spent starting KDC: real 1.033s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Sep 23 17:16:43 dist-test-slave-1x1f krb5kdc[25928](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183803, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T17:16:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:16:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.229.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
I20260923 17:16:43.596922 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:44985
--webserver_interface=127.11.229.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:39033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:44985
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:16:43.705029 25941 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:16:43.705282 25941 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:16:43.705322 25941 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:16:43.709208 25941 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:16:43.709265 25941 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:16:43.709285 25941 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:16:43.709301 25941 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:16:43.709316 25941 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:16:43.714354 25941 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:39033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:44985
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:44985
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.229.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25941
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:16:43.715296 25941 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:16:43.716207 25941 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:16:43.724445 25946 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:16:43.724453 25949 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:16:43.724453 25947 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:16:43.724488 25941 server_base.cc:1034] running on GCE node
I20260923 17:16:43.725190 25941 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:16:43.726300 25941 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:16:43.727484 25941 hybrid_clock.cc:648] HybridClock initialized: now 1790183803727471 us; error 33 us; skew 500 ppm
Sep 23 17:16:43 dist-test-slave-1x1f krb5kdc[25928](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183803, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:16:43.736572 25941 init.cc:377] Logged in from keytab as kudu/127.11.229.190@KRBTEST.COM (short username kudu)
I20260923 17:16:43.737520 25941 webserver.cc:460] Webserver started at http://127.11.229.190:39449/ using document root <none> and password file <none>
I20260923 17:16:43.738113 25941 fs_manager.cc:359] Metadata directory not provided
I20260923 17:16:43.738175 25941 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:16:43.738438 25941 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:16:43.740458 25941 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "ab93d0e00d144467a0c5ee3c286f80b1"
format_stamp: "Formatted at 2026-09-23 17:16:43 on dist-test-slave-1x1f"
server_key: "fbd50d0c43c20dd33c5b55f2f22e0201"
server_key_iv: "41319671b87fbffc5f5ee6444b69e44b"
server_key_version: "encryptionkey@0"
I20260923 17:16:43.741019 25941 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "ab93d0e00d144467a0c5ee3c286f80b1"
format_stamp: "Formatted at 2026-09-23 17:16:43 on dist-test-slave-1x1f"
server_key: "fbd50d0c43c20dd33c5b55f2f22e0201"
server_key_iv: "41319671b87fbffc5f5ee6444b69e44b"
server_key_version: "encryptionkey@0"
I20260923 17:16:43.744642 25941 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260923 17:16:43.747030 25956 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:16:43.748302 25941 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 17:16:43.748425 25941 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "ab93d0e00d144467a0c5ee3c286f80b1"
format_stamp: "Formatted at 2026-09-23 17:16:43 on dist-test-slave-1x1f"
server_key: "fbd50d0c43c20dd33c5b55f2f22e0201"
server_key_iv: "41319671b87fbffc5f5ee6444b69e44b"
server_key_version: "encryptionkey@0"
I20260923 17:16:43.748526 25941 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:16:43.760921 25941 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:16:43.763900 25941 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:16:43.764103 25941 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:16:43.770936 25941 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.190:44985
I20260923 17:16:43.771325 26008 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.190:44985 every 8 connection(s)
I20260923 17:16:43.771977 25941 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:16:43.772727 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 25941
I20260923 17:16:43.772856 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:16:43.773176 12182 external_mini_cluster.cc:1428] Setting key d1ff272669e827f916717fd8d804282b
I20260923 17:16:43.775321 26009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:16:43.780910 26009 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1: Bootstrap starting.
Sep 23 17:16:43 dist-test-slave-1x1f krb5kdc[25928](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183803, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:16:43.783486 26009 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1: Neither blocks nor log segments found. Creating new log.
I20260923 17:16:43.784422 26009 log.cc:824] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1: Log is configured to *not* fsync() on all Append() calls
I20260923 17:16:43.787009 26009 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1: No bootstrap required, opened a new log
I20260923 17:16:43.788674 26012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:43.774608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58628 (local address 127.11.229.190:44985)
0923 17:16:43.775015 (+ 407us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:43.775030 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:43.775062 (+ 32us) server_negotiation.cc:407] Connection header received
0923 17:16:43.775738 (+ 676us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:43.775754 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:43.776063 (+ 309us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:43.776434 (+ 371us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:16:43.777147 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:43.778331 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:43.779193 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:43.779659 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:43.779834 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:43.782856 (+ 3022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:16:43.782861 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:16:43.782875 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:16:43.782905 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:16:43.785318 (+ 2413us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:43.785778 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:43.785784 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:43.785790 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:43.785933 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:43.786285 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:43.786289 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:43.786291 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:43.786836 (+ 545us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:16:43.787041 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:43.787373 (+ 332us) server_negotiation.cc:299] Negotiation successful
0923 17:16:43.787712 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":284,"thread_start_us":128,"threads_started":1}
I20260923 17:16:43.791638 26009 raft_consensus.cc:348] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab93d0e00d144467a0c5ee3c286f80b1" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 44985 } }
I20260923 17:16:43.791865 26009 raft_consensus.cc:374] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:16:43.791949 26009 raft_consensus.cc:729] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab93d0e00d144467a0c5ee3c286f80b1, State: Initialized, Role: FOLLOWER
I20260923 17:16:43.792443 26009 consensus_queue.cc:260] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab93d0e00d144467a0c5ee3c286f80b1" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 44985 } }
I20260923 17:16:43.792609 26009 raft_consensus.cc:388] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:16:43.792727 26009 raft_consensus.cc:482] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:16:43.792852 26009 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:16:43.793874 26009 raft_consensus.cc:504] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab93d0e00d144467a0c5ee3c286f80b1" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 44985 } }
I20260923 17:16:43.794176 26009 leader_election.cc:302] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ab93d0e00d144467a0c5ee3c286f80b1; no voters:
I20260923 17:16:43.794535 26009 leader_election.cc:288] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 17:16:43.794672 26014 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:16:43.794906 26014 raft_consensus.cc:686] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [term 1 LEADER]: Becoming Leader. State: Replica: ab93d0e00d144467a0c5ee3c286f80b1, State: Running, Role: LEADER
I20260923 17:16:43.795228 26014 consensus_queue.cc:237] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab93d0e00d144467a0c5ee3c286f80b1" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 44985 } }
I20260923 17:16:43.795807 26009 sys_catalog.cc:564] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:16:43.796912 26015 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ab93d0e00d144467a0c5ee3c286f80b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab93d0e00d144467a0c5ee3c286f80b1" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 44985 } } }
I20260923 17:16:43.797055 26015 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [sys.catalog]: This master's current role is: LEADER
I20260923 17:16:43.797492 26023 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:16:43.797402 26016 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ab93d0e00d144467a0c5ee3c286f80b1. Latest consensus state: current_term: 1 leader_uuid: "ab93d0e00d144467a0c5ee3c286f80b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab93d0e00d144467a0c5ee3c286f80b1" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 44985 } } }
I20260923 17:16:43.798267 26016 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [sys.catalog]: This master's current role is: LEADER
I20260923 17:16:43.800714 26023 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:16:43.806397 26023 catalog_manager.cc:1347] Generated new cluster ID: d6cf14f0b7564da3b21d8e1932380485
I20260923 17:16:43.806473 26023 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:16:43.830458 26023 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:16:43.831765 26023 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:16:43.843952 26023 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1: Generated new TSK 0
I20260923 17:16:43.844646 26023 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.229.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab.
Entry for principal kudu/127.11.229.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab.
I20260923 17:16:43.874651 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.129:0
--local_ip_for_outbound_sockets=127.11.229.129
--webserver_interface=127.11.229.129
--webserver_port=0
--tserver_master_addrs=127.11.229.190:44985
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab
--principal=kudu/127.11.229.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:39033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:16:43.995049 26035 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:16:43.995321 26035 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:16:43.995366 26035 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:16:43.999644 26035 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:16:43.999702 26035 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:16:43.999790 26035 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.129
I20260923 17:16:44.005091 26035 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:39033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab
--principal=kudu/127.11.229.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.229.129
--webserver_port=0
--tserver_master_addrs=127.11.229.190:44985
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26035
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.129
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:16:44.006107 26035 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:16:44.007102 26035 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:16:44.016530 26040 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:16:44.016639 26043 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:16:44.016530 26041 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:16:44.016731 26035 server_base.cc:1034] running on GCE node
I20260923 17:16:44.017144 26035 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:16:44.017993 26035 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:16:44.019197 26035 hybrid_clock.cc:648] HybridClock initialized: now 1790183804019162 us; error 48 us; skew 500 ppm
Sep 23 17:16:44 dist-test-slave-1x1f krb5kdc[25928](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183804, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:16:44.021953 26035 init.cc:377] Logged in from keytab as kudu/127.11.229.129@KRBTEST.COM (short username kudu)
I20260923 17:16:44.022884 26035 webserver.cc:460] Webserver started at http://127.11.229.129:45423/ using document root <none> and password file <none>
I20260923 17:16:44.023452 26035 fs_manager.cc:359] Metadata directory not provided
I20260923 17:16:44.023540 26035 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:16:44.023770 26035 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:16:44.025794 26035 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-0/data/instance:
uuid: "fac5855b35dd44b3b9af0f38d07b32e1"
format_stamp: "Formatted at 2026-09-23 17:16:44 on dist-test-slave-1x1f"
server_key: "1839442265d0db8db9d824783136cf39"
server_key_iv: "d4a3d0b00bc5b2df48717caa0c2ee85d"
server_key_version: "encryptionkey@0"
I20260923 17:16:44.026582 26035 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance:
uuid: "fac5855b35dd44b3b9af0f38d07b32e1"
format_stamp: "Formatted at 2026-09-23 17:16:44 on dist-test-slave-1x1f"
server_key: "1839442265d0db8db9d824783136cf39"
server_key_iv: "d4a3d0b00bc5b2df48717caa0c2ee85d"
server_key_version: "encryptionkey@0"
I20260923 17:16:44.030676 26035 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.003s
I20260923 17:16:44.033255 26050 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:16:44.034546 26035 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 17:16:44.034698 26035 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-0/wal
uuid: "fac5855b35dd44b3b9af0f38d07b32e1"
format_stamp: "Formatted at 2026-09-23 17:16:44 on dist-test-slave-1x1f"
server_key: "1839442265d0db8db9d824783136cf39"
server_key_iv: "d4a3d0b00bc5b2df48717caa0c2ee85d"
server_key_version: "encryptionkey@0"
I20260923 17:16:44.034823 26035 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:16:44.058094 26035 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:16:44.061796 26035 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:16:44.062023 26035 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:16:44.062701 26035 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:16:44.063588 26035 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:16:44.063668 26035 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:16:44.063750 26035 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:16:44.063796 26035 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:16:44.073210 26035 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.129:39103
I20260923 17:16:44.073225 26164 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.129:39103 every 8 connection(s)
I20260923 17:16:44.074157 26035 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
I20260923 17:16:44.081523 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 26035
I20260923 17:16:44.081676 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance
I20260923 17:16:44.081986 12182 external_mini_cluster.cc:1428] Setting key 32136e084ffaf1a793f20e521b1ce513
Sep 23 17:16:44 dist-test-slave-1x1f krb5kdc[25928](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183804, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.129@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:16:44.089329 26012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:44.076009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:33743 (local address 127.11.229.190:44985)
0923 17:16:44.076168 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:44.076172 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:44.076971 (+ 799us) server_negotiation.cc:407] Connection header received
0923 17:16:44.078644 (+ 1673us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:44.078648 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:44.078720 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:44.078833 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:16:44.080042 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:44.080640 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:44.081991 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:44.082408 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:44.082531 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:44.085363 (+ 2832us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:16:44.085367 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:16:44.085370 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:16:44.085399 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:16:44.087097 (+ 1698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:44.087671 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:44.087676 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:44.087679 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:44.087771 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:44.088137 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:44.088142 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:44.088144 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:44.088348 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:16:44.088467 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:44.088999 (+ 532us) server_negotiation.cc:299] Negotiation successful
0923 17:16:44.089141 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260923 17:16:44.090142 26167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:44.076364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.129:33743)
0923 17:16:44.076822 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:44.076866 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0923 17:16:44.078417 (+ 1551us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:16:44.079008 (+ 591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:16:44.079015 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:16:44.079377 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:16:44.079890 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:44.079903 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:44.080786 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:44.080792 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:44.081855 (+ 1063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:44.081865 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:44.082571 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:44.082576 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:44.082815 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:44.083559 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:16:44.083580 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:16:44.085173 (+ 1593us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:16:44.087250 (+ 2077us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:16:44.087256 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:16:44.087272 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:16:44.087555 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:16:44.087873 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:16:44.087878 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:16:44.087880 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:16:44.088034 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:16:44.088464 (+ 430us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:16:44.088472 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:16:44.088740 (+ 268us) client_negotiation.cc:769] Sending connection context
0923 17:16:44.088942 (+ 202us) client_negotiation.cc:240] Negotiation successful
0923 17:16:44.089298 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":108,"threads_started":1}
WARNING: no policy specified for kudu/127.11.229.130@KRBTEST.COM; defaulting to no policy
I20260923 17:16:44.091559 26165 heartbeater.cc:347] Connected to a master server at 127.11.229.190:44985
I20260923 17:16:44.091830 26165 heartbeater.cc:464] Registering TS with master...
I20260923 17:16:44.092310 26165 heartbeater.cc:511] Master 127.11.229.190:44985 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.130@KRBTEST.COM" created.
I20260923 17:16:44.093814 25973 ts_manager.cc:194] Registered new tserver with Master: fac5855b35dd44b3b9af0f38d07b32e1 (127.11.229.129:39103)
I20260923 17:16:44.095784 25973 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.129@KRBTEST.COM'} at 127.11.229.129:33743
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab.
Entry for principal kudu/127.11.229.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab.
I20260923 17:16:44.126482 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.130:0
--local_ip_for_outbound_sockets=127.11.229.130
--webserver_interface=127.11.229.130
--webserver_port=0
--tserver_master_addrs=127.11.229.190:44985
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab
--principal=kudu/127.11.229.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:39033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:16:44.235347 26170 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:16:44.235654 26170 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:16:44.235728 26170 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:16:44.239882 26170 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:16:44.239960 26170 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:16:44.240047 26170 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.130
I20260923 17:16:44.245230 26170 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:39033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab
--principal=kudu/127.11.229.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.229.130
--webserver_port=0
--tserver_master_addrs=127.11.229.190:44985
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26170
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.130
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:16:44.246312 26170 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:16:44.247334 26170 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:16:44.257397 26175 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:16:44.257448 26176 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:16:44.257438 26178 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:16:44.257573 26170 server_base.cc:1034] running on GCE node
I20260923 17:16:44.258052 26170 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:16:44.258679 26170 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:16:44.259877 26170 hybrid_clock.cc:648] HybridClock initialized: now 1790183804259864 us; error 23 us; skew 500 ppm
Sep 23 17:16:44 dist-test-slave-1x1f krb5kdc[25928](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183804, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:16:44.262512 26170 init.cc:377] Logged in from keytab as kudu/127.11.229.130@KRBTEST.COM (short username kudu)
I20260923 17:16:44.263414 26170 webserver.cc:460] Webserver started at http://127.11.229.130:39343/ using document root <none> and password file <none>
I20260923 17:16:44.263963 26170 fs_manager.cc:359] Metadata directory not provided
I20260923 17:16:44.264050 26170 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:16:44.264271 26170 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:16:44.266312 26170 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-1/data/instance:
uuid: "1b7744d6de814dffa2521e7c0170c656"
format_stamp: "Formatted at 2026-09-23 17:16:44 on dist-test-slave-1x1f"
server_key: "419fed7dd5c02d5d67d4b2523eee8140"
server_key_iv: "13f92a5175ddadc1a384b6de6cc92b73"
server_key_version: "encryptionkey@0"
I20260923 17:16:44.266878 26170 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance:
uuid: "1b7744d6de814dffa2521e7c0170c656"
format_stamp: "Formatted at 2026-09-23 17:16:44 on dist-test-slave-1x1f"
server_key: "419fed7dd5c02d5d67d4b2523eee8140"
server_key_iv: "13f92a5175ddadc1a384b6de6cc92b73"
server_key_version: "encryptionkey@0"
I20260923 17:16:44.270558 26170 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260923 17:16:44.272992 26185 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:16:44.274441 26170 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 17:16:44.274582 26170 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-1/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-1/wal
uuid: "1b7744d6de814dffa2521e7c0170c656"
format_stamp: "Formatted at 2026-09-23 17:16:44 on dist-test-slave-1x1f"
server_key: "419fed7dd5c02d5d67d4b2523eee8140"
server_key_iv: "13f92a5175ddadc1a384b6de6cc92b73"
server_key_version: "encryptionkey@0"
I20260923 17:16:44.274695 26170 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:16:44.294940 26170 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:16:44.298260 26170 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:16:44.298452 26170 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:16:44.299021 26170 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:16:44.299817 26170 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:16:44.299883 26170 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:16:44.299949 26170 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:16:44.299993 26170 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:16:44.309063 26170 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.130:42083
I20260923 17:16:44.309080 26299 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.130:42083 every 8 connection(s)
I20260923 17:16:44.309929 26170 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
I20260923 17:16:44.312904 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 26170
I20260923 17:16:44.313035 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance
I20260923 17:16:44.313400 12182 external_mini_cluster.cc:1428] Setting key 6bb5c757ffea07774dfe987814c4ab6a
Sep 23 17:16:44 dist-test-slave-1x1f krb5kdc[25928](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183804, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.130@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.229.131@KRBTEST.COM; defaulting to no policy
I20260923 17:16:44.326050 26012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:44.311859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:52115 (local address 127.11.229.190:44985)
0923 17:16:44.312024 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:44.312029 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:44.312882 (+ 853us) server_negotiation.cc:407] Connection header received
0923 17:16:44.314819 (+ 1937us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:44.314823 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:44.314881 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:44.314966 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:16:44.316674 (+ 1708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:44.317506 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:44.318909 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:44.319162 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:44.319287 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:44.321907 (+ 2620us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:16:44.321911 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:16:44.321914 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:16:44.321946 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:16:44.323515 (+ 1569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:44.324086 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:44.324091 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:44.324093 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:44.324177 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:44.324646 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:44.324652 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:44.324654 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:44.324857 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:16:44.324969 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:44.325752 (+ 783us) server_negotiation.cc:299] Negotiation successful
0923 17:16:44.325886 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.131@KRBTEST.COM" created.
I20260923 17:16:44.326999 26302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:44.312186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.130:52115)
0923 17:16:44.312688 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:44.312750 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0923 17:16:44.314579 (+ 1829us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:16:44.315160 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:16:44.315172 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:16:44.315714 (+ 542us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:16:44.316478 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:44.316502 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:44.317659 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:44.317662 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:44.318774 (+ 1112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:44.318784 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:44.319330 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:44.319335 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:44.319549 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:44.320184 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:16:44.320201 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:16:44.321727 (+ 1526us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:16:44.323635 (+ 1908us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:16:44.323642 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:16:44.323659 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:16:44.323971 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:16:44.324316 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:16:44.324320 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:16:44.324322 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:16:44.324531 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:16:44.324980 (+ 449us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:16:44.324990 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:16:44.325426 (+ 436us) client_negotiation.cc:769] Sending connection context
0923 17:16:44.325709 (+ 283us) client_negotiation.cc:240] Negotiation successful
0923 17:16:44.326045 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":101,"threads_started":1}
I20260923 17:16:44.328363 26300 heartbeater.cc:347] Connected to a master server at 127.11.229.190:44985
I20260923 17:16:44.328629 26300 heartbeater.cc:464] Registering TS with master...
I20260923 17:16:44.329210 26300 heartbeater.cc:511] Master 127.11.229.190:44985 requested a full tablet report, sending...
I20260923 17:16:44.330349 25973 ts_manager.cc:194] Registered new tserver with Master: 1b7744d6de814dffa2521e7c0170c656 (127.11.229.130:42083)
I20260923 17:16:44.331208 25973 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.130@KRBTEST.COM'} at 127.11.229.130:52115
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab.
Entry for principal kudu/127.11.229.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab.
I20260923 17:16:44.342545 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.131:0
--local_ip_for_outbound_sockets=127.11.229.131
--webserver_interface=127.11.229.131
--webserver_port=0
--tserver_master_addrs=127.11.229.190:44985
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab
--principal=kudu/127.11.229.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:39033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:16:44.459167 26305 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:16:44.459460 26305 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:16:44.459537 26305 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:16:44.463555 26305 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:16:44.463641 26305 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:16:44.463734 26305 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.131
I20260923 17:16:44.468906 26305 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:39033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab
--principal=kudu/127.11.229.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.229.131
--webserver_port=0
--tserver_master_addrs=127.11.229.190:44985
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26305
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.131
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:16:44.469950 26305 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:16:44.470986 26305 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:16:44.481293 26310 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:16:44.481279 26311 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:16:44.481365 26313 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:16:44.481535 26305 server_base.cc:1034] running on GCE node
I20260923 17:16:44.481932 26305 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:16:44.482638 26305 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:16:44.483810 26305 hybrid_clock.cc:648] HybridClock initialized: now 1790183804483796 us; error 35 us; skew 500 ppm
Sep 23 17:16:44 dist-test-slave-1x1f krb5kdc[25928](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183804, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:16:44.486718 26305 init.cc:377] Logged in from keytab as kudu/127.11.229.131@KRBTEST.COM (short username kudu)
I20260923 17:16:44.487560 26305 webserver.cc:460] Webserver started at http://127.11.229.131:40717/ using document root <none> and password file <none>
I20260923 17:16:44.488070 26305 fs_manager.cc:359] Metadata directory not provided
I20260923 17:16:44.488125 26305 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:16:44.488298 26305 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:16:44.490440 26305 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-2/data/instance:
uuid: "af600c2890494e1ba21578ef6e073d26"
format_stamp: "Formatted at 2026-09-23 17:16:44 on dist-test-slave-1x1f"
server_key: "5b40d5891623d983d3d1a8b1ddcda782"
server_key_iv: "53e5897ec3995bd42bdb5ce45af11349"
server_key_version: "encryptionkey@0"
I20260923 17:16:44.490949 26305 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance:
uuid: "af600c2890494e1ba21578ef6e073d26"
format_stamp: "Formatted at 2026-09-23 17:16:44 on dist-test-slave-1x1f"
server_key: "5b40d5891623d983d3d1a8b1ddcda782"
server_key_iv: "53e5897ec3995bd42bdb5ce45af11349"
server_key_version: "encryptionkey@0"
I20260923 17:16:44.494691 26305 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260923 17:16:44.497334 26320 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:16:44.498746 26305 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 17:16:44.498842 26305 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-2/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-2/wal
uuid: "af600c2890494e1ba21578ef6e073d26"
format_stamp: "Formatted at 2026-09-23 17:16:44 on dist-test-slave-1x1f"
server_key: "5b40d5891623d983d3d1a8b1ddcda782"
server_key_iv: "53e5897ec3995bd42bdb5ce45af11349"
server_key_version: "encryptionkey@0"
I20260923 17:16:44.498925 26305 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:16:44.531957 26305 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:16:44.535180 26305 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:16:44.535349 26305 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:16:44.535888 26305 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:16:44.536696 26305 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:16:44.536742 26305 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:16:44.536784 26305 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:16:44.536799 26305 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:16:44.545670 26305 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.131:43643
I20260923 17:16:44.545692 26433 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.131:43643 every 8 connection(s)
I20260923 17:16:44.546604 26305 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
I20260923 17:16:44.549497 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 26305
I20260923 17:16:44.549633 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance
I20260923 17:16:44.549998 12182 external_mini_cluster.cc:1428] Setting key 716affa33c09f3a9f9fb829bf7e78da8
Sep 23 17:16:44 dist-test-slave-1x1f krb5kdc[25928](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183804, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.131@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:16:44.560916 26012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:44.548401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:48787 (local address 127.11.229.190:44985)
0923 17:16:44.548535 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:44.548539 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:44.549423 (+ 884us) server_negotiation.cc:407] Connection header received
0923 17:16:44.551377 (+ 1954us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:44.551381 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:44.551439 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:44.551516 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:16:44.552772 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:44.553318 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:44.554564 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:44.554797 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:44.554917 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:44.557197 (+ 2280us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:16:44.557201 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:16:44.557204 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:16:44.557235 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:16:44.558847 (+ 1612us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:44.559359 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:44.559363 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:44.559367 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:44.559445 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:44.559778 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:44.559783 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:44.559785 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:44.559971 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:16:44.560079 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:44.560611 (+ 532us) server_negotiation.cc:299] Negotiation successful
0923 17:16:44.560732 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260923 17:16:44.561697 26436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:44.548773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.131:48787)
0923 17:16:44.549243 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:44.549301 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0923 17:16:44.551154 (+ 1853us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:16:44.551694 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:16:44.551700 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:16:44.552054 (+ 354us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:16:44.552638 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:44.552651 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:44.553446 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:44.553449 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:44.554444 (+ 995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:44.554453 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:44.554952 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:44.554956 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:44.555125 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:44.555634 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:16:44.555649 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:16:44.557037 (+ 1388us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:16:44.558965 (+ 1928us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:16:44.558971 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:16:44.558985 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:16:44.559234 (+ 249us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:16:44.559544 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:16:44.559547 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:16:44.559549 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:16:44.559683 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:16:44.560087 (+ 404us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:16:44.560095 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:16:44.560364 (+ 269us) client_negotiation.cc:769] Sending connection context
0923 17:16:44.560569 (+ 205us) client_negotiation.cc:240] Negotiation successful
0923 17:16:44.560891 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":113,"threads_started":1}
I20260923 17:16:44.562918 26434 heartbeater.cc:347] Connected to a master server at 127.11.229.190:44985
I20260923 17:16:44.563194 26434 heartbeater.cc:464] Registering TS with master...
I20260923 17:16:44.563843 26434 heartbeater.cc:511] Master 127.11.229.190:44985 requested a full tablet report, sending...
I20260923 17:16:44.564895 25973 ts_manager.cc:194] Registered new tserver with Master: af600c2890494e1ba21578ef6e073d26 (127.11.229.131:43643)
I20260923 17:16:44.565464 25973 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.131@KRBTEST.COM'} at 127.11.229.131:48787
I20260923 17:16:44.576113 12182 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 17:16:44.586318 26012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:44.578473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58640 (local address 127.11.229.190:44985)
0923 17:16:44.578589 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:44.578592 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:44.578809 (+ 217us) server_negotiation.cc:407] Connection header received
0923 17:16:44.579001 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:44.579005 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:44.579060 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:44.579149 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:16:44.579930 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:44.580501 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:44.581410 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:44.581667 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:44.581798 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:44.583352 (+ 1554us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:16:44.583356 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:16:44.583358 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:16:44.583379 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:16:44.584597 (+ 1218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:44.585023 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:44.585027 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:44.585029 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:44.585109 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:44.585399 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:44.585403 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:44.585404 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:44.585623 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:16:44.585774 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:44.586004 (+ 230us) server_negotiation.cc:299] Negotiation successful
0923 17:16:44.586118 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260923 17:16:44.589093 25973 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58640:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 17:16:44.592201 25973 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 17:16:44.606978 26450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:44.601672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48678 (local address 127.11.229.131:43643)
0923 17:16:44.602128 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:44.602139 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:44.602159 (+ 20us) server_negotiation.cc:407] Connection header received
0923 17:16:44.602250 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:44.602258 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:44.602436 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:44.602580 (+ 144us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:16:44.602812 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:44.603848 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:44.605421 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:44.606289 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:44.606416 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:44.606567 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:44.606706 (+ 139us) server_negotiation.cc:299] Negotiation successful
0923 17:16:44.606819 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":180,"threads_started":1}
I20260923 17:16:44.606967 26446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:44.600461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.130:42083 (local address 127.0.0.1:57446)
0923 17:16:44.600876 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:44.600892 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 17:16:44.601001 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:16:44.602398 (+ 1397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:16:44.602406 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:16:44.602433 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:16:44.602579 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:44.602586 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:44.603929 (+ 1343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:44.603934 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:44.605452 (+ 1518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:44.605462 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:44.606539 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:44.606543 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:44.606678 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:44.606702 (+ 24us) client_negotiation.cc:769] Sending connection context
0923 17:16:44.606753 (+ 51us) client_negotiation.cc:240] Negotiation successful
0923 17:16:44.606836 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":358,"mutex_wait_us":69,"spinlock_wait_cycles":5632,"thread_start_us":77,"threads_started":1}
I20260923 17:16:44.607295 26448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:44.601265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51748 (local address 127.11.229.129:39103)
0923 17:16:44.602872 (+ 1607us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:44.602879 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:44.602902 (+ 23us) server_negotiation.cc:407] Connection header received
0923 17:16:44.602972 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:44.602977 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:44.603185 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:44.603320 (+ 135us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:16:44.603619 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:44.604743 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:44.605982 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:44.606752 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:44.606851 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:44.606966 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:44.607061 (+ 95us) server_negotiation.cc:299] Negotiation successful
0923 17:16:44.607153 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1507,"thread_start_us":75,"threads_started":1}
I20260923 17:16:44.607852 26449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:44.601311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57446 (local address 127.11.229.130:42083)
0923 17:16:44.601797 (+ 486us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:44.601811 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:44.601850 (+ 39us) server_negotiation.cc:407] Connection header received
0923 17:16:44.601932 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:44.601938 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:44.602141 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:44.602364 (+ 223us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:16:44.602713 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:44.603795 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:44.605582 (+ 1787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:44.606414 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:44.607552 (+ 1138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:44.607641 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:44.607678 (+ 37us) server_negotiation.cc:299] Negotiation successful
0923 17:16:44.607740 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":383,"thread_start_us":100,"threads_started":1}
I20260923 17:16:44.607928 26447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:44.601197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.131:43643 (local address 127.0.0.1:48678)
0923 17:16:44.601429 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:44.601441 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 17:16:44.601521 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:16:44.602569 (+ 1048us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:16:44.602571 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:16:44.602585 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:16:44.602695 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:44.602701 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:44.603979 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:44.603983 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:44.605302 (+ 1319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:44.605312 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:44.606397 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:44.606400 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:44.606514 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:44.606555 (+ 41us) client_negotiation.cc:769] Sending connection context
0923 17:16:44.606668 (+ 113us) client_negotiation.cc:240] Negotiation successful
0923 17:16:44.607850 (+ 1182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"mutex_wait_us":1181,"thread_start_us":100,"threads_started":1}
I20260923 17:16:44.608060 26445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:44.600461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:39103 (local address 127.0.0.1:51748)
0923 17:16:44.600814 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:44.600864 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0923 17:16:44.601001 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:16:44.603319 (+ 2318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:16:44.603322 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:16:44.603341 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:16:44.603495 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:44.603503 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:44.604876 (+ 1373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:44.604880 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:44.605868 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:44.605875 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:44.606848 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:44.606851 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:44.606940 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:44.606960 (+ 20us) client_negotiation.cc:769] Sending connection context
0923 17:16:44.607037 (+ 77us) client_negotiation.cc:240] Negotiation successful
0923 17:16:44.607103 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"mutex_wait_us":28,"spinlock_wait_cycles":7040,"thread_start_us":90,"threads_started":1}
I20260923 17:16:44.610728 26099 tablet_service.cc:1467] Processing CreateTablet for tablet e8c6a4a9d17443fbad9697092aadd07f (DEFAULT_TABLE table=test-table [id=211b5a81a4f74dbb978c5b32f15f049c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:16:44.610757 26368 tablet_service.cc:1467] Processing CreateTablet for tablet e8c6a4a9d17443fbad9697092aadd07f (DEFAULT_TABLE table=test-table [id=211b5a81a4f74dbb978c5b32f15f049c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:16:44.610757 26233 tablet_service.cc:1467] Processing CreateTablet for tablet e8c6a4a9d17443fbad9697092aadd07f (DEFAULT_TABLE table=test-table [id=211b5a81a4f74dbb978c5b32f15f049c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:16:44.611788 26368 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e8c6a4a9d17443fbad9697092aadd07f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:16:44.611784 26233 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e8c6a4a9d17443fbad9697092aadd07f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:16:44.611785 26099 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e8c6a4a9d17443fbad9697092aadd07f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:16:44.617795 26451 tablet_bootstrap.cc:492] T e8c6a4a9d17443fbad9697092aadd07f P fac5855b35dd44b3b9af0f38d07b32e1: Bootstrap starting.
I20260923 17:16:44.619176 26452 tablet_bootstrap.cc:492] T e8c6a4a9d17443fbad9697092aadd07f P 1b7744d6de814dffa2521e7c0170c656: Bootstrap starting.
I20260923 17:16:44.620391 26451 tablet_bootstrap.cc:654] T e8c6a4a9d17443fbad9697092aadd07f P fac5855b35dd44b3b9af0f38d07b32e1: Neither blocks nor log segments found. Creating new log.
I20260923 17:16:44.621279 26451 log.cc:824] T e8c6a4a9d17443fbad9697092aadd07f P fac5855b35dd44b3b9af0f38d07b32e1: Log is configured to *not* fsync() on all Append() calls
I20260923 17:16:44.621677 26452 tablet_bootstrap.cc:654] T e8c6a4a9d17443fbad9697092aadd07f P 1b7744d6de814dffa2521e7c0170c656: Neither blocks nor log segments found. Creating new log.
I20260923 17:16:44.622047 26453 tablet_bootstrap.cc:492] T e8c6a4a9d17443fbad9697092aadd07f P af600c2890494e1ba21578ef6e073d26: Bootstrap starting.
I20260923 17:16:44.622529 26452 log.cc:824] T e8c6a4a9d17443fbad9697092aadd07f P 1b7744d6de814dffa2521e7c0170c656: Log is configured to *not* fsync() on all Append() calls
I20260923 17:16:44.623718 26451 tablet_bootstrap.cc:492] T e8c6a4a9d17443fbad9697092aadd07f P fac5855b35dd44b3b9af0f38d07b32e1: No bootstrap required, opened a new log
I20260923 17:16:44.623901 26451 ts_tablet_manager.cc:1397] T e8c6a4a9d17443fbad9697092aadd07f P fac5855b35dd44b3b9af0f38d07b32e1: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260923 17:16:44.624097 26453 tablet_bootstrap.cc:654] T e8c6a4a9d17443fbad9697092aadd07f P af600c2890494e1ba21578ef6e073d26: Neither blocks nor log segments found. Creating new log.
I20260923 17:16:44.624491 26452 tablet_bootstrap.cc:492] T e8c6a4a9d17443fbad9697092aadd07f P 1b7744d6de814dffa2521e7c0170c656: No bootstrap required, opened a new log
I20260923 17:16:44.624667 26452 ts_tablet_manager.cc:1397] T e8c6a4a9d17443fbad9697092aadd07f P 1b7744d6de814dffa2521e7c0170c656: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260923 17:16:44.625305 26453 log.cc:824] T e8c6a4a9d17443fbad9697092aadd07f P af600c2890494e1ba21578ef6e073d26: Log is configured to *not* fsync() on all Append() calls
I20260923 17:16:44.627260 26453 tablet_bootstrap.cc:492] T e8c6a4a9d17443fbad9697092aadd07f P af600c2890494e1ba21578ef6e073d26: No bootstrap required, opened a new log
I20260923 17:16:44.627441 26453 ts_tablet_manager.cc:1397] T e8c6a4a9d17443fbad9697092aadd07f P af600c2890494e1ba21578ef6e073d26: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260923 17:16:44.628229 26451 raft_consensus.cc:348] T e8c6a4a9d17443fbad9697092aadd07f P fac5855b35dd44b3b9af0f38d07b32e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b7744d6de814dffa2521e7c0170c656" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42083 } } peers { permanent_uuid: "fac5855b35dd44b3b9af0f38d07b32e1" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 39103 } } peers { permanent_uuid: "af600c2890494e1ba21578ef6e073d26" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 43643 } }
I20260923 17:16:44.628490 26451 raft_consensus.cc:374] T e8c6a4a9d17443fbad9697092aadd07f P fac5855b35dd44b3b9af0f38d07b32e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:16:44.628553 26451 raft_consensus.cc:729] T e8c6a4a9d17443fbad9697092aadd07f P fac5855b35dd44b3b9af0f38d07b32e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac5855b35dd44b3b9af0f38d07b32e1, State: Initialized, Role: FOLLOWER
I20260923 17:16:44.628535 26452 raft_consensus.cc:348] T e8c6a4a9d17443fbad9697092aadd07f P 1b7744d6de814dffa2521e7c0170c656 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b7744d6de814dffa2521e7c0170c656" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42083 } } peers { permanent_uuid: "fac5855b35dd44b3b9af0f38d07b32e1" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 39103 } } peers { permanent_uuid: "af600c2890494e1ba21578ef6e073d26" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 43643 } }
I20260923 17:16:44.628820 26452 raft_consensus.cc:374] T e8c6a4a9d17443fbad9697092aadd07f P 1b7744d6de814dffa2521e7c0170c656 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:16:44.628875 26452 raft_consensus.cc:729] T e8c6a4a9d17443fbad9697092aadd07f P 1b7744d6de814dffa2521e7c0170c656 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b7744d6de814dffa2521e7c0170c656, State: Initialized, Role: FOLLOWER
I20260923 17:16:44.628989 26451 consensus_queue.cc:260] T e8c6a4a9d17443fbad9697092aadd07f P fac5855b35dd44b3b9af0f38d07b32e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b7744d6de814dffa2521e7c0170c656" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42083 } } peers { permanent_uuid: "fac5855b35dd44b3b9af0f38d07b32e1" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 39103 } } peers { permanent_uuid: "af600c2890494e1ba21578ef6e073d26" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 43643 } }
I20260923 17:16:44.629307 26452 consensus_queue.cc:260] T e8c6a4a9d17443fbad9697092aadd07f P 1b7744d6de814dffa2521e7c0170c656 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b7744d6de814dffa2521e7c0170c656" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42083 } } peers { permanent_uuid: "fac5855b35dd44b3b9af0f38d07b32e1" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 39103 } } peers { permanent_uuid: "af600c2890494e1ba21578ef6e073d26" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 43643 } }
I20260923 17:16:44.629730 26165 heartbeater.cc:503] Master 127.11.229.190:44985 was elected leader, sending a full tablet report...
I20260923 17:16:44.629964 26451 ts_tablet_manager.cc:1428] T e8c6a4a9d17443fbad9697092aadd07f P fac5855b35dd44b3b9af0f38d07b32e1: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260923 17:16:44.630191 26452 ts_tablet_manager.cc:1428] T e8c6a4a9d17443fbad9697092aadd07f P 1b7744d6de814dffa2521e7c0170c656: Time spent starting tablet: real 0.005s user 0.001s sys 0.005s
I20260923 17:16:44.630625 26300 heartbeater.cc:503] Master 127.11.229.190:44985 was elected leader, sending a full tablet report...
I20260923 17:16:44.632215 26453 raft_consensus.cc:348] T e8c6a4a9d17443fbad9697092aadd07f P af600c2890494e1ba21578ef6e073d26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b7744d6de814dffa2521e7c0170c656" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42083 } } peers { permanent_uuid: "fac5855b35dd44b3b9af0f38d07b32e1" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 39103 } } peers { permanent_uuid: "af600c2890494e1ba21578ef6e073d26" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 43643 } }
I20260923 17:16:44.632479 26453 raft_consensus.cc:374] T e8c6a4a9d17443fbad9697092aadd07f P af600c2890494e1ba21578ef6e073d26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:16:44.632560 26453 raft_consensus.cc:729] T e8c6a4a9d17443fbad9697092aadd07f P af600c2890494e1ba21578ef6e073d26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af600c2890494e1ba21578ef6e073d26, State: Initialized, Role: FOLLOWER
I20260923 17:16:44.633356 26453 consensus_queue.cc:260] T e8c6a4a9d17443fbad9697092aadd07f P af600c2890494e1ba21578ef6e073d26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b7744d6de814dffa2521e7c0170c656" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42083 } } peers { permanent_uuid: "fac5855b35dd44b3b9af0f38d07b32e1" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 39103 } } peers { permanent_uuid: "af600c2890494e1ba21578ef6e073d26" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 43643 } }
I20260923 17:16:44.633939 26434 heartbeater.cc:503] Master 127.11.229.190:44985 was elected leader, sending a full tablet report...
I20260923 17:16:44.634308 26453 ts_tablet_manager.cc:1428] T e8c6a4a9d17443fbad9697092aadd07f P af600c2890494e1ba21578ef6e073d26: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260923 17:16:44.637492 26457 raft_consensus.cc:482] T e8c6a4a9d17443fbad9697092aadd07f P fac5855b35dd44b3b9af0f38d07b32e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 17:16:44.637622 26457 raft_consensus.cc:504] T e8c6a4a9d17443fbad9697092aadd07f P fac5855b35dd44b3b9af0f38d07b32e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b7744d6de814dffa2521e7c0170c656" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42083 } } peers { permanent_uuid: "fac5855b35dd44b3b9af0f38d07b32e1" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 39103 } } peers { permanent_uuid: "af600c2890494e1ba21578ef6e073d26" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 43643 } }
I20260923 17:16:44.638670 26457 leader_election.cc:288] T e8c6a4a9d17443fbad9697092aadd07f P fac5855b35dd44b3b9af0f38d07b32e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b7744d6de814dffa2521e7c0170c656 (127.11.229.130:42083), af600c2890494e1ba21578ef6e073d26 (127.11.229.131:43643)
I20260923 17:16:44.642756 26449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:44.638939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:44983 (local address 127.11.229.130:42083)
0923 17:16:44.639075 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:44.639083 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:44.639236 (+ 153us) server_negotiation.cc:407] Connection header received
0923 17:16:44.639444 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:44.639448 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:44.639501 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:44.639595 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:16:44.639873 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:44.640484 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:44.641677 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:44.642118 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:44.642209 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:44.642329 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:44.642562 (+ 233us) server_negotiation.cc:299] Negotiation successful
0923 17:16:44.642635 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260923 17:16:44.642758 26450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:44.639381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:45969 (local address 127.11.229.131:43643)
0923 17:16:44.639758 (+ 377us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:44.639774 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:44.639786 (+ 12us) server_negotiation.cc:407] Connection header received
0923 17:16:44.639827 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:44.639831 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:44.639879 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:44.639950 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:16:44.640187 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:44.640745 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:44.641809 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:44.642220 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:44.642355 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:44.642405 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:44.642593 (+ 188us) server_negotiation.cc:299] Negotiation successful
0923 17:16:44.642657 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":297}
I20260923 17:16:44.642778 26461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:44.639248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.131:43643 (local address 127.11.229.129:45969)
0923 17:16:44.639610 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:44.639624 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 17:16:44.639716 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:16:44.639971 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:16:44.639974 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:16:44.639990 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:16:44.640101 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:44.640108 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:44.640865 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:44.640868 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:44.641689 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:44.641699 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:44.642350 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:44.642355 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:44.642458 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:44.642475 (+ 17us) client_negotiation.cc:769] Sending connection context
0923 17:16:44.642569 (+ 94us) client_negotiation.cc:240] Negotiation successful
0923 17:16:44.642634 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"mutex_wait_us":29,"thread_start_us":100,"threads_started":1}
I20260923 17:16:44.642789 26460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:44.638854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.130:42083 (local address 127.11.229.129:44983)
0923 17:16:44.639123 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:44.639135 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 17:16:44.639313 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:16:44.639614 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:16:44.639617 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:16:44.639633 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:16:44.639775 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:44.639784 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:44.640587 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:44.640590 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:44.641556 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:44.641565 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:44.642254 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:44.642327 (+ 73us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:44.642426 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:44.642450 (+ 24us) client_negotiation.cc:769] Sending connection context
0923 17:16:44.642524 (+ 74us) client_negotiation.cc:240] Negotiation successful
0923 17:16:44.642615 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206,"mutex_wait_us":30,"thread_start_us":119,"threads_started":1}
I20260923 17:16:44.643460 26253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8c6a4a9d17443fbad9697092aadd07f" candidate_uuid: "fac5855b35dd44b3b9af0f38d07b32e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b7744d6de814dffa2521e7c0170c656" is_pre_election: true
I20260923 17:16:44.643514 26388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8c6a4a9d17443fbad9697092aadd07f" candidate_uuid: "fac5855b35dd44b3b9af0f38d07b32e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af600c2890494e1ba21578ef6e073d26" is_pre_election: true
I20260923 17:16:44.643738 26388 raft_consensus.cc:2454] T e8c6a4a9d17443fbad9697092aadd07f P af600c2890494e1ba21578ef6e073d26 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac5855b35dd44b3b9af0f38d07b32e1 in term 0.
I20260923 17:16:44.643738 26253 raft_consensus.cc:2454] T e8c6a4a9d17443fbad9697092aadd07f P 1b7744d6de814dffa2521e7c0170c656 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fac5855b35dd44b3b9af0f38d07b32e1 in term 0.
I20260923 17:16:44.644156 26053 leader_election.cc:302] T e8c6a4a9d17443fbad9697092aadd07f P fac5855b35dd44b3b9af0f38d07b32e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af600c2890494e1ba21578ef6e073d26, fac5855b35dd44b3b9af0f38d07b32e1; no voters:
I20260923 17:16:44.644364 26457 raft_consensus.cc:2781] T e8c6a4a9d17443fbad9697092aadd07f P fac5855b35dd44b3b9af0f38d07b32e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 17:16:44.644457 26457 raft_consensus.cc:482] T e8c6a4a9d17443fbad9697092aadd07f P fac5855b35dd44b3b9af0f38d07b32e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 17:16:44.644512 26457 raft_consensus.cc:3037] T e8c6a4a9d17443fbad9697092aadd07f P fac5855b35dd44b3b9af0f38d07b32e1 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:16:44.645500 26457 raft_consensus.cc:504] T e8c6a4a9d17443fbad9697092aadd07f P fac5855b35dd44b3b9af0f38d07b32e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b7744d6de814dffa2521e7c0170c656" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42083 } } peers { permanent_uuid: "fac5855b35dd44b3b9af0f38d07b32e1" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 39103 } } peers { permanent_uuid: "af600c2890494e1ba21578ef6e073d26" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 43643 } }
I20260923 17:16:44.645851 26457 leader_election.cc:288] T e8c6a4a9d17443fbad9697092aadd07f P fac5855b35dd44b3b9af0f38d07b32e1 [CANDIDATE]: Term 1 election: Requested vote from peers 1b7744d6de814dffa2521e7c0170c656 (127.11.229.130:42083), af600c2890494e1ba21578ef6e073d26 (127.11.229.131:43643)
I20260923 17:16:44.646209 26388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8c6a4a9d17443fbad9697092aadd07f" candidate_uuid: "fac5855b35dd44b3b9af0f38d07b32e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af600c2890494e1ba21578ef6e073d26"
I20260923 17:16:44.646171 26253 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e8c6a4a9d17443fbad9697092aadd07f" candidate_uuid: "fac5855b35dd44b3b9af0f38d07b32e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b7744d6de814dffa2521e7c0170c656"
I20260923 17:16:44.646381 26388 raft_consensus.cc:3037] T e8c6a4a9d17443fbad9697092aadd07f P af600c2890494e1ba21578ef6e073d26 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:16:44.646404 26253 raft_consensus.cc:3037] T e8c6a4a9d17443fbad9697092aadd07f P 1b7744d6de814dffa2521e7c0170c656 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:16:44.647547 26253 raft_consensus.cc:2454] T e8c6a4a9d17443fbad9697092aadd07f P 1b7744d6de814dffa2521e7c0170c656 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac5855b35dd44b3b9af0f38d07b32e1 in term 1.
I20260923 17:16:44.647642 26388 raft_consensus.cc:2454] T e8c6a4a9d17443fbad9697092aadd07f P af600c2890494e1ba21578ef6e073d26 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fac5855b35dd44b3b9af0f38d07b32e1 in term 1.
I20260923 17:16:44.647804 26053 leader_election.cc:302] T e8c6a4a9d17443fbad9697092aadd07f P fac5855b35dd44b3b9af0f38d07b32e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b7744d6de814dffa2521e7c0170c656, fac5855b35dd44b3b9af0f38d07b32e1; no voters:
I20260923 17:16:44.647964 26457 raft_consensus.cc:2781] T e8c6a4a9d17443fbad9697092aadd07f P fac5855b35dd44b3b9af0f38d07b32e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:16:44.648172 26457 raft_consensus.cc:686] T e8c6a4a9d17443fbad9697092aadd07f P fac5855b35dd44b3b9af0f38d07b32e1 [term 1 LEADER]: Becoming Leader. State: Replica: fac5855b35dd44b3b9af0f38d07b32e1, State: Running, Role: LEADER
I20260923 17:16:44.648473 26457 consensus_queue.cc:237] T e8c6a4a9d17443fbad9697092aadd07f P fac5855b35dd44b3b9af0f38d07b32e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b7744d6de814dffa2521e7c0170c656" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42083 } } peers { permanent_uuid: "fac5855b35dd44b3b9af0f38d07b32e1" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 39103 } } peers { permanent_uuid: "af600c2890494e1ba21578ef6e073d26" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 43643 } }
I20260923 17:16:44.651587 25972 catalog_manager.cc:5495] T e8c6a4a9d17443fbad9697092aadd07f P fac5855b35dd44b3b9af0f38d07b32e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to fac5855b35dd44b3b9af0f38d07b32e1 (127.11.229.129). New cstate: current_term: 1 leader_uuid: "fac5855b35dd44b3b9af0f38d07b32e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b7744d6de814dffa2521e7c0170c656" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fac5855b35dd44b3b9af0f38d07b32e1" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 39103 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af600c2890494e1ba21578ef6e073d26" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 43643 } health_report { overall_health: UNKNOWN } } }
I20260923 17:16:44.668179 26448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:44.664638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51764 (local address 127.11.229.129:39103)
0923 17:16:44.664770 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:44.664775 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:44.664789 (+ 14us) server_negotiation.cc:407] Connection header received
0923 17:16:44.664964 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:44.664967 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:44.665016 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:44.665120 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 17:16:44.665370 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:44.665881 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:44.666788 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:44.667006 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:44.667114 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:44.667422 (+ 308us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 17:16:44.667801 (+ 379us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 17:16:44.667925 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:44.667986 (+ 61us) server_negotiation.cc:299] Negotiation successful
0923 17:16:44.668040 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260923 17:16:44.673779 26253 raft_consensus.cc:1261] T e8c6a4a9d17443fbad9697092aadd07f P 1b7744d6de814dffa2521e7c0170c656 [term 1 FOLLOWER]: Refusing update from remote peer fac5855b35dd44b3b9af0f38d07b32e1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:16:44.673820 26388 raft_consensus.cc:1261] T e8c6a4a9d17443fbad9697092aadd07f P af600c2890494e1ba21578ef6e073d26 [term 1 FOLLOWER]: Refusing update from remote peer fac5855b35dd44b3b9af0f38d07b32e1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:16:44.674584 26457 consensus_queue.cc:1035] T e8c6a4a9d17443fbad9697092aadd07f P fac5855b35dd44b3b9af0f38d07b32e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af600c2890494e1ba21578ef6e073d26" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 43643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:16:44.674787 26462 consensus_queue.cc:1035] T e8c6a4a9d17443fbad9697092aadd07f P fac5855b35dd44b3b9af0f38d07b32e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b7744d6de814dffa2521e7c0170c656" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:16:44.681455 26465 mvcc.cc:205] Tried to move back new op lower bound from 7332592863937183744 to 7332592863842553856. Current Snapshot: MvccSnapshot[applied={T|T < 7332592863937183744}]
I20260923 17:16:44.682175 26466 mvcc.cc:205] Tried to move back new op lower bound from 7332592863937183744 to 7332592863842553856. Current Snapshot: MvccSnapshot[applied={T|T < 7332592863937183744}]
I20260923 17:16:44.684471 26467 mvcc.cc:205] Tried to move back new op lower bound from 7332592863937183744 to 7332592863842553856. Current Snapshot: MvccSnapshot[applied={T|T < 7332592863937183744}]
I20260923 17:16:44.690680 25972 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58640:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:16:44.690864 25972 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58640:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:16:44.693290 25972 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1: Sending DeleteTablet for 3 replicas of tablet e8c6a4a9d17443fbad9697092aadd07f
I20260923 17:16:44.694029 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 26035
I20260923 17:16:44.693984 26099 tablet_service.cc:1514] Processing DeleteTablet for tablet e8c6a4a9d17443fbad9697092aadd07f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:16:44 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:51748
I20260923 17:16:44.694730 26368 tablet_service.cc:1514] Processing DeleteTablet for tablet e8c6a4a9d17443fbad9697092aadd07f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:16:44 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:48678
I20260923 17:16:44.694730 26233 tablet_service.cc:1514] Processing DeleteTablet for tablet e8c6a4a9d17443fbad9697092aadd07f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:16:44 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:57446
I20260923 17:16:44.695209 26474 tablet_replica.cc:330] T e8c6a4a9d17443fbad9697092aadd07f P af600c2890494e1ba21578ef6e073d26: stopping tablet replica
I20260923 17:16:44.695545 26474 raft_consensus.cc:2229] T e8c6a4a9d17443fbad9697092aadd07f P af600c2890494e1ba21578ef6e073d26 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:16:44.695540 26475 tablet_replica.cc:330] T e8c6a4a9d17443fbad9697092aadd07f P 1b7744d6de814dffa2521e7c0170c656: stopping tablet replica
I20260923 17:16:44.695856 26475 raft_consensus.cc:2229] T e8c6a4a9d17443fbad9697092aadd07f P 1b7744d6de814dffa2521e7c0170c656 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:16:44.695880 26474 raft_consensus.cc:2258] T e8c6a4a9d17443fbad9697092aadd07f P af600c2890494e1ba21578ef6e073d26 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:16:44.696146 26475 raft_consensus.cc:2258] T e8c6a4a9d17443fbad9697092aadd07f P 1b7744d6de814dffa2521e7c0170c656 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:16:44.697595 26474 ts_tablet_manager.cc:1905] T e8c6a4a9d17443fbad9697092aadd07f P af600c2890494e1ba21578ef6e073d26: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:16:44.697635 26475 ts_tablet_manager.cc:1905] T e8c6a4a9d17443fbad9697092aadd07f P 1b7744d6de814dffa2521e7c0170c656: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:16:44.699899 26475 ts_tablet_manager.cc:1918] T e8c6a4a9d17443fbad9697092aadd07f P 1b7744d6de814dffa2521e7c0170c656: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 17:16:44.700007 26475 log.cc:1196] T e8c6a4a9d17443fbad9697092aadd07f P 1b7744d6de814dffa2521e7c0170c656: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-1/wal/wals/e8c6a4a9d17443fbad9697092aadd07f
I20260923 17:16:44.700304 26475 ts_tablet_manager.cc:1939] T e8c6a4a9d17443fbad9697092aadd07f P 1b7744d6de814dffa2521e7c0170c656: Deleting consensus metadata
I20260923 17:16:44.701277 26474 ts_tablet_manager.cc:1918] T e8c6a4a9d17443fbad9697092aadd07f P af600c2890494e1ba21578ef6e073d26: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 17:16:44.701390 26474 log.cc:1196] T e8c6a4a9d17443fbad9697092aadd07f P af600c2890494e1ba21578ef6e073d26: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-2/wal/wals/e8c6a4a9d17443fbad9697092aadd07f
I20260923 17:16:44.701400 25959 catalog_manager.cc:4841] TS 1b7744d6de814dffa2521e7c0170c656 (127.11.229.130:42083): tablet e8c6a4a9d17443fbad9697092aadd07f (table test-table [id=211b5a81a4f74dbb978c5b32f15f049c]) successfully deleted
I20260923 17:16:44.701742 26474 ts_tablet_manager.cc:1939] T e8c6a4a9d17443fbad9697092aadd07f P af600c2890494e1ba21578ef6e073d26: Deleting consensus metadata
I20260923 17:16:44.703307 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 26170
W20260923 17:16:44.703272 25960 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.229.129:39103 (error 108)
I20260923 17:16:44.703274 25959 catalog_manager.cc:4841] TS af600c2890494e1ba21578ef6e073d26 (127.11.229.131:43643): tablet e8c6a4a9d17443fbad9697092aadd07f (table test-table [id=211b5a81a4f74dbb978c5b32f15f049c]) successfully deleted
I20260923 17:16:44.705019 26445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:44.704675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:39103 (local address 127.0.0.1:51768)
0923 17:16:44.704832 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:44.704918 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.129:39103: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260923 17:16:44.705242 25960 catalog_manager.cc:4584] TS fac5855b35dd44b3b9af0f38d07b32e1 (127.11.229.129:39103): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e8c6a4a9d17443fbad9697092aadd07f: Network error: Client connection negotiation failed: client connection to 127.11.229.129:39103: connect: Connection refused (error 111)
I20260923 17:16:44.709811 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 26305
I20260923 17:16:44.715350 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 25941
I20260923 17:16:44.721932 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:44985
--webserver_interface=127.11.229.190
--webserver_port=39449
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:39033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:44985
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:16:44.829825 26477 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:16:44.830081 26477 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:16:44.830120 26477 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:16:44.834057 26477 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:16:44.834113 26477 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:16:44.834132 26477 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:16:44.834149 26477 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:16:44.834164 26477 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:16:44.839558 26477 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:39033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:44985
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:44985
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.229.190
--webserver_port=39449
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26477
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:16:44.840524 26477 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:16:44.841444 26477 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:16:44.854481 26484 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:16:44.854606 26477 server_base.cc:1034] running on GCE node
W20260923 17:16:44.854508 26486 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:16:44.854481 26483 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:16:44.855319 26477 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:16:44.856506 26477 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:16:44.857709 26477 hybrid_clock.cc:648] HybridClock initialized: now 1790183804857672 us; error 49 us; skew 500 ppm
Sep 23 17:16:44 dist-test-slave-1x1f krb5kdc[25928](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183804, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:16:44.860524 26477 init.cc:377] Logged in from keytab as kudu/127.11.229.190@KRBTEST.COM (short username kudu)
I20260923 17:16:44.861409 26477 webserver.cc:460] Webserver started at http://127.11.229.190:39449/ using document root <none> and password file <none>
I20260923 17:16:44.861997 26477 fs_manager.cc:359] Metadata directory not provided
I20260923 17:16:44.862111 26477 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:16:44.866097 26477 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.001s
I20260923 17:16:44.868287 26493 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:16:44.869498 26477 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 17:16:44.869642 26477 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "ab93d0e00d144467a0c5ee3c286f80b1"
format_stamp: "Formatted at 2026-09-23 17:16:43 on dist-test-slave-1x1f"
server_key: "fbd50d0c43c20dd33c5b55f2f22e0201"
server_key_iv: "41319671b87fbffc5f5ee6444b69e44b"
server_key_version: "encryptionkey@0"
I20260923 17:16:44.870275 26477 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:16:44.886334 26477 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:16:44.889616 26477 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:16:44.889833 26477 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:16:44.896720 26477 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.190:44985
I20260923 17:16:44.897044 26545 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.190:44985 every 8 connection(s)
I20260923 17:16:44.897948 26477 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:16:44.898566 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 26477
I20260923 17:16:44.899062 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.129:39103
--local_ip_for_outbound_sockets=127.11.229.129
--tserver_master_addrs=127.11.229.190:44985
--webserver_port=45423
--webserver_interface=127.11.229.129
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab
--principal=kudu/127.11.229.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:39033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 17:16:44.903188 26546 sys_catalog.cc:263] Verifying existing consensus state
I20260923 17:16:44.904848 26546 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1: Bootstrap starting.
I20260923 17:16:44.921626 26546 log.cc:824] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1: Log is configured to *not* fsync() on all Append() calls
I20260923 17:16:44.930083 26546 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260923 17:16:44.930514 26546 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1: Bootstrap complete.
I20260923 17:16:44.934669 26546 raft_consensus.cc:348] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab93d0e00d144467a0c5ee3c286f80b1" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 44985 } }
I20260923 17:16:44.935098 26546 raft_consensus.cc:729] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab93d0e00d144467a0c5ee3c286f80b1, State: Initialized, Role: FOLLOWER
I20260923 17:16:44.935621 26546 consensus_queue.cc:260] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab93d0e00d144467a0c5ee3c286f80b1" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 44985 } }
I20260923 17:16:44.935765 26546 raft_consensus.cc:388] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:16:44.935854 26546 raft_consensus.cc:482] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:16:44.935968 26546 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [term 1 FOLLOWER]: Advancing to term 2
I20260923 17:16:44.937930 26546 raft_consensus.cc:504] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab93d0e00d144467a0c5ee3c286f80b1" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 44985 } }
I20260923 17:16:44.938310 26546 leader_election.cc:302] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ab93d0e00d144467a0c5ee3c286f80b1; no voters:
I20260923 17:16:44.938704 26546 leader_election.cc:288] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260923 17:16:44.938793 26550 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [term 2 FOLLOWER]: Leader election won for term 2
I20260923 17:16:44.938993 26550 raft_consensus.cc:686] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [term 2 LEADER]: Becoming Leader. State: Replica: ab93d0e00d144467a0c5ee3c286f80b1, State: Running, Role: LEADER
I20260923 17:16:44.939276 26550 consensus_queue.cc:237] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab93d0e00d144467a0c5ee3c286f80b1" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 44985 } }
I20260923 17:16:44.939932 26546 sys_catalog.cc:564] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:16:44.940562 26551 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "ab93d0e00d144467a0c5ee3c286f80b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab93d0e00d144467a0c5ee3c286f80b1" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 44985 } } }
I20260923 17:16:44.940687 26551 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [sys.catalog]: This master's current role is: LEADER
I20260923 17:16:44.941431 26552 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ab93d0e00d144467a0c5ee3c286f80b1. Latest consensus state: current_term: 2 leader_uuid: "ab93d0e00d144467a0c5ee3c286f80b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab93d0e00d144467a0c5ee3c286f80b1" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 44985 } } }
I20260923 17:16:44.941625 26552 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [sys.catalog]: This master's current role is: LEADER
I20260923 17:16:44.941926 26558 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:16:44.945716 26558 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:16:44.946273 26558 catalog_manager.cc:1259] Loaded cluster ID: d6cf14f0b7564da3b21d8e1932380485
I20260923 17:16:44.946346 26558 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:16:44.947422 26558 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260923 17:16:44.950124 26558 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260923 17:16:44.954407 26558 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:16:44.955094 26558 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1: Loaded TSK: 0
I20260923 17:16:44.956064 26558 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260923 17:16:45.026274 26548 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:16:45.026613 26548 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:16:45.026703 26548 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:16:45.031219 26548 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:16:45.031304 26548 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:16:45.031401 26548 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.129
I20260923 17:16:45.037189 26548 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:39033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab
--principal=kudu/127.11.229.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.129:39103
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.229.129
--webserver_port=45423
--tserver_master_addrs=127.11.229.190:44985
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26548
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.129
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:16:45.038370 26548 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:16:45.039474 26548 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:16:45.049942 26574 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:16:45.049968 26548 server_base.cc:1034] running on GCE node
W20260923 17:16:45.049991 26576 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:16:45.050122 26573 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:16:45.050711 26548 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:16:45.051340 26548 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:16:45.052554 26548 hybrid_clock.cc:648] HybridClock initialized: now 1790183805052529 us; error 42 us; skew 500 ppm
Sep 23 17:16:45 dist-test-slave-1x1f krb5kdc[25928](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183805, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:16:45.055629 26548 init.cc:377] Logged in from keytab as kudu/127.11.229.129@KRBTEST.COM (short username kudu)
I20260923 17:16:45.056562 26548 webserver.cc:460] Webserver started at http://127.11.229.129:45423/ using document root <none> and password file <none>
I20260923 17:16:45.057149 26548 fs_manager.cc:359] Metadata directory not provided
I20260923 17:16:45.057289 26548 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:16:45.061499 26548 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260923 17:16:45.063925 26583 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:16:45.065292 26548 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260923 17:16:45.065428 26548 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-0/wal
uuid: "fac5855b35dd44b3b9af0f38d07b32e1"
format_stamp: "Formatted at 2026-09-23 17:16:44 on dist-test-slave-1x1f"
server_key: "1839442265d0db8db9d824783136cf39"
server_key_iv: "d4a3d0b00bc5b2df48717caa0c2ee85d"
server_key_version: "encryptionkey@0"
I20260923 17:16:45.065995 26548 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:16:45.097388 26548 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:16:45.100986 26548 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:16:45.101218 26548 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:16:45.101864 26548 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:16:45.103083 26590 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260923 17:16:45.107380 26548 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260923 17:16:45.107489 26548 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.000s
I20260923 17:16:45.107578 26548 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260923 17:16:45.109416 26548 ts_tablet_manager.cc:610] Registered 1 tablets
I20260923 17:16:45.109488 26548 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260923 17:16:45.109822 26590 tablet_bootstrap.cc:492] T e8c6a4a9d17443fbad9697092aadd07f P fac5855b35dd44b3b9af0f38d07b32e1: Bootstrap starting.
I20260923 17:16:45.120713 26548 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.129:39103
I20260923 17:16:45.120790 26697 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.129:39103 every 8 connection(s)
I20260923 17:16:45.121650 26548 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
I20260923 17:16:45.126511 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 26548
I20260923 17:16:45.127038 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.130:42083
--local_ip_for_outbound_sockets=127.11.229.130
--tserver_master_addrs=127.11.229.190:44985
--webserver_port=39343
--webserver_interface=127.11.229.130
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab
--principal=kudu/127.11.229.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:39033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 17:16:45.129696 26590 log.cc:824] T e8c6a4a9d17443fbad9697092aadd07f P fac5855b35dd44b3b9af0f38d07b32e1: Log is configured to *not* fsync() on all Append() calls
Sep 23 17:16:45 dist-test-slave-1x1f krb5kdc[25928](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183805, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.129@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:16:45.138082 26590 tablet_bootstrap.cc:492] T e8c6a4a9d17443fbad9697092aadd07f P fac5855b35dd44b3b9af0f38d07b32e1: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260923 17:16:45.138587 26590 tablet_bootstrap.cc:492] T e8c6a4a9d17443fbad9697092aadd07f P fac5855b35dd44b3b9af0f38d07b32e1: Bootstrap complete.
I20260923 17:16:45.139869 26590 ts_tablet_manager.cc:1397] T e8c6a4a9d17443fbad9697092aadd07f P fac5855b35dd44b3b9af0f38d07b32e1: Time spent bootstrapping tablet: real 0.030s user 0.020s sys 0.008s
I20260923 17:16:45.141651 26700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:45.123919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:46349 (local address 127.11.229.190:44985)
0923 17:16:45.124322 (+ 403us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:45.124347 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:45.124644 (+ 297us) server_negotiation.cc:407] Connection header received
0923 17:16:45.125841 (+ 1197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:45.125859 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:45.126353 (+ 494us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:45.126822 (+ 469us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:16:45.128360 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:45.129817 (+ 1457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:45.131296 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:45.132098 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:45.132307 (+ 209us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:45.135487 (+ 3180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:16:45.135493 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:16:45.135507 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:16:45.135541 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:16:45.137759 (+ 2218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:45.138485 (+ 726us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:45.138494 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:45.138502 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:45.138661 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:45.139090 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:45.139093 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:45.139095 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:45.139548 (+ 453us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:16:45.139679 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:45.140396 (+ 717us) server_negotiation.cc:299] Negotiation successful
0923 17:16:45.140685 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":250,"thread_start_us":113,"threads_started":1}
I20260923 17:16:45.142372 26701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:45.123927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.129:46349)
0923 17:16:45.124444 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:45.124495 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0923 17:16:45.125353 (+ 858us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:16:45.126874 (+ 1521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:16:45.126883 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:16:45.127415 (+ 532us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:16:45.128081 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:45.128104 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:45.129956 (+ 1852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:45.129959 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:45.131141 (+ 1182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:45.131164 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:45.132261 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:45.132265 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:45.132459 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:45.133175 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:16:45.133195 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:16:45.135256 (+ 2061us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:16:45.137895 (+ 2639us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:16:45.137903 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:16:45.137920 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:16:45.138347 (+ 427us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:16:45.138780 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:16:45.138784 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:16:45.138785 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:16:45.138965 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:16:45.139672 (+ 707us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:16:45.139681 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:16:45.139971 (+ 290us) client_negotiation.cc:769] Sending connection context
0923 17:16:45.140238 (+ 267us) client_negotiation.cc:240] Negotiation successful
0923 17:16:45.140557 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":135,"threads_started":1}
I20260923 17:16:45.142841 26590 raft_consensus.cc:348] T e8c6a4a9d17443fbad9697092aadd07f P fac5855b35dd44b3b9af0f38d07b32e1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b7744d6de814dffa2521e7c0170c656" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42083 } } peers { permanent_uuid: "fac5855b35dd44b3b9af0f38d07b32e1" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 39103 } } peers { permanent_uuid: "af600c2890494e1ba21578ef6e073d26" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 43643 } }
I20260923 17:16:45.143246 26590 raft_consensus.cc:729] T e8c6a4a9d17443fbad9697092aadd07f P fac5855b35dd44b3b9af0f38d07b32e1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac5855b35dd44b3b9af0f38d07b32e1, State: Initialized, Role: FOLLOWER
I20260923 17:16:45.143672 26590 consensus_queue.cc:260] T e8c6a4a9d17443fbad9697092aadd07f P fac5855b35dd44b3b9af0f38d07b32e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b7744d6de814dffa2521e7c0170c656" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42083 } } peers { permanent_uuid: "fac5855b35dd44b3b9af0f38d07b32e1" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 39103 } } peers { permanent_uuid: "af600c2890494e1ba21578ef6e073d26" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 43643 } }
I20260923 17:16:45.144554 26590 ts_tablet_manager.cc:1428] T e8c6a4a9d17443fbad9697092aadd07f P fac5855b35dd44b3b9af0f38d07b32e1: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260923 17:16:45.144796 26698 heartbeater.cc:347] Connected to a master server at 127.11.229.190:44985
I20260923 17:16:45.145027 26698 heartbeater.cc:464] Registering TS with master...
I20260923 17:16:45.145532 26698 heartbeater.cc:511] Master 127.11.229.190:44985 requested a full tablet report, sending...
I20260923 17:16:45.148061 26508 ts_manager.cc:194] Registered new tserver with Master: fac5855b35dd44b3b9af0f38d07b32e1 (127.11.229.129:39103)
I20260923 17:16:45.151624 26508 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.129@KRBTEST.COM'} at 127.11.229.129:46349
I20260923 17:16:45.154389 26698 heartbeater.cc:503] Master 127.11.229.190:44985 was elected leader, sending a full tablet report...
Sep 23 17:16:45 dist-test-slave-1x1f krb5kdc[25928](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183804, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for kudu/127.11.229.129@KRBTEST.COM
I20260923 17:16:45.162181 26705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:45.150955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:39103 (local address 127.0.0.1:51782)
0923 17:16:45.151349 (+ 394us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:45.151394 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0923 17:16:45.151520 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:16:45.152194 (+ 674us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:16:45.152200 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:16:45.152687 (+ 487us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:16:45.152835 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:45.152844 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:45.153905 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:45.153909 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:45.154774 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:45.154787 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:45.155592 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:45.155596 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:45.155705 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:45.156508 (+ 803us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:16:45.156528 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:16:45.158139 (+ 1611us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:16:45.160366 (+ 2227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:16:45.160376 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:16:45.160381 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:16:45.160669 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:16:45.160963 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:16:45.160966 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:16:45.160968 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:16:45.161062 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:16:45.161530 (+ 468us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:16:45.161536 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:16:45.161662 (+ 126us) client_negotiation.cc:769] Sending connection context
0923 17:16:45.161817 (+ 155us) client_negotiation.cc:240] Negotiation successful
0923 17:16:45.162009 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":91,"threads_started":1}
I20260923 17:16:45.162343 26706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:45.151052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51782 (local address 127.11.229.129:39103)
0923 17:16:45.151655 (+ 603us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:45.151668 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:45.151692 (+ 24us) server_negotiation.cc:407] Connection header received
0923 17:16:45.151771 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:45.151777 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:45.151987 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:45.152120 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:16:45.152966 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:45.153776 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:45.154920 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:45.155463 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:45.155595 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:45.158380 (+ 2785us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:16:45.158389 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:16:45.158400 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:16:45.158424 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:16:45.160224 (+ 1800us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:45.160785 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:45.160790 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:45.160791 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:45.160872 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:45.161151 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:45.161153 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:45.161155 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:45.161421 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:16:45.161530 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:45.161893 (+ 363us) server_negotiation.cc:299] Negotiation successful
0923 17:16:45.162035 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":512,"thread_start_us":84,"threads_started":1}
I20260923 17:16:45.163283 26632 tablet_service.cc:1514] Processing DeleteTablet for tablet e8c6a4a9d17443fbad9697092aadd07f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:16:44 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:51782
I20260923 17:16:45.164196 26707 tablet_replica.cc:330] stopping tablet replica
I20260923 17:16:45.164558 26707 raft_consensus.cc:2229] T e8c6a4a9d17443fbad9697092aadd07f P fac5855b35dd44b3b9af0f38d07b32e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:16:45.164844 26707 raft_consensus.cc:2258] T e8c6a4a9d17443fbad9697092aadd07f P fac5855b35dd44b3b9af0f38d07b32e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:16:45.165978 26707 ts_tablet_manager.cc:1905] T e8c6a4a9d17443fbad9697092aadd07f P fac5855b35dd44b3b9af0f38d07b32e1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:16:45.170513 26707 ts_tablet_manager.cc:1918] T e8c6a4a9d17443fbad9697092aadd07f P fac5855b35dd44b3b9af0f38d07b32e1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 17:16:45.170620 26707 log.cc:1196] T e8c6a4a9d17443fbad9697092aadd07f P fac5855b35dd44b3b9af0f38d07b32e1: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-0/wal/wals/e8c6a4a9d17443fbad9697092aadd07f
I20260923 17:16:45.170905 26707 ts_tablet_manager.cc:1939] T e8c6a4a9d17443fbad9697092aadd07f P fac5855b35dd44b3b9af0f38d07b32e1: Deleting consensus metadata
I20260923 17:16:45.172869 26497 catalog_manager.cc:4841] TS fac5855b35dd44b3b9af0f38d07b32e1 (127.11.229.129:39103): tablet e8c6a4a9d17443fbad9697092aadd07f (table test-table [id=211b5a81a4f74dbb978c5b32f15f049c]) successfully deleted
W20260923 17:16:45.248179 26702 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:16:45.248432 26702 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:16:45.248476 26702 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:16:45.252372 26702 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:16:45.252422 26702 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:16:45.252478 26702 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.130
I20260923 17:16:45.257723 26702 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:39033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab
--principal=kudu/127.11.229.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.130:42083
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.229.130
--webserver_port=39343
--tserver_master_addrs=127.11.229.190:44985
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26702
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.130
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:16:45.258703 26702 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:16:45.259629 26702 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:16:45.269273 26712 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:16:45.269471 26702 server_base.cc:1034] running on GCE node
W20260923 17:16:45.269366 26715 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:16:45.269659 26713 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:16:45.270067 26702 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:16:45.270761 26702 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:16:45.271975 26702 hybrid_clock.cc:648] HybridClock initialized: now 1790183805271954 us; error 30 us; skew 500 ppm
Sep 23 17:16:45 dist-test-slave-1x1f krb5kdc[25928](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183805, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:16:45.275048 26702 init.cc:377] Logged in from keytab as kudu/127.11.229.130@KRBTEST.COM (short username kudu)
I20260923 17:16:45.275985 26702 webserver.cc:460] Webserver started at http://127.11.229.130:39343/ using document root <none> and password file <none>
I20260923 17:16:45.276573 26702 fs_manager.cc:359] Metadata directory not provided
I20260923 17:16:45.276677 26702 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:16:45.280616 26702 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260923 17:16:45.282743 26722 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:16:45.283921 26702 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 17:16:45.284055 26702 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-1/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-1/wal
uuid: "1b7744d6de814dffa2521e7c0170c656"
format_stamp: "Formatted at 2026-09-23 17:16:44 on dist-test-slave-1x1f"
server_key: "419fed7dd5c02d5d67d4b2523eee8140"
server_key_iv: "13f92a5175ddadc1a384b6de6cc92b73"
server_key_version: "encryptionkey@0"
I20260923 17:16:45.284590 26702 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:16:45.294607 26702 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:16:45.297407 26702 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:16:45.297605 26702 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:16:45.298168 26702 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:16:45.298985 26702 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:16:45.299055 26702 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:16:45.299125 26702 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:16:45.299176 26702 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:16:45.309062 26702 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.130:42083
I20260923 17:16:45.309087 26835 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.130:42083 every 8 connection(s)
I20260923 17:16:45.310118 26702 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
I20260923 17:16:45.314863 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 26702
I20260923 17:16:45.315339 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.131:43643
--local_ip_for_outbound_sockets=127.11.229.131
--tserver_master_addrs=127.11.229.190:44985
--webserver_port=40717
--webserver_interface=127.11.229.131
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab
--principal=kudu/127.11.229.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:39033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 23 17:16:45 dist-test-slave-1x1f krb5kdc[25928](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183805, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.130@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:16:45.325603 26700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:45.311970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:38073 (local address 127.11.229.190:44985)
0923 17:16:45.312112 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:45.312116 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:45.312866 (+ 750us) server_negotiation.cc:407] Connection header received
0923 17:16:45.314259 (+ 1393us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:45.314263 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:45.314324 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:45.314456 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:16:45.316058 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:45.316675 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:45.317826 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:45.318292 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:45.318415 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:45.321274 (+ 2859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:16:45.321281 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:16:45.321286 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:16:45.321321 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:16:45.323246 (+ 1925us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:45.323791 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:45.323797 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:45.323801 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:45.323904 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:45.324265 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:45.324271 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:45.324275 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:45.324546 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:16:45.324654 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:45.325204 (+ 550us) server_negotiation.cc:299] Negotiation successful
0923 17:16:45.325371 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260923 17:16:45.326500 26838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:45.312291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.130:38073)
0923 17:16:45.312720 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:45.312760 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0923 17:16:45.314023 (+ 1263us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:16:45.314662 (+ 639us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:16:45.314671 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:16:45.315168 (+ 497us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:16:45.315878 (+ 710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:45.315900 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:45.316843 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:45.316846 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:45.317703 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:45.317712 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:45.318461 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:45.318463 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:45.318600 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:45.319301 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:16:45.319318 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:16:45.321084 (+ 1766us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:16:45.323382 (+ 2298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:16:45.323387 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:16:45.323400 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:16:45.323674 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:16:45.324018 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:16:45.324020 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:16:45.324022 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:16:45.324165 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:16:45.324674 (+ 509us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:16:45.324680 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:16:45.324952 (+ 272us) client_negotiation.cc:769] Sending connection context
0923 17:16:45.325121 (+ 169us) client_negotiation.cc:240] Negotiation successful
0923 17:16:45.325410 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":101,"threads_started":1}
I20260923 17:16:45.327793 26836 heartbeater.cc:347] Connected to a master server at 127.11.229.190:44985
I20260923 17:16:45.328043 26836 heartbeater.cc:464] Registering TS with master...
I20260923 17:16:45.328575 26836 heartbeater.cc:511] Master 127.11.229.190:44985 requested a full tablet report, sending...
I20260923 17:16:45.329802 26508 ts_manager.cc:194] Registered new tserver with Master: 1b7744d6de814dffa2521e7c0170c656 (127.11.229.130:42083)
I20260923 17:16:45.330466 26508 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.130@KRBTEST.COM'} at 127.11.229.130:38073
W20260923 17:16:45.427762 26839 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:16:45.428005 26839 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:16:45.428048 26839 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:16:45.432179 26839 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:16:45.432242 26839 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:16:45.432300 26839 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.131
I20260923 17:16:45.437472 26839 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:39033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab
--principal=kudu/127.11.229.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.131:43643
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.229.131
--webserver_port=40717
--tserver_master_addrs=127.11.229.190:44985
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26839
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.131
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:16:45.438524 26839 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:16:45.439527 26839 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:16:45.449870 26845 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:16:45.449859 26847 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:16:45.449999 26839 server_base.cc:1034] running on GCE node
W20260923 17:16:45.449862 26844 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:16:45.450726 26839 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:16:45.451469 26839 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:16:45.452705 26839 hybrid_clock.cc:648] HybridClock initialized: now 1790183805452686 us; error 34 us; skew 500 ppm
Sep 23 17:16:45 dist-test-slave-1x1f krb5kdc[25928](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183805, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:16:45.455631 26839 init.cc:377] Logged in from keytab as kudu/127.11.229.131@KRBTEST.COM (short username kudu)
I20260923 17:16:45.456463 26839 webserver.cc:460] Webserver started at http://127.11.229.131:40717/ using document root <none> and password file <none>
I20260923 17:16:45.457013 26839 fs_manager.cc:359] Metadata directory not provided
I20260923 17:16:45.457114 26839 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:16:45.461434 26839 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.000s
I20260923 17:16:45.463747 26854 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:16:45.465155 26839 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260923 17:16:45.465354 26839 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-2/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-2/wal
uuid: "af600c2890494e1ba21578ef6e073d26"
format_stamp: "Formatted at 2026-09-23 17:16:44 on dist-test-slave-1x1f"
server_key: "5b40d5891623d983d3d1a8b1ddcda782"
server_key_iv: "53e5897ec3995bd42bdb5ce45af11349"
server_key_version: "encryptionkey@0"
I20260923 17:16:45.465909 26839 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:16:45.488523 26839 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:16:45.491993 26839 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:16:45.492257 26839 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:16:45.492888 26839 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:16:45.493765 26839 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:16:45.493836 26839 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:16:45.493906 26839 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:16:45.493955 26839 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:16:45.503247 26839 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.131:43643
I20260923 17:16:45.503281 26967 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.131:43643 every 8 connection(s)
I20260923 17:16:45.504232 26839 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
I20260923 17:16:45.512732 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 26839
Sep 23 17:16:45 dist-test-slave-1x1f krb5kdc[25928](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183805, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.131@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:16:45.519173 26700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:45.506133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:41767 (local address 127.11.229.190:44985)
0923 17:16:45.506341 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:45.506346 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:45.507279 (+ 933us) server_negotiation.cc:407] Connection header received
0923 17:16:45.508661 (+ 1382us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:45.508664 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:45.508726 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:45.508806 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:16:45.510244 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:45.510774 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:45.511941 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:45.512159 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:45.512256 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:45.515228 (+ 2972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:16:45.515232 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:16:45.515234 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:16:45.515259 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:16:45.516686 (+ 1427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:45.517212 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:45.517216 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:45.517218 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:45.517306 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:45.517723 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:45.517729 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:45.517734 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:45.517907 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:16:45.517984 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:45.518825 (+ 841us) server_negotiation.cc:299] Negotiation successful
0923 17:16:45.518953 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260923 17:16:45.519870 26970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:45.506597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.131:41767)
0923 17:16:45.507104 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:45.507160 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0923 17:16:45.508437 (+ 1277us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:16:45.508977 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:16:45.508983 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:16:45.509575 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:16:45.510069 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:45.510082 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:45.510892 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:45.510895 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:45.511821 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:45.511830 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:45.512348 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:45.512351 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:45.512568 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:45.513208 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:16:45.513231 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:16:45.515072 (+ 1841us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:16:45.516803 (+ 1731us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:16:45.516811 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:16:45.516829 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:16:45.517084 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:16:45.517404 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:16:45.517409 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:16:45.517411 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:16:45.517580 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:16:45.518020 (+ 440us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:16:45.518029 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:16:45.518412 (+ 383us) client_negotiation.cc:769] Sending connection context
0923 17:16:45.518638 (+ 226us) client_negotiation.cc:240] Negotiation successful
0923 17:16:45.518919 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":119,"threads_started":1}
I20260923 17:16:45.521088 26968 heartbeater.cc:347] Connected to a master server at 127.11.229.190:44985
I20260923 17:16:45.521346 26968 heartbeater.cc:464] Registering TS with master...
I20260923 17:16:45.521914 26968 heartbeater.cc:511] Master 127.11.229.190:44985 requested a full tablet report, sending...
I20260923 17:16:45.522548 26972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:45.513490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58656 (local address 127.11.229.190:44985)
0923 17:16:45.513767 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:45.513772 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:45.513887 (+ 115us) server_negotiation.cc:407] Connection header received
0923 17:16:45.514051 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:45.514054 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:45.514096 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:45.514170 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:16:45.515086 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:45.515867 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:45.516855 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:45.517071 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:45.517143 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:45.518819 (+ 1676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:16:45.518844 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:16:45.518846 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:16:45.518866 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:16:45.520748 (+ 1882us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:45.521245 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:45.521250 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:45.521254 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:45.521357 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:45.521703 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:45.521705 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:45.521706 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:45.521880 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:16:45.522054 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:45.522299 (+ 245us) server_negotiation.cc:299] Negotiation successful
0923 17:16:45.522397 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":212,"spinlock_wait_cycles":4864,"thread_start_us":99,"threads_started":1}
I20260923 17:16:45.523202 26508 ts_manager.cc:194] Registered new tserver with Master: af600c2890494e1ba21578ef6e073d26 (127.11.229.131:43643)
I20260923 17:16:45.523998 26508 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.131@KRBTEST.COM'} at 127.11.229.131:41767
I20260923 17:16:45.524746 12182 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 17:16:45.531560 26972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:45.525383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58664 (local address 127.11.229.190:44985)
0923 17:16:45.525500 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:45.525504 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:45.525678 (+ 174us) server_negotiation.cc:407] Connection header received
0923 17:16:45.525865 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:45.525867 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:45.525943 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:45.526050 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 17:16:45.526411 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:45.527286 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:45.528894 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:45.529323 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:45.529442 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:45.529843 (+ 401us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 17:16:45.530307 (+ 464us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 17:16:45.530439 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:45.531366 (+ 927us) server_negotiation.cc:299] Negotiation successful
0923 17:16:45.531436 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260923 17:16:45.532354 26510 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:58664:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 17:16:45.536993 26510 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 17:16:45.545706 26632 tablet_service.cc:1467] Processing CreateTablet for tablet 4d1e0f3d1d7a4b2d94ece9b934a5e195 (DEFAULT_TABLE table=test-table [id=d4db56f65a514e0b8ee89d3b259bb258]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:16:45.546404 26632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d1e0f3d1d7a4b2d94ece9b934a5e195. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:16:45.549407 26590 tablet_bootstrap.cc:492] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1: Bootstrap starting.
I20260923 17:16:45.550414 26590 tablet_bootstrap.cc:654] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1: Neither blocks nor log segments found. Creating new log.
I20260923 17:16:45.550516 26705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:45.544348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.130:42083 (local address 127.0.0.1:57456)
0923 17:16:45.544466 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:45.544485 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0923 17:16:45.544570 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:16:45.545649 (+ 1079us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:16:45.545652 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:16:45.545673 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:16:45.545809 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:45.545818 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:45.547422 (+ 1604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:45.547429 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:45.548658 (+ 1229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:45.548669 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:45.550018 (+ 1349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:45.550024 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:45.550133 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:45.550189 (+ 56us) client_negotiation.cc:769] Sending connection context
0923 17:16:45.550306 (+ 117us) client_negotiation.cc:240] Negotiation successful
0923 17:16:45.550386 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260923 17:16:45.550550 26978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:45.544631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.131:43643 (local address 127.0.0.1:48688)
0923 17:16:45.544883 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:45.544897 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 17:16:45.544991 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:16:45.546189 (+ 1198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:16:45.546193 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:16:45.546210 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:16:45.546341 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:45.546348 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:45.547962 (+ 1614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:45.547966 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:45.549177 (+ 1211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:45.549187 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:45.550189 (+ 1002us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:45.550192 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:45.550337 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:45.550356 (+ 19us) client_negotiation.cc:769] Sending connection context
0923 17:16:45.550399 (+ 43us) client_negotiation.cc:240] Negotiation successful
0923 17:16:45.550449 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":127,"threads_started":1}
I20260923 17:16:45.550642 26977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:45.544547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57456 (local address 127.11.229.130:42083)
0923 17:16:45.544945 (+ 398us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:45.544959 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:45.544987 (+ 28us) server_negotiation.cc:407] Connection header received
0923 17:16:45.545076 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:45.545085 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:45.545436 (+ 351us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:45.545665 (+ 229us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:16:45.546132 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:45.547272 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:45.548836 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:45.549884 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:45.550026 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:45.550178 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:45.550343 (+ 165us) server_negotiation.cc:299] Negotiation successful
0923 17:16:45.550470 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":285,"thread_start_us":194,"threads_started":1}
I20260923 17:16:45.551095 26979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:45.545244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48688 (local address 127.11.229.131:43643)
0923 17:16:45.545609 (+ 365us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:45.545625 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:45.545647 (+ 22us) server_negotiation.cc:407] Connection header received
0923 17:16:45.545717 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:45.545723 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:45.545906 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:45.546488 (+ 582us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:16:45.546750 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:45.547798 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:45.549472 (+ 1674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:45.550061 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:45.550691 (+ 630us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:45.550832 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:45.550876 (+ 44us) server_negotiation.cc:299] Negotiation successful
0923 17:16:45.550956 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":265,"thread_start_us":159,"threads_started":1}
I20260923 17:16:45.552649 26590 tablet_bootstrap.cc:492] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1: No bootstrap required, opened a new log
I20260923 17:16:45.552745 26590 ts_tablet_manager.cc:1397] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260923 17:16:45.553126 26590 raft_consensus.cc:348] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b7744d6de814dffa2521e7c0170c656" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42083 } } peers { permanent_uuid: "af600c2890494e1ba21578ef6e073d26" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 43643 } } peers { permanent_uuid: "fac5855b35dd44b3b9af0f38d07b32e1" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 39103 } }
I20260923 17:16:45.553225 26590 raft_consensus.cc:374] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:16:45.553253 26590 raft_consensus.cc:729] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac5855b35dd44b3b9af0f38d07b32e1, State: Initialized, Role: FOLLOWER
I20260923 17:16:45.553401 26590 consensus_queue.cc:260] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b7744d6de814dffa2521e7c0170c656" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42083 } } peers { permanent_uuid: "af600c2890494e1ba21578ef6e073d26" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 43643 } } peers { permanent_uuid: "fac5855b35dd44b3b9af0f38d07b32e1" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 39103 } }
I20260923 17:16:45.553681 26590 ts_tablet_manager.cc:1428] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260923 17:16:45.554118 26902 tablet_service.cc:1467] Processing CreateTablet for tablet 4d1e0f3d1d7a4b2d94ece9b934a5e195 (DEFAULT_TABLE table=test-table [id=d4db56f65a514e0b8ee89d3b259bb258]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:16:45.555370 26902 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d1e0f3d1d7a4b2d94ece9b934a5e195. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:16:45.559947 26770 tablet_service.cc:1467] Processing CreateTablet for tablet 4d1e0f3d1d7a4b2d94ece9b934a5e195 (DEFAULT_TABLE table=test-table [id=d4db56f65a514e0b8ee89d3b259bb258]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:16:45.561003 26770 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d1e0f3d1d7a4b2d94ece9b934a5e195. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:16:45.562692 26981 tablet_bootstrap.cc:492] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P af600c2890494e1ba21578ef6e073d26: Bootstrap starting.
I20260923 17:16:45.565169 26981 tablet_bootstrap.cc:654] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P af600c2890494e1ba21578ef6e073d26: Neither blocks nor log segments found. Creating new log.
I20260923 17:16:45.565932 26981 log.cc:824] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P af600c2890494e1ba21578ef6e073d26: Log is configured to *not* fsync() on all Append() calls
I20260923 17:16:45.567449 26983 tablet_bootstrap.cc:492] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P 1b7744d6de814dffa2521e7c0170c656: Bootstrap starting.
I20260923 17:16:45.568085 26981 tablet_bootstrap.cc:492] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P af600c2890494e1ba21578ef6e073d26: No bootstrap required, opened a new log
I20260923 17:16:45.568308 26981 ts_tablet_manager.cc:1397] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P af600c2890494e1ba21578ef6e073d26: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260923 17:16:45.569819 26983 tablet_bootstrap.cc:654] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P 1b7744d6de814dffa2521e7c0170c656: Neither blocks nor log segments found. Creating new log.
I20260923 17:16:45.570631 26983 log.cc:824] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P 1b7744d6de814dffa2521e7c0170c656: Log is configured to *not* fsync() on all Append() calls
I20260923 17:16:45.571954 26981 raft_consensus.cc:348] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P af600c2890494e1ba21578ef6e073d26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b7744d6de814dffa2521e7c0170c656" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42083 } } peers { permanent_uuid: "af600c2890494e1ba21578ef6e073d26" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 43643 } } peers { permanent_uuid: "fac5855b35dd44b3b9af0f38d07b32e1" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 39103 } }
I20260923 17:16:45.572206 26981 raft_consensus.cc:374] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P af600c2890494e1ba21578ef6e073d26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:16:45.572293 26981 raft_consensus.cc:729] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P af600c2890494e1ba21578ef6e073d26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af600c2890494e1ba21578ef6e073d26, State: Initialized, Role: FOLLOWER
I20260923 17:16:45.572329 26983 tablet_bootstrap.cc:492] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P 1b7744d6de814dffa2521e7c0170c656: No bootstrap required, opened a new log
I20260923 17:16:45.572515 26983 ts_tablet_manager.cc:1397] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P 1b7744d6de814dffa2521e7c0170c656: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260923 17:16:45.572784 26981 consensus_queue.cc:260] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P af600c2890494e1ba21578ef6e073d26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b7744d6de814dffa2521e7c0170c656" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42083 } } peers { permanent_uuid: "af600c2890494e1ba21578ef6e073d26" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 43643 } } peers { permanent_uuid: "fac5855b35dd44b3b9af0f38d07b32e1" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 39103 } }
I20260923 17:16:45.573601 26968 heartbeater.cc:503] Master 127.11.229.190:44985 was elected leader, sending a full tablet report...
I20260923 17:16:45.573891 26981 ts_tablet_manager.cc:1428] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P af600c2890494e1ba21578ef6e073d26: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20260923 17:16:45.576789 26983 raft_consensus.cc:348] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P 1b7744d6de814dffa2521e7c0170c656 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b7744d6de814dffa2521e7c0170c656" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42083 } } peers { permanent_uuid: "af600c2890494e1ba21578ef6e073d26" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 43643 } } peers { permanent_uuid: "fac5855b35dd44b3b9af0f38d07b32e1" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 39103 } }
I20260923 17:16:45.577085 26983 raft_consensus.cc:374] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P 1b7744d6de814dffa2521e7c0170c656 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:16:45.577145 26983 raft_consensus.cc:729] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P 1b7744d6de814dffa2521e7c0170c656 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b7744d6de814dffa2521e7c0170c656, State: Initialized, Role: FOLLOWER
I20260923 17:16:45.577545 26983 consensus_queue.cc:260] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P 1b7744d6de814dffa2521e7c0170c656 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b7744d6de814dffa2521e7c0170c656" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42083 } } peers { permanent_uuid: "af600c2890494e1ba21578ef6e073d26" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 43643 } } peers { permanent_uuid: "fac5855b35dd44b3b9af0f38d07b32e1" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 39103 } }
I20260923 17:16:45.578353 26836 heartbeater.cc:503] Master 127.11.229.190:44985 was elected leader, sending a full tablet report...
I20260923 17:16:45.578418 26983 ts_tablet_manager.cc:1428] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P 1b7744d6de814dffa2521e7c0170c656: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260923 17:16:45.583328 26985 raft_consensus.cc:482] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P af600c2890494e1ba21578ef6e073d26 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 17:16:45.583465 26985 raft_consensus.cc:504] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P af600c2890494e1ba21578ef6e073d26 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b7744d6de814dffa2521e7c0170c656" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42083 } } peers { permanent_uuid: "af600c2890494e1ba21578ef6e073d26" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 43643 } } peers { permanent_uuid: "fac5855b35dd44b3b9af0f38d07b32e1" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 39103 } }
I20260923 17:16:45.584434 26985 leader_election.cc:288] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P af600c2890494e1ba21578ef6e073d26 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b7744d6de814dffa2521e7c0170c656 (127.11.229.130:42083), fac5855b35dd44b3b9af0f38d07b32e1 (127.11.229.129:39103)
I20260923 17:16:45.588400 26977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:45.584842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:44453 (local address 127.11.229.130:42083)
0923 17:16:45.585001 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:45.585006 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:45.585019 (+ 13us) server_negotiation.cc:407] Connection header received
0923 17:16:45.585066 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:45.585069 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:45.585107 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:45.585183 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:16:45.585532 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:45.586081 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:45.587265 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:45.587765 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:45.587899 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:45.587960 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:45.588201 (+ 241us) server_negotiation.cc:299] Negotiation successful
0923 17:16:45.588275 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260923 17:16:45.588400 26970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:45.584646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.130:42083 (local address 127.11.229.131:44453)
0923 17:16:45.584789 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:45.584807 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 17:16:45.584902 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:16:45.585265 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:16:45.585267 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:16:45.585287 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:16:45.585414 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:45.585419 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:45.586207 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:45.586213 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:45.587100 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:45.587110 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:45.587899 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:45.587903 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:45.588030 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:45.588049 (+ 19us) client_negotiation.cc:769] Sending connection context
0923 17:16:45.588184 (+ 135us) client_negotiation.cc:240] Negotiation successful
0923 17:16:45.588264 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55,"spinlock_wait_cycles":9472}
I20260923 17:16:45.588541 26706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:45.584816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:47289 (local address 127.11.229.129:39103)
0923 17:16:45.584995 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:45.585002 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:45.585278 (+ 276us) server_negotiation.cc:407] Connection header received
0923 17:16:45.585419 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:45.585422 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:45.585480 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:45.585578 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:16:45.585828 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:45.586443 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:45.587448 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:45.587997 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:45.588103 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:45.588243 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:45.588352 (+ 109us) server_negotiation.cc:299] Negotiation successful
0923 17:16:45.588418 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260923 17:16:45.588868 26987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:45.584646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:39103 (local address 127.11.229.131:47289)
0923 17:16:45.585180 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:45.585191 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0923 17:16:45.585318 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:16:45.585586 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:16:45.585589 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:16:45.585604 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:16:45.585717 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:45.585728 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:45.586547 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:45.586552 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:45.587328 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:45.587337 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:45.588103 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:45.588106 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:45.588225 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:45.588257 (+ 32us) client_negotiation.cc:769] Sending connection context
0923 17:16:45.588337 (+ 80us) client_negotiation.cc:240] Negotiation successful
0923 17:16:45.588404 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":478,"mutex_wait_us":255,"thread_start_us":102,"threads_started":1}
I20260923 17:16:45.589195 26790 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d1e0f3d1d7a4b2d94ece9b934a5e195" candidate_uuid: "af600c2890494e1ba21578ef6e073d26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b7744d6de814dffa2521e7c0170c656" is_pre_election: true
I20260923 17:16:45.589393 26652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d1e0f3d1d7a4b2d94ece9b934a5e195" candidate_uuid: "af600c2890494e1ba21578ef6e073d26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac5855b35dd44b3b9af0f38d07b32e1" is_pre_election: true
I20260923 17:16:45.589516 26790 raft_consensus.cc:2454] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P 1b7744d6de814dffa2521e7c0170c656 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af600c2890494e1ba21578ef6e073d26 in term 0.
I20260923 17:16:45.589668 26652 raft_consensus.cc:2454] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate af600c2890494e1ba21578ef6e073d26 in term 0.
I20260923 17:16:45.590046 26857 leader_election.cc:302] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P af600c2890494e1ba21578ef6e073d26 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 1b7744d6de814dffa2521e7c0170c656, af600c2890494e1ba21578ef6e073d26, fac5855b35dd44b3b9af0f38d07b32e1; no voters:
I20260923 17:16:45.590389 26985 raft_consensus.cc:2781] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P af600c2890494e1ba21578ef6e073d26 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 17:16:45.590466 26985 raft_consensus.cc:482] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P af600c2890494e1ba21578ef6e073d26 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 17:16:45.590500 26985 raft_consensus.cc:3037] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P af600c2890494e1ba21578ef6e073d26 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:16:45.591593 26985 raft_consensus.cc:504] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P af600c2890494e1ba21578ef6e073d26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b7744d6de814dffa2521e7c0170c656" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42083 } } peers { permanent_uuid: "af600c2890494e1ba21578ef6e073d26" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 43643 } } peers { permanent_uuid: "fac5855b35dd44b3b9af0f38d07b32e1" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 39103 } }
I20260923 17:16:45.592005 26985 leader_election.cc:288] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P af600c2890494e1ba21578ef6e073d26 [CANDIDATE]: Term 1 election: Requested vote from peers 1b7744d6de814dffa2521e7c0170c656 (127.11.229.130:42083), fac5855b35dd44b3b9af0f38d07b32e1 (127.11.229.129:39103)
I20260923 17:16:45.592396 26790 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d1e0f3d1d7a4b2d94ece9b934a5e195" candidate_uuid: "af600c2890494e1ba21578ef6e073d26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b7744d6de814dffa2521e7c0170c656"
I20260923 17:16:45.592393 26652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d1e0f3d1d7a4b2d94ece9b934a5e195" candidate_uuid: "af600c2890494e1ba21578ef6e073d26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fac5855b35dd44b3b9af0f38d07b32e1"
I20260923 17:16:45.592509 26652 raft_consensus.cc:3037] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:16:45.592535 26790 raft_consensus.cc:3037] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P 1b7744d6de814dffa2521e7c0170c656 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:16:45.593528 26790 raft_consensus.cc:2454] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P 1b7744d6de814dffa2521e7c0170c656 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af600c2890494e1ba21578ef6e073d26 in term 1.
I20260923 17:16:45.593616 26652 raft_consensus.cc:2454] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate af600c2890494e1ba21578ef6e073d26 in term 1.
I20260923 17:16:45.593792 26857 leader_election.cc:302] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P af600c2890494e1ba21578ef6e073d26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b7744d6de814dffa2521e7c0170c656, af600c2890494e1ba21578ef6e073d26; no voters:
I20260923 17:16:45.593951 26985 raft_consensus.cc:2781] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P af600c2890494e1ba21578ef6e073d26 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:16:45.594192 26985 raft_consensus.cc:686] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P af600c2890494e1ba21578ef6e073d26 [term 1 LEADER]: Becoming Leader. State: Replica: af600c2890494e1ba21578ef6e073d26, State: Running, Role: LEADER
I20260923 17:16:45.594570 26985 consensus_queue.cc:237] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P af600c2890494e1ba21578ef6e073d26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b7744d6de814dffa2521e7c0170c656" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42083 } } peers { permanent_uuid: "af600c2890494e1ba21578ef6e073d26" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 43643 } } peers { permanent_uuid: "fac5855b35dd44b3b9af0f38d07b32e1" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 39103 } }
I20260923 17:16:45.597575 26510 catalog_manager.cc:5495] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P af600c2890494e1ba21578ef6e073d26 reported cstate change: term changed from 0 to 1, leader changed from <none> to af600c2890494e1ba21578ef6e073d26 (127.11.229.131). New cstate: current_term: 1 leader_uuid: "af600c2890494e1ba21578ef6e073d26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b7744d6de814dffa2521e7c0170c656" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af600c2890494e1ba21578ef6e073d26" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 43643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fac5855b35dd44b3b9af0f38d07b32e1" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 39103 } health_report { overall_health: UNKNOWN } } }
I20260923 17:16:45.615862 26979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:45.612014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48694 (local address 127.11.229.131:43643)
0923 17:16:45.612203 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:45.612208 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:45.612226 (+ 18us) server_negotiation.cc:407] Connection header received
0923 17:16:45.612322 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:45.612325 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:45.612378 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:45.612496 (+ 118us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 17:16:45.612768 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:45.613385 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:45.614362 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:45.614590 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:45.614714 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:45.615042 (+ 328us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 17:16:45.615457 (+ 415us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 17:16:45.615597 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:45.615646 (+ 49us) server_negotiation.cc:299] Negotiation successful
0923 17:16:45.615705 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260923 17:16:45.621768 26652 raft_consensus.cc:1261] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [term 1 FOLLOWER]: Refusing update from remote peer af600c2890494e1ba21578ef6e073d26: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:16:45.621773 26790 raft_consensus.cc:1261] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P 1b7744d6de814dffa2521e7c0170c656 [term 1 FOLLOWER]: Refusing update from remote peer af600c2890494e1ba21578ef6e073d26: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:16:45.622463 26988 consensus_queue.cc:1035] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P af600c2890494e1ba21578ef6e073d26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fac5855b35dd44b3b9af0f38d07b32e1" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 39103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:16:45.622663 26985 consensus_queue.cc:1035] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P af600c2890494e1ba21578ef6e073d26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b7744d6de814dffa2521e7c0170c656" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260923 17:16:45.622777 26699 tablet.cc:2369] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 17:16:45.630081 26993 mvcc.cc:205] Tried to move back new op lower bound from 7332592867819982848 to 7332592867718180864. Current Snapshot: MvccSnapshot[applied={T|T < 7332592867819982848}]
I20260923 17:16:45.631151 26991 mvcc.cc:205] Tried to move back new op lower bound from 7332592867819982848 to 7332592867718180864. Current Snapshot: MvccSnapshot[applied={T|T < 7332592867819982848 or (T in {7332592867819982848})}]
I20260923 17:16:45.638473 26508 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:58664:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:16:45.638645 26508 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:58664:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:16:45.640965 26508 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1: Sending DeleteTablet for 3 replicas of tablet 4d1e0f3d1d7a4b2d94ece9b934a5e195
I20260923 17:16:45.641616 26632 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d1e0f3d1d7a4b2d94ece9b934a5e195 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:16:45 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:51782
I20260923 17:16:45.641682 26902 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d1e0f3d1d7a4b2d94ece9b934a5e195 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:16:45 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:48688
I20260923 17:16:45.641721 26770 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d1e0f3d1d7a4b2d94ece9b934a5e195 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:16:45 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:57456
I20260923 17:16:45.641801 26707 tablet_replica.cc:330] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1: stopping tablet replica
I20260923 17:16:45.641952 26707 raft_consensus.cc:2229] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:16:45.642100 26707 raft_consensus.cc:2258] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:16:45.642256 27001 tablet_replica.cc:330] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P 1b7744d6de814dffa2521e7c0170c656: stopping tablet replica
I20260923 17:16:45.642270 27000 tablet_replica.cc:330] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P af600c2890494e1ba21578ef6e073d26: stopping tablet replica
I20260923 17:16:45.642645 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 26548
I20260923 17:16:45.642974 26707 ts_tablet_manager.cc:1905] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:16:45.643440 27000 raft_consensus.cc:2229] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P af600c2890494e1ba21578ef6e073d26 [term 1 LEADER]: Raft consensus shutting down.
I20260923 17:16:45.643847 27000 raft_consensus.cc:2258] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P af600c2890494e1ba21578ef6e073d26 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:16:45.642704 27001 raft_consensus.cc:2229] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P 1b7744d6de814dffa2521e7c0170c656 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:16:45.644404 27001 raft_consensus.cc:2258] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P 1b7744d6de814dffa2521e7c0170c656 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:16:45.645174 27000 ts_tablet_manager.cc:1905] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P af600c2890494e1ba21578ef6e073d26: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:16:45.647367 27001 ts_tablet_manager.cc:1905] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P 1b7744d6de814dffa2521e7c0170c656: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:16:45.648783 27000 ts_tablet_manager.cc:1918] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P af600c2890494e1ba21578ef6e073d26: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 17:16:45.648911 27000 log.cc:1196] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P af600c2890494e1ba21578ef6e073d26: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-2/wal/wals/4d1e0f3d1d7a4b2d94ece9b934a5e195
I20260923 17:16:45.649394 27000 ts_tablet_manager.cc:1939] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P af600c2890494e1ba21578ef6e073d26: Deleting consensus metadata
I20260923 17:16:45.650331 27001 ts_tablet_manager.cc:1918] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P 1b7744d6de814dffa2521e7c0170c656: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260923 17:16:45.650311 26497 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.229.129:39103 (error 108)
I20260923 17:16:45.650465 27001 log.cc:1196] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P 1b7744d6de814dffa2521e7c0170c656: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-1/wal/wals/4d1e0f3d1d7a4b2d94ece9b934a5e195
I20260923 17:16:45.650650 26496 catalog_manager.cc:4841] TS af600c2890494e1ba21578ef6e073d26 (127.11.229.131:43643): tablet 4d1e0f3d1d7a4b2d94ece9b934a5e195 (table test-table [id=d4db56f65a514e0b8ee89d3b259bb258]) successfully deleted
I20260923 17:16:45.650882 27001 ts_tablet_manager.cc:1939] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P 1b7744d6de814dffa2521e7c0170c656: Deleting consensus metadata
I20260923 17:16:45.651165 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 26702
I20260923 17:16:45.655615 26978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:45.655258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:39103 (local address 127.0.0.1:51798)
0923 17:16:45.655426 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:45.655510 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.129:39103: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260923 17:16:45.655797 26497 catalog_manager.cc:4584] TS fac5855b35dd44b3b9af0f38d07b32e1 (127.11.229.129:39103): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4d1e0f3d1d7a4b2d94ece9b934a5e195: Network error: Client connection negotiation failed: client connection to 127.11.229.129:39103: connect: Connection refused (error 111)
I20260923 17:16:45.657836 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 26839
I20260923 17:16:45.658991 26978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:45.658055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.130:42083 (local address 127.0.0.1:57462)
0923 17:16:45.658834 (+ 779us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:45.658899 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.130:42083: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":686}
I20260923 17:16:45.664036 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 26477
I20260923 17:16:45.670516 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:44985
--webserver_interface=127.11.229.190
--webserver_port=39449
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:39033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:44985
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:16:45.779274 27003 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:16:45.779561 27003 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:16:45.779637 27003 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:16:45.783746 27003 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:16:45.783823 27003 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:16:45.783860 27003 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:16:45.783912 27003 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:16:45.783949 27003 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:16:45.789435 27003 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:39033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:44985
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:44985
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.229.190
--webserver_port=39449
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27003
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:16:45.790633 27003 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:16:45.791594 27003 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:16:45.800446 27008 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:16:45.800446 27009 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:16:45.800570 27011 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:16:45.800762 27003 server_base.cc:1034] running on GCE node
I20260923 17:16:45.801424 27003 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:16:45.802532 27003 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:16:45.803692 27003 hybrid_clock.cc:648] HybridClock initialized: now 1790183805803678 us; error 25 us; skew 500 ppm
Sep 23 17:16:45 dist-test-slave-1x1f krb5kdc[25928](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183805, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:16:45.806531 27003 init.cc:377] Logged in from keytab as kudu/127.11.229.190@KRBTEST.COM (short username kudu)
I20260923 17:16:45.807421 27003 webserver.cc:460] Webserver started at http://127.11.229.190:39449/ using document root <none> and password file <none>
I20260923 17:16:45.807953 27003 fs_manager.cc:359] Metadata directory not provided
I20260923 17:16:45.808013 27003 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:16:45.811707 27003 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.003s
I20260923 17:16:45.813750 27018 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:16:45.814985 27003 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260923 17:16:45.815116 27003 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "ab93d0e00d144467a0c5ee3c286f80b1"
format_stamp: "Formatted at 2026-09-23 17:16:43 on dist-test-slave-1x1f"
server_key: "fbd50d0c43c20dd33c5b55f2f22e0201"
server_key_iv: "41319671b87fbffc5f5ee6444b69e44b"
server_key_version: "encryptionkey@0"
I20260923 17:16:45.815640 27003 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:16:45.831982 27003 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:16:45.835052 27003 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:16:45.835238 27003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:16:45.842468 27003 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.190:44985
I20260923 17:16:45.842744 27070 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.190:44985 every 8 connection(s)
I20260923 17:16:45.843605 27003 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:16:45.846563 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 27003
I20260923 17:16:45.847003 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.129:39103
--local_ip_for_outbound_sockets=127.11.229.129
--tserver_master_addrs=127.11.229.190:44985
--webserver_port=45423
--webserver_interface=127.11.229.129
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab
--principal=kudu/127.11.229.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:39033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 17:16:45.847937 27071 sys_catalog.cc:263] Verifying existing consensus state
I20260923 17:16:45.849560 27071 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1: Bootstrap starting.
I20260923 17:16:45.866572 27071 log.cc:824] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1: Log is configured to *not* fsync() on all Append() calls
I20260923 17:16:45.877938 27071 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260923 17:16:45.878374 27071 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1: Bootstrap complete.
I20260923 17:16:45.882616 27071 raft_consensus.cc:348] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab93d0e00d144467a0c5ee3c286f80b1" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 44985 } }
I20260923 17:16:45.883037 27071 raft_consensus.cc:729] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab93d0e00d144467a0c5ee3c286f80b1, State: Initialized, Role: FOLLOWER
I20260923 17:16:45.883513 27071 consensus_queue.cc:260] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab93d0e00d144467a0c5ee3c286f80b1" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 44985 } }
I20260923 17:16:45.883651 27071 raft_consensus.cc:388] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:16:45.883738 27071 raft_consensus.cc:482] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:16:45.883859 27071 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [term 2 FOLLOWER]: Advancing to term 3
I20260923 17:16:45.885712 27071 raft_consensus.cc:504] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab93d0e00d144467a0c5ee3c286f80b1" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 44985 } }
I20260923 17:16:45.886050 27071 leader_election.cc:302] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ab93d0e00d144467a0c5ee3c286f80b1; no voters:
I20260923 17:16:45.886436 27071 leader_election.cc:288] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260923 17:16:45.886528 27075 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [term 3 FOLLOWER]: Leader election won for term 3
I20260923 17:16:45.886721 27075 raft_consensus.cc:686] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [term 3 LEADER]: Becoming Leader. State: Replica: ab93d0e00d144467a0c5ee3c286f80b1, State: Running, Role: LEADER
I20260923 17:16:45.887002 27075 consensus_queue.cc:237] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab93d0e00d144467a0c5ee3c286f80b1" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 44985 } }
I20260923 17:16:45.887706 27071 sys_catalog.cc:564] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:16:45.887956 27075 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ab93d0e00d144467a0c5ee3c286f80b1. Latest consensus state: current_term: 3 leader_uuid: "ab93d0e00d144467a0c5ee3c286f80b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab93d0e00d144467a0c5ee3c286f80b1" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 44985 } } }
I20260923 17:16:45.888070 27075 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [sys.catalog]: This master's current role is: LEADER
I20260923 17:16:45.888425 27079 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:16:45.888454 27076 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "ab93d0e00d144467a0c5ee3c286f80b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab93d0e00d144467a0c5ee3c286f80b1" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 44985 } } }
I20260923 17:16:45.888702 27076 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab93d0e00d144467a0c5ee3c286f80b1 [sys.catalog]: This master's current role is: LEADER
I20260923 17:16:45.893527 27079 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:16:45.894134 27079 catalog_manager.cc:1259] Loaded cluster ID: d6cf14f0b7564da3b21d8e1932380485
I20260923 17:16:45.894205 27079 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260923 17:16:45.895260 27079 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f64924d99ad google::LogMessage::Fail() at ??:0
@ 0x7f64924dc88a google::LogMessage::SendToLog() at ??:0
@ 0x7f64924d94de google::LogMessage::Flush() at ??:0
@ 0x7f64924daa19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f649ce18fdd _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f649ce19d2f kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f649ce16579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f649ce5a640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f649472b3d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f649472bc83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f649472d3f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f649471c512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f6495d606db start_thread at ??:0
@ 0x7f6490fd761f clone at ??:0
W20260923 17:16:45.980144 27073 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:16:45.980513 27073 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:16:45.980578 27073 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:16:45.986804 27073 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:16:45.986886 27073 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:16:45.986972 27073 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.129
I20260923 17:16:45.995049 27073 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:39033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab
--principal=kudu/127.11.229.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.129:39103
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.229.129
--webserver_port=45423
--tserver_master_addrs=127.11.229.190:44985
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27073
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.129
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:16:45.996495 27073 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:16:45.997797 27073 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:16:46.010336 27115 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:16:46.010329 27112 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:16:46.010305 27113 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:16:46.010807 27073 server_base.cc:1034] running on GCE node
I20260923 17:16:46.011348 27073 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:16:46.012086 27073 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:16:46.013278 27073 hybrid_clock.cc:648] HybridClock initialized: now 1790183806013254 us; error 34 us; skew 500 ppm
Sep 23 17:16:46 dist-test-slave-1x1f krb5kdc[25928](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183806, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:16:46.016692 27073 init.cc:377] Logged in from keytab as kudu/127.11.229.129@KRBTEST.COM (short username kudu)
I20260923 17:16:46.017755 27073 webserver.cc:460] Webserver started at http://127.11.229.129:45423/ using document root <none> and password file <none>
I20260923 17:16:46.018510 27073 fs_manager.cc:359] Metadata directory not provided
I20260923 17:16:46.018599 27073 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:16:46.023653 27073 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260923 17:16:46.026024 27122 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:16:46.027384 27073 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 17:16:46.027529 27073 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-0/wal
uuid: "fac5855b35dd44b3b9af0f38d07b32e1"
format_stamp: "Formatted at 2026-09-23 17:16:44 on dist-test-slave-1x1f"
server_key: "1839442265d0db8db9d824783136cf39"
server_key_iv: "d4a3d0b00bc5b2df48717caa0c2ee85d"
server_key_version: "encryptionkey@0"
I20260923 17:16:46.028074 27073 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:16:46.059511 27073 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:16:46.063143 27073 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:16:46.063396 27073 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:16:46.064078 27073 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:16:46.065250 27129 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260923 17:16:46.070678 27073 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260923 17:16:46.070786 27073 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.000s
I20260923 17:16:46.070887 27073 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260923 17:16:46.072625 27073 ts_tablet_manager.cc:610] Registered 1 tablets
I20260923 17:16:46.072705 27073 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260923 17:16:46.072983 27129 tablet_bootstrap.cc:492] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1: Bootstrap starting.
I20260923 17:16:46.079662 27129 log.cc:824] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1: Log is configured to *not* fsync() on all Append() calls
I20260923 17:16:46.083398 27073 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.129:39103
I20260923 17:16:46.084280 27073 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
I20260923 17:16:46.085433 27237 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.129:39103 every 8 connection(s)
I20260923 17:16:46.089016 27129 tablet_bootstrap.cc:492] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260923 17:16:46.089483 27129 tablet_bootstrap.cc:492] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1: Bootstrap complete.
I20260923 17:16:46.089831 27129 ts_tablet_manager.cc:1397] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1: Time spent bootstrapping tablet: real 0.017s user 0.012s sys 0.000s
I20260923 17:16:46.092916 27129 raft_consensus.cc:348] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b7744d6de814dffa2521e7c0170c656" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42083 } } peers { permanent_uuid: "af600c2890494e1ba21578ef6e073d26" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 43643 } } peers { permanent_uuid: "fac5855b35dd44b3b9af0f38d07b32e1" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 39103 } }
I20260923 17:16:46.093519 27129 raft_consensus.cc:729] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fac5855b35dd44b3b9af0f38d07b32e1, State: Initialized, Role: FOLLOWER
I20260923 17:16:46.094030 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 27073
I20260923 17:16:46.094003 27129 consensus_queue.cc:260] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b7744d6de814dffa2521e7c0170c656" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42083 } } peers { permanent_uuid: "af600c2890494e1ba21578ef6e073d26" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 43643 } } peers { permanent_uuid: "fac5855b35dd44b3b9af0f38d07b32e1" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 39103 } }
I20260923 17:16:46.094619 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.130:42083
--local_ip_for_outbound_sockets=127.11.229.130
--tserver_master_addrs=127.11.229.190:44985
--webserver_port=39343
--webserver_interface=127.11.229.130
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab
--principal=kudu/127.11.229.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:39033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 17:16:46.095031 27129 ts_tablet_manager.cc:1428] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1: Time spent starting tablet: real 0.005s user 0.005s sys 0.003s
W20260923 17:16:46.122750 27240 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:16:46.086408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.129:33315)
0923 17:16:46.086878 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:46.086929 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0923 17:16:46.087766 (+ 837us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:16:46.121938 (+ 34172us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":134,"threads_started":1}
W20260923 17:16:46.123238 27238 heartbeater.cc:644] Failed to heartbeat to 127.11.229.190:44985 (0 consecutive failures): Network error: Failed to ping master at 127.11.229.190:44985: Client connection negotiation failed: client connection to 127.11.229.190:44985: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260923 17:16:46.123965 27240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:46.123729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.129:34679)
0923 17:16:46.123855 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:46.123913 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260923 17:16:46.124779 27240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:46.124503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.129:58327)
0923 17:16:46.124646 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:46.124725 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
W20260923 17:16:46.124974 27238 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260923 17:16:46.208293 27242 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:16:46.208570 27242 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:16:46.208648 27242 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:16:46.212548 27242 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:16:46.212634 27242 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:16:46.212731 27242 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.130
I20260923 17:16:46.217994 27242 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:39033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab
--principal=kudu/127.11.229.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.130:42083
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.229.130
--webserver_port=39343
--tserver_master_addrs=127.11.229.190:44985
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27242
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.130
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:16:46.219118 27242 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:16:46.220151 27242 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:16:46.229827 27247 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:16:46.229837 27250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:16:46.229912 27242 server_base.cc:1034] running on GCE node
W20260923 17:16:46.229875 27248 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:16:46.230630 27242 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:16:46.231418 27242 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:16:46.232601 27242 hybrid_clock.cc:648] HybridClock initialized: now 1790183806232574 us; error 38 us; skew 500 ppm
Sep 23 17:16:46 dist-test-slave-1x1f krb5kdc[25928](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183806, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:16:46.235625 27242 init.cc:377] Logged in from keytab as kudu/127.11.229.130@KRBTEST.COM (short username kudu)
I20260923 17:16:46.236467 27242 webserver.cc:460] Webserver started at http://127.11.229.130:39343/ using document root <none> and password file <none>
I20260923 17:16:46.237032 27242 fs_manager.cc:359] Metadata directory not provided
I20260923 17:16:46.237123 27242 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:16:46.240825 27242 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260923 17:16:46.242978 27257 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:16:46.244333 27242 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 17:16:46.244488 27242 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-1/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-1/wal
uuid: "1b7744d6de814dffa2521e7c0170c656"
format_stamp: "Formatted at 2026-09-23 17:16:44 on dist-test-slave-1x1f"
server_key: "419fed7dd5c02d5d67d4b2523eee8140"
server_key_iv: "13f92a5175ddadc1a384b6de6cc92b73"
server_key_version: "encryptionkey@0"
I20260923 17:16:46.245086 27242 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:16:46.260499 27242 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:16:46.263491 27242 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:16:46.263638 27242 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:16:46.264127 27242 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:16:46.264856 27242 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:16:46.264901 27242 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:16:46.264940 27242 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:16:46.264955 27242 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:16:46.273062 27242 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.130:42083
I20260923 17:16:46.273171 27370 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.130:42083 every 8 connection(s)
I20260923 17:16:46.274055 27242 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
I20260923 17:16:46.277963 27373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:46.276219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.130:39467)
0923 17:16:46.276757 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:46.277165 (+ 408us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":137,"threads_started":1}
W20260923 17:16:46.278431 27371 heartbeater.cc:644] Failed to heartbeat to 127.11.229.190:44985 (0 consecutive failures): Network error: Failed to ping master at 127.11.229.190:44985: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
I20260923 17:16:46.279001 27373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:46.278808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.130:47359)
0923 17:16:46.278910 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:46.278954 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260923 17:16:46.279569 27373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:46.279396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.130:37107)
0923 17:16:46.279487 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:46.279525 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260923 17:16:46.279742 27371 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260923 17:16:46.280934 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 27242
I20260923 17:16:46.281373 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.131:43643
--local_ip_for_outbound_sockets=127.11.229.131
--tserver_master_addrs=127.11.229.190:44985
--webserver_port=40717
--webserver_interface=127.11.229.131
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab
--principal=kudu/127.11.229.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:39033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:16:46.390632 27374 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:16:46.390888 27374 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:16:46.390931 27374 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:16:46.394942 27374 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:16:46.394992 27374 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:16:46.395077 27374 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.131
I20260923 17:16:46.400221 27374 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:39033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab
--principal=kudu/127.11.229.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.131:43643
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.229.131
--webserver_port=40717
--tserver_master_addrs=127.11.229.190:44985
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27374
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.131
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:16:46.401199 27374 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:16:46.402187 27374 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:16:46.411958 27382 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:16:46.411967 27379 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:16:46.411897 27380 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:16:46.412170 27374 server_base.cc:1034] running on GCE node
I20260923 17:16:46.412561 27374 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:16:46.413214 27374 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:16:46.414361 27374 hybrid_clock.cc:648] HybridClock initialized: now 1790183806414322 us; error 48 us; skew 500 ppm
Sep 23 17:16:46 dist-test-slave-1x1f krb5kdc[25928](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183806, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:16:46.417438 27374 init.cc:377] Logged in from keytab as kudu/127.11.229.131@KRBTEST.COM (short username kudu)
I20260923 17:16:46.418546 27374 webserver.cc:460] Webserver started at http://127.11.229.131:40717/ using document root <none> and password file <none>
I20260923 17:16:46.419178 27374 fs_manager.cc:359] Metadata directory not provided
I20260923 17:16:46.419277 27374 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:16:46.423388 27374 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260923 17:16:46.425621 27389 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:16:46.427143 27374 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 17:16:46.427311 27374 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-2/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-2/wal
uuid: "af600c2890494e1ba21578ef6e073d26"
format_stamp: "Formatted at 2026-09-23 17:16:44 on dist-test-slave-1x1f"
server_key: "5b40d5891623d983d3d1a8b1ddcda782"
server_key_iv: "53e5897ec3995bd42bdb5ce45af11349"
server_key_version: "encryptionkey@0"
I20260923 17:16:46.427971 27374 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:16:46.471535 27374 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:16:46.475054 27374 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:16:46.475270 27374 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:16:46.475880 27374 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:16:46.476783 27374 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:16:46.476850 27374 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:16:46.476922 27374 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:16:46.476972 27374 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:16:46.486557 27374 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.131:43643
I20260923 17:16:46.486618 27502 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.131:43643 every 8 connection(s)
I20260923 17:16:46.487582 27374 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
I20260923 17:16:46.488866 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 27374
I20260923 17:16:46.491771 27506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:46.489981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.131:42307)
0923 17:16:46.490540 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:46.491026 (+ 486us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":362,"thread_start_us":191,"threads_started":1}
W20260923 17:16:46.492295 27503 heartbeater.cc:644] Failed to heartbeat to 127.11.229.190:44985 (0 consecutive failures): Network error: Failed to ping master at 127.11.229.190:44985: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
I20260923 17:16:46.492893 27506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:46.492670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.131:45137)
0923 17:16:46.492786 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:46.492836 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260923 17:16:46.493631 27506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:46.493428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.131:37387)
0923 17:16:46.493535 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:46.493581 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260923 17:16:46.493898 27503 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260923 17:16:47.126021 27507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:47.125575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.129:52673)
0923 17:16:47.125857 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:47.125920 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":88,"threads_started":1}
I20260923 17:16:47.280639 27508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:47.280245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.130:60263)
0923 17:16:47.280487 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:47.280539 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":72,"threads_started":1}
I20260923 17:16:47.495033 27509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:47.494526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.131:45149)
0923 17:16:47.494806 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:47.494884 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":76,"threads_started":1}
I20260923 17:16:47.516151 27510 raft_consensus.cc:482] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 17:16:47.516381 27510 raft_consensus.cc:504] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b7744d6de814dffa2521e7c0170c656" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42083 } } peers { permanent_uuid: "af600c2890494e1ba21578ef6e073d26" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 43643 } } peers { permanent_uuid: "fac5855b35dd44b3b9af0f38d07b32e1" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 39103 } }
I20260923 17:16:47.517480 27510 leader_election.cc:288] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1b7744d6de814dffa2521e7c0170c656 (127.11.229.130:42083), af600c2890494e1ba21578ef6e073d26 (127.11.229.131:43643)
Sep 23 17:16:47 dist-test-slave-1x1f krb5kdc[25928](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183806, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.129@KRBTEST.COM for kudu/127.11.229.130@KRBTEST.COM
Sep 23 17:16:47 dist-test-slave-1x1f krb5kdc[25928](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183806, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.129@KRBTEST.COM for kudu/127.11.229.131@KRBTEST.COM
I20260923 17:16:47.532513 27507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:47.517718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.130:42083 (local address 127.11.229.129:54689)
0923 17:16:47.517837 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:47.517854 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 17:16:47.517967 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:16:47.519931 (+ 1964us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:16:47.519936 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:16:47.520504 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:16:47.521007 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:47.521022 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:47.522320 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:47.522322 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:47.523191 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:47.523201 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:47.523908 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:47.523912 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:47.524088 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:47.524765 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:16:47.524781 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:16:47.526799 (+ 2018us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:16:47.529573 (+ 2774us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:16:47.529579 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:16:47.529610 (+ 31us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:16:47.529946 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:16:47.530391 (+ 445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:16:47.530396 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:16:47.530399 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:16:47.530577 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:16:47.531426 (+ 849us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:16:47.531434 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:16:47.531729 (+ 295us) client_negotiation.cc:769] Sending connection context
0923 17:16:47.531953 (+ 224us) client_negotiation.cc:240] Negotiation successful
0923 17:16:47.532308 (+ 355us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45,"mutex_wait_us":102,"spinlock_wait_cycles":6528}
I20260923 17:16:47.533054 27512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:47.518028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.131:43643 (local address 127.11.229.129:34617)
0923 17:16:47.518352 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:47.518366 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 17:16:47.518464 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:16:47.519929 (+ 1465us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:16:47.519935 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:16:47.520504 (+ 569us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:16:47.521007 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:47.521022 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:47.522303 (+ 1281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:47.522312 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:47.523191 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:16:47.523200 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:16:47.523951 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:16:47.523955 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:16:47.524091 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:47.524813 (+ 722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:16:47.524826 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:16:47.527064 (+ 2238us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:16:47.529794 (+ 2730us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:16:47.529797 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:16:47.529799 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:16:47.530054 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:16:47.530725 (+ 671us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:16:47.530729 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:16:47.530732 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:16:47.530810 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:16:47.531454 (+ 644us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:16:47.531457 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:16:47.531730 (+ 273us) client_negotiation.cc:769] Sending connection context
0923 17:16:47.531953 (+ 223us) client_negotiation.cc:240] Negotiation successful
0923 17:16:47.532459 (+ 506us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"mutex_wait_us":233,"spinlock_wait_cycles":87296,"thread_start_us":99,"threads_started":1}
I20260923 17:16:47.533353 27511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:47.517933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:54689 (local address 127.11.229.130:42083)
0923 17:16:47.518442 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:47.518465 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:47.518511 (+ 46us) server_negotiation.cc:407] Connection header received
0923 17:16:47.519215 (+ 704us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:47.519221 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:47.519548 (+ 327us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:47.519906 (+ 358us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:16:47.521180 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:47.522138 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:47.523324 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:47.523782 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:47.523969 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:47.527090 (+ 3121us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:16:47.527099 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:16:47.527115 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:16:47.527172 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:16:47.529435 (+ 2263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:47.530075 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:47.530081 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:47.530086 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:47.530269 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:47.530711 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:47.530714 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:47.530715 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:47.531285 (+ 570us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:16:47.532717 (+ 1432us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:47.532873 (+ 156us) server_negotiation.cc:299] Negotiation successful
0923 17:16:47.533158 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":132,"threads_started":1}
I20260923 17:16:47.534741 27513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:47.518215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:34617 (local address 127.11.229.131:43643)
0923 17:16:47.518551 (+ 336us) server_negotiation.cc:206] Beginning negotiation
0923 17:16:47.518578 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0923 17:16:47.518608 (+ 30us) server_negotiation.cc:407] Connection header received
0923 17:16:47.519214 (+ 606us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:16:47.519221 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:16:47.519549 (+ 328us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:16:47.519820 (+ 271us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:16:47.521191 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:47.522137 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:47.523321 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:16:47.523784 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:16:47.523982 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:16:47.527299 (+ 3317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:16:47.527303 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:16:47.527314 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:16:47.527367 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:16:47.529670 (+ 2303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:47.530179 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:47.530184 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:47.530188 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:47.530350 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:16:47.530893 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:16:47.530896 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:16:47.530898 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:16:47.531285 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:16:47.531512 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0923 17:16:47.532122 (+ 610us) server_negotiation.cc:299] Negotiation successful
0923 17:16:47.533035 (+ 913us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":233,"thread_start_us":136,"threads_started":1}
W20260923 17:16:47.536340 27125 leader_election.cc:341] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1b7744d6de814dffa2521e7c0170c656 (127.11.229.130:42083): Not found: Tablet not found: 4d1e0f3d1d7a4b2d94ece9b934a5e195
W20260923 17:16:47.537705 27125 leader_election.cc:341] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer af600c2890494e1ba21578ef6e073d26 (127.11.229.131:43643): Not found: Tablet not found: 4d1e0f3d1d7a4b2d94ece9b934a5e195
I20260923 17:16:47.537789 27125 leader_election.cc:302] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac5855b35dd44b3b9af0f38d07b32e1; no voters: 1b7744d6de814dffa2521e7c0170c656, af600c2890494e1ba21578ef6e073d26
I20260923 17:16:47.538069 27510 raft_consensus.cc:2726] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260923 17:16:48.127388 27514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:48.126861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.129:41803)
0923 17:16:48.127217 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:48.127284 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":87,"threads_started":1}
I20260923 17:16:48.281899 27515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:48.281458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.130:60131)
0923 17:16:48.281747 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:48.281805 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":112,"threads_started":1}
I20260923 17:16:48.496328 27516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:48.495876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.131:45509)
0923 17:16:48.496157 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:48.496230 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":90,"threads_started":1}
I20260923 17:16:49.128728 27517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:49.128256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.129:46871)
0923 17:16:49.128553 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:49.128626 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":113,"threads_started":1}
I20260923 17:16:49.283407 27518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:49.282848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.130:57223)
0923 17:16:49.283188 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:49.283255 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":88,"threads_started":1}
I20260923 17:16:49.399595 27519 raft_consensus.cc:482] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 17:16:49.399785 27519 raft_consensus.cc:504] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b7744d6de814dffa2521e7c0170c656" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42083 } } peers { permanent_uuid: "af600c2890494e1ba21578ef6e073d26" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 43643 } } peers { permanent_uuid: "fac5855b35dd44b3b9af0f38d07b32e1" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 39103 } }
I20260923 17:16:49.400333 27519 leader_election.cc:288] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1b7744d6de814dffa2521e7c0170c656 (127.11.229.130:42083), af600c2890494e1ba21578ef6e073d26 (127.11.229.131:43643)
W20260923 17:16:49.401317 27125 leader_election.cc:341] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1b7744d6de814dffa2521e7c0170c656 (127.11.229.130:42083): Not found: Tablet not found: 4d1e0f3d1d7a4b2d94ece9b934a5e195
W20260923 17:16:49.401463 27125 leader_election.cc:341] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer af600c2890494e1ba21578ef6e073d26 (127.11.229.131:43643): Not found: Tablet not found: 4d1e0f3d1d7a4b2d94ece9b934a5e195
I20260923 17:16:49.401543 27125 leader_election.cc:302] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac5855b35dd44b3b9af0f38d07b32e1; no voters: 1b7744d6de814dffa2521e7c0170c656, af600c2890494e1ba21578ef6e073d26
I20260923 17:16:49.401758 27519 raft_consensus.cc:2726] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260923 17:16:49.497526 27520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:49.497101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.131:46823)
0923 17:16:49.497357 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:49.497420 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":86,"threads_started":1}
I20260923 17:16:50.129891 27521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:50.129465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.129:44535)
0923 17:16:50.129735 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:50.129791 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":91,"threads_started":1}
I20260923 17:16:50.284647 27522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:50.284219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.130:45621)
0923 17:16:50.284500 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:50.284557 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":92,"threads_started":1}
I20260923 17:16:50.498955 27523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:50.498495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.131:42579)
0923 17:16:50.498771 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:50.498832 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":100,"threads_started":1}
I20260923 17:16:51.131486 27524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:51.130943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.129:54811)
0923 17:16:51.131293 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:51.131366 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":75,"threads_started":1}
I20260923 17:16:51.285913 27525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:51.285436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.130:54497)
0923 17:16:51.285705 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:51.285776 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":77,"threads_started":1}
I20260923 17:16:51.385663 27526 raft_consensus.cc:482] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 17:16:51.385795 27526 raft_consensus.cc:504] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b7744d6de814dffa2521e7c0170c656" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42083 } } peers { permanent_uuid: "af600c2890494e1ba21578ef6e073d26" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 43643 } } peers { permanent_uuid: "fac5855b35dd44b3b9af0f38d07b32e1" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 39103 } }
I20260923 17:16:51.386143 27526 leader_election.cc:288] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1b7744d6de814dffa2521e7c0170c656 (127.11.229.130:42083), af600c2890494e1ba21578ef6e073d26 (127.11.229.131:43643)
W20260923 17:16:51.386961 27125 leader_election.cc:341] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1b7744d6de814dffa2521e7c0170c656 (127.11.229.130:42083): Not found: Tablet not found: 4d1e0f3d1d7a4b2d94ece9b934a5e195
W20260923 17:16:51.387140 27125 leader_election.cc:341] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer af600c2890494e1ba21578ef6e073d26 (127.11.229.131:43643): Not found: Tablet not found: 4d1e0f3d1d7a4b2d94ece9b934a5e195
I20260923 17:16:51.387208 27125 leader_election.cc:302] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac5855b35dd44b3b9af0f38d07b32e1; no voters: 1b7744d6de814dffa2521e7c0170c656, af600c2890494e1ba21578ef6e073d26
I20260923 17:16:51.387413 27526 raft_consensus.cc:2726] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260923 17:16:51.500263 27527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:51.499846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.131:50251)
0923 17:16:51.500108 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:51.500170 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":75,"threads_started":1}
I20260923 17:16:52.132866 27528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:52.132301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.129:48003)
0923 17:16:52.132613 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:52.132677 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":227,"thread_start_us":87,"threads_started":1}
I20260923 17:16:52.287325 27529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:52.286884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.130:43591)
0923 17:16:52.287162 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:52.287232 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":77,"threads_started":1}
I20260923 17:16:52.501509 27530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:52.501119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.131:39445)
0923 17:16:52.501363 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:52.501418 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":73,"threads_started":1}
I20260923 17:16:53.134351 27531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:53.133594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.129:52747)
0923 17:16:53.133879 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:53.134160 (+ 281us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":85,"threads_started":1}
I20260923 17:16:53.288568 27532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:53.288127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.130:34111)
0923 17:16:53.288424 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:53.288476 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":87,"threads_started":1}
I20260923 17:16:53.502925 27533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:53.502452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.131:32785)
0923 17:16:53.502765 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:53.502834 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":81,"threads_started":1}
I20260923 17:16:53.602104 27534 raft_consensus.cc:482] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 17:16:53.602332 27534 raft_consensus.cc:504] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b7744d6de814dffa2521e7c0170c656" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42083 } } peers { permanent_uuid: "af600c2890494e1ba21578ef6e073d26" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 43643 } } peers { permanent_uuid: "fac5855b35dd44b3b9af0f38d07b32e1" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 39103 } }
I20260923 17:16:53.602713 27534 leader_election.cc:288] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1b7744d6de814dffa2521e7c0170c656 (127.11.229.130:42083), af600c2890494e1ba21578ef6e073d26 (127.11.229.131:43643)
W20260923 17:16:53.603608 27125 leader_election.cc:341] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer af600c2890494e1ba21578ef6e073d26 (127.11.229.131:43643): Not found: Tablet not found: 4d1e0f3d1d7a4b2d94ece9b934a5e195
W20260923 17:16:53.603802 27125 leader_election.cc:341] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1b7744d6de814dffa2521e7c0170c656 (127.11.229.130:42083): Not found: Tablet not found: 4d1e0f3d1d7a4b2d94ece9b934a5e195
I20260923 17:16:53.603878 27125 leader_election.cc:302] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac5855b35dd44b3b9af0f38d07b32e1; no voters: 1b7744d6de814dffa2521e7c0170c656, af600c2890494e1ba21578ef6e073d26
I20260923 17:16:53.604081 27534 raft_consensus.cc:2726] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260923 17:16:54.135690 27535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:54.135213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.129:49975)
0923 17:16:54.135530 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:54.135590 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":101,"threads_started":1}
I20260923 17:16:54.289789 27536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:54.289370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.130:42387)
0923 17:16:54.289629 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:54.289690 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":71,"threads_started":1}
I20260923 17:16:54.504292 27537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:54.503849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.131:36625)
0923 17:16:54.504114 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:54.504171 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":105,"threads_started":1}
I20260923 17:16:55.136906 27538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:55.136476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.129:44079)
0923 17:16:55.136742 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:55.136797 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":91,"threads_started":1}
I20260923 17:16:55.291051 27539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:55.290639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.130:52519)
0923 17:16:55.290906 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:55.290960 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":75,"threads_started":1}
I20260923 17:16:55.505447 27540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:55.505001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.131:44425)
0923 17:16:55.505290 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:55.505351 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":97,"threads_started":1}
I20260923 17:16:56.138180 27541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:56.137796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.129:36889)
0923 17:16:56.138027 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:56.138083 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":70,"threads_started":1}
I20260923 17:16:56.144851 27542 raft_consensus.cc:482] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 17:16:56.145026 27542 raft_consensus.cc:504] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b7744d6de814dffa2521e7c0170c656" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42083 } } peers { permanent_uuid: "af600c2890494e1ba21578ef6e073d26" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 43643 } } peers { permanent_uuid: "fac5855b35dd44b3b9af0f38d07b32e1" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 39103 } }
I20260923 17:16:56.145565 27542 leader_election.cc:288] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1b7744d6de814dffa2521e7c0170c656 (127.11.229.130:42083), af600c2890494e1ba21578ef6e073d26 (127.11.229.131:43643)
W20260923 17:16:56.146890 27125 leader_election.cc:341] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer af600c2890494e1ba21578ef6e073d26 (127.11.229.131:43643): Not found: Tablet not found: 4d1e0f3d1d7a4b2d94ece9b934a5e195
W20260923 17:16:56.147045 27125 leader_election.cc:341] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1b7744d6de814dffa2521e7c0170c656 (127.11.229.130:42083): Not found: Tablet not found: 4d1e0f3d1d7a4b2d94ece9b934a5e195
I20260923 17:16:56.147104 27125 leader_election.cc:302] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac5855b35dd44b3b9af0f38d07b32e1; no voters: 1b7744d6de814dffa2521e7c0170c656, af600c2890494e1ba21578ef6e073d26
I20260923 17:16:56.147275 27542 raft_consensus.cc:2726] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260923 17:16:56.292230 27543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:56.291825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.130:48367)
0923 17:16:56.292084 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:56.292139 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":78,"threads_started":1}
I20260923 17:16:56.506783 27544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:56.506384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.131:38865)
0923 17:16:56.506640 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:56.506692 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":71,"threads_started":1}
I20260923 17:16:57.139453 27545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:57.139030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.129:42801)
0923 17:16:57.139281 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:57.139355 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":92,"threads_started":1}
I20260923 17:16:57.293597 27546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:57.293102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.130:43039)
0923 17:16:57.293392 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:57.293450 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":104,"threads_started":1}
I20260923 17:16:57.508229 27547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:57.507796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.131:58021)
0923 17:16:57.508069 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:57.508132 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":93,"threads_started":1}
I20260923 17:16:58.140739 27548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:58.140261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.129:41971)
0923 17:16:58.140577 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:58.140639 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":102,"threads_started":1}
I20260923 17:16:58.294993 27549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:58.294478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.130:33927)
0923 17:16:58.294786 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:58.294863 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":83,"threads_started":1}
I20260923 17:16:58.509547 27550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:58.509055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.131:42179)
0923 17:16:58.509392 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:58.509454 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":259,"thread_start_us":75,"threads_started":1}
I20260923 17:16:59.141947 27551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:59.141544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.129:41337)
0923 17:16:59.141796 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:59.141853 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":86,"threads_started":1}
I20260923 17:16:59.296397 27552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:59.295936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.130:38751)
0923 17:16:59.296231 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:59.296296 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":95,"threads_started":1}
I20260923 17:16:59.510939 27553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:16:59.510543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.131:38599)
0923 17:16:59.510786 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0923 17:16:59.510847 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":72,"threads_started":1}
I20260923 17:17:00.043334 27554 raft_consensus.cc:482] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 17:17:00.043499 27554 raft_consensus.cc:504] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b7744d6de814dffa2521e7c0170c656" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42083 } } peers { permanent_uuid: "af600c2890494e1ba21578ef6e073d26" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 43643 } } peers { permanent_uuid: "fac5855b35dd44b3b9af0f38d07b32e1" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 39103 } }
I20260923 17:17:00.043963 27554 leader_election.cc:288] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1b7744d6de814dffa2521e7c0170c656 (127.11.229.130:42083), af600c2890494e1ba21578ef6e073d26 (127.11.229.131:43643)
W20260923 17:17:00.044809 27125 leader_election.cc:341] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 1b7744d6de814dffa2521e7c0170c656 (127.11.229.130:42083): Not found: Tablet not found: 4d1e0f3d1d7a4b2d94ece9b934a5e195
W20260923 17:17:00.044960 27125 leader_election.cc:341] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer af600c2890494e1ba21578ef6e073d26 (127.11.229.131:43643): Not found: Tablet not found: 4d1e0f3d1d7a4b2d94ece9b934a5e195
I20260923 17:17:00.045019 27125 leader_election.cc:302] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fac5855b35dd44b3b9af0f38d07b32e1; no voters: 1b7744d6de814dffa2521e7c0170c656, af600c2890494e1ba21578ef6e073d26
I20260923 17:17:00.045202 27554 raft_consensus.cc:2726] T 4d1e0f3d1d7a4b2d94ece9b934a5e195 P fac5855b35dd44b3b9af0f38d07b32e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260923 17:17:00.143270 27555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:00.142793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.129:37673)
0923 17:17:00.143072 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:00.143131 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":113,"threads_started":1}
I20260923 17:17:00.297695 27556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:00.297248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.130:37085)
0923 17:17:00.297541 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:00.297595 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":99,"threads_started":1}
I20260923 17:17:00.512422 27557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:00.511888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.131:48919)
0923 17:17:00.512254 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:00.512323 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":94,"threads_started":1}
I20260923 17:17:01.144873 27558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:01.144393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.129:60251)
0923 17:17:01.144708 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:01.144775 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":72,"threads_started":1}
I20260923 17:17:01.299216 27559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:01.298749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:44985 (local address 127.11.229.130:39725)
0923 17:17:01.299047 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:01.299117 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:44985: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":86,"threads_started":1}
I20260923 17:17:01.500536 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 27073
I20260923 17:17:01.506498 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 27242
I20260923 17:17:01.511970 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 27374
2026-09-23T17:17:01Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (19366 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 17:17:01 dist-test-slave-1x1f krb5kdc[27562](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 17:17:01 dist-test-slave-1x1f krb5kdc[27562](info): set up 2 sockets
Sep 23 17:17:01 dist-test-slave-1x1f krb5kdc[27562](info): commencing operation
krb5kdc: starting...
W20260923 17:17:02.842873 12182 mini_kdc.cc:121] Time spent starting KDC: real 1.038s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Sep 23 17:17:02 dist-test-slave-1x1f krb5kdc[27562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183822, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T17:17:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:17:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.229.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
I20260923 17:17:02.970506 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:36279
--webserver_interface=127.11.229.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:35505
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:36279
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:17:03.078858 27575 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:17:03.079178 27575 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:17:03.079250 27575 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:17:03.083232 27575 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260923 17:17:03.083328 27575 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260923 17:17:03.083359 27575 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260923 17:17:03.083393 27575 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:17:03.083431 27575 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:17:03.083487 27575 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:17:03.083523 27575 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:17:03.083557 27575 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:17:03.088825 27575 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:35505
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:36279
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:36279
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.229.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27575
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:17:03.089900 27575 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:17:03.090915 27575 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:17:03.099821 27581 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:17:03.100005 27575 server_base.cc:1034] running on GCE node
W20260923 17:17:03.099913 27580 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:17:03.099821 27583 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:17:03.100613 27575 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:17:03.101761 27575 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:17:03.102967 27575 hybrid_clock.cc:648] HybridClock initialized: now 1790183823102953 us; error 26 us; skew 500 ppm
Sep 23 17:17:03 dist-test-slave-1x1f krb5kdc[27562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183823, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:17:03.111670 27575 init.cc:377] Logged in from keytab as kudu/127.11.229.190@KRBTEST.COM (short username kudu)
I20260923 17:17:03.112699 27575 webserver.cc:460] Webserver started at http://127.11.229.190:33075/ using document root <none> and password file <none>
I20260923 17:17:03.113335 27575 fs_manager.cc:359] Metadata directory not provided
I20260923 17:17:03.113438 27575 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:17:03.113690 27575 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:17:03.116029 27575 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "1a1c758878174c29a8ea96431421db13"
format_stamp: "Formatted at 2026-09-23 17:17:03 on dist-test-slave-1x1f"
server_key: "44938f7212d65a051bdbde8a1fb143f0"
server_key_iv: "4acbf9b95984fd33256fe3650db6b0aa"
server_key_version: "encryptionkey@0"
I20260923 17:17:03.116673 27575 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "1a1c758878174c29a8ea96431421db13"
format_stamp: "Formatted at 2026-09-23 17:17:03 on dist-test-slave-1x1f"
server_key: "44938f7212d65a051bdbde8a1fb143f0"
server_key_iv: "4acbf9b95984fd33256fe3650db6b0aa"
server_key_version: "encryptionkey@0"
I20260923 17:17:03.120728 27575 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260923 17:17:03.123472 27590 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:17:03.124835 27575 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260923 17:17:03.125000 27575 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "1a1c758878174c29a8ea96431421db13"
format_stamp: "Formatted at 2026-09-23 17:17:03 on dist-test-slave-1x1f"
server_key: "44938f7212d65a051bdbde8a1fb143f0"
server_key_iv: "4acbf9b95984fd33256fe3650db6b0aa"
server_key_version: "encryptionkey@0"
I20260923 17:17:03.125126 27575 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:17:03.162180 27575 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:17:03.165330 27575 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:17:03.165567 27575 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:17:03.172910 27575 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.190:36279
I20260923 17:17:03.173228 27642 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.190:36279 every 8 connection(s)
I20260923 17:17:03.173916 27575 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:17:03.176797 27643 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:17:03.177362 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 27575
I20260923 17:17:03.177500 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:17:03.177855 12182 external_mini_cluster.cc:1428] Setting key 6eb9a55838fc702f31f1f4a0359b69da
I20260923 17:17:03.184701 27643 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13: Bootstrap starting.
I20260923 17:17:03.187476 27643 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13: Neither blocks nor log segments found. Creating new log.
Sep 23 17:17:03 dist-test-slave-1x1f krb5kdc[27562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183822, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:17:03.188349 27643 log.cc:824] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13: Log is configured to *not* fsync() on all Append() calls
I20260923 17:17:03.190846 27643 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13: No bootstrap required, opened a new log
I20260923 17:17:03.194502 27646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:03.179415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58832 (local address 127.11.229.190:36279)
0923 17:17:03.179937 (+ 522us) server_negotiation.cc:206] Beginning negotiation
0923 17:17:03.179957 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0923 17:17:03.180002 (+ 45us) server_negotiation.cc:407] Connection header received
0923 17:17:03.180803 (+ 801us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:17:03.180827 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:17:03.181274 (+ 447us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:17:03.181668 (+ 394us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:17:03.182376 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:03.184003 (+ 1627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:03.185212 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:03.185957 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:03.186128 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:17:03.188743 (+ 2615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:17:03.188751 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:17:03.188769 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:17:03.188811 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:17:03.190974 (+ 2163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:17:03.191438 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:17:03.191444 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:17:03.191450 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:17:03.191591 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:17:03.192074 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:17:03.192078 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:17:03.192080 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:17:03.192603 (+ 523us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:17:03.192823 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0923 17:17:03.193045 (+ 222us) server_negotiation.cc:299] Negotiation successful
0923 17:17:03.193438 (+ 393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":352,"thread_start_us":152,"threads_started":1}
I20260923 17:17:03.195659 27643 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a1c758878174c29a8ea96431421db13" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 36279 } }
I20260923 17:17:03.195948 27643 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:17:03.196010 27643 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a1c758878174c29a8ea96431421db13, State: Initialized, Role: FOLLOWER
I20260923 17:17:03.196483 27643 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a1c758878174c29a8ea96431421db13" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 36279 } }
I20260923 17:17:03.196650 27643 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:17:03.196763 27643 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:17:03.196902 27643 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:17:03.197845 27643 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a1c758878174c29a8ea96431421db13" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 36279 } }
I20260923 17:17:03.198200 27643 leader_election.cc:302] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1a1c758878174c29a8ea96431421db13; no voters:
I20260923 17:17:03.198586 27643 leader_election.cc:288] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 17:17:03.198753 27648 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:17:03.198997 27648 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [term 1 LEADER]: Becoming Leader. State: Replica: 1a1c758878174c29a8ea96431421db13, State: Running, Role: LEADER
I20260923 17:17:03.199378 27648 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a1c758878174c29a8ea96431421db13" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 36279 } }
I20260923 17:17:03.199863 27643 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:17:03.201009 27649 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1a1c758878174c29a8ea96431421db13" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a1c758878174c29a8ea96431421db13" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 36279 } } }
I20260923 17:17:03.201135 27649 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [sys.catalog]: This master's current role is: LEADER
I20260923 17:17:03.201529 27657 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:17:03.201493 27650 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1a1c758878174c29a8ea96431421db13. Latest consensus state: current_term: 1 leader_uuid: "1a1c758878174c29a8ea96431421db13" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a1c758878174c29a8ea96431421db13" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 36279 } } }
I20260923 17:17:03.201686 27650 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [sys.catalog]: This master's current role is: LEADER
I20260923 17:17:03.205039 27657 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:17:03.211061 27657 catalog_manager.cc:1347] Generated new cluster ID: 22ed4c47d61a4d62810a8152b4eff9d6
I20260923 17:17:03.211127 27657 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:17:03.222337 27657 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:17:03.223326 27657 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:17:03.230650 27657 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13: Generated new TSK 0
I20260923 17:17:03.231318 27657 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.229.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab.
Entry for principal kudu/127.11.229.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab.
I20260923 17:17:03.271370 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.129:0
--local_ip_for_outbound_sockets=127.11.229.129
--webserver_interface=127.11.229.129
--webserver_port=0
--tserver_master_addrs=127.11.229.190:36279
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab
--principal=kudu/127.11.229.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:35505
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:17:03.383844 27669 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:17:03.384122 27669 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:17:03.384168 27669 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:17:03.388701 27669 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:17:03.388774 27669 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:17:03.388876 27669 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.129
I20260923 17:17:03.394210 27669 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:35505
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab
--principal=kudu/127.11.229.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.229.129
--webserver_port=0
--tserver_master_addrs=127.11.229.190:36279
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27669
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.129
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:17:03.395311 27669 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:17:03.396364 27669 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:17:03.406940 27677 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:17:03.406986 27674 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:17:03.407032 27675 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:17:03.407137 27669 server_base.cc:1034] running on GCE node
I20260923 17:17:03.407591 27669 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:17:03.408212 27669 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:17:03.409390 27669 hybrid_clock.cc:648] HybridClock initialized: now 1790183823409374 us; error 32 us; skew 500 ppm
Sep 23 17:17:03 dist-test-slave-1x1f krb5kdc[27562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183823, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:17:03.412137 27669 init.cc:377] Logged in from keytab as kudu/127.11.229.129@KRBTEST.COM (short username kudu)
I20260923 17:17:03.413021 27669 webserver.cc:460] Webserver started at http://127.11.229.129:34387/ using document root <none> and password file <none>
I20260923 17:17:03.413563 27669 fs_manager.cc:359] Metadata directory not provided
I20260923 17:17:03.413647 27669 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:17:03.413870 27669 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:17:03.415876 27669 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-0/data/instance:
uuid: "26358176962d45319c4c4c34d54a6fc5"
format_stamp: "Formatted at 2026-09-23 17:17:03 on dist-test-slave-1x1f"
server_key: "d3d58befc684202d7afff505cd01d688"
server_key_iv: "341c9e25f50e17a49ee23fa3d4b0db6a"
server_key_version: "encryptionkey@0"
I20260923 17:17:03.416412 27669 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance:
uuid: "26358176962d45319c4c4c34d54a6fc5"
format_stamp: "Formatted at 2026-09-23 17:17:03 on dist-test-slave-1x1f"
server_key: "d3d58befc684202d7afff505cd01d688"
server_key_iv: "341c9e25f50e17a49ee23fa3d4b0db6a"
server_key_version: "encryptionkey@0"
I20260923 17:17:03.420414 27669 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.002s
I20260923 17:17:03.423185 27684 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:17:03.424635 27669 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 17:17:03.424803 27669 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-0/wal
uuid: "26358176962d45319c4c4c34d54a6fc5"
format_stamp: "Formatted at 2026-09-23 17:17:03 on dist-test-slave-1x1f"
server_key: "d3d58befc684202d7afff505cd01d688"
server_key_iv: "341c9e25f50e17a49ee23fa3d4b0db6a"
server_key_version: "encryptionkey@0"
I20260923 17:17:03.424944 27669 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:17:03.438097 27669 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:17:03.442726 27669 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:17:03.442975 27669 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:17:03.443857 27669 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:17:03.444792 27669 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:17:03.444862 27669 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:17:03.444933 27669 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:17:03.444984 27669 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:17:03.456168 27669 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.129:38399
I20260923 17:17:03.456188 27797 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.129:38399 every 8 connection(s)
I20260923 17:17:03.457093 27669 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
I20260923 17:17:03.457971 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 27669
I20260923 17:17:03.458096 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance
I20260923 17:17:03.458513 12182 external_mini_cluster.cc:1428] Setting key f9ffa1c5ecae0a0750d5df2fe72bfca2
Sep 23 17:17:03 dist-test-slave-1x1f krb5kdc[27562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183823, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.129@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.229.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.130@KRBTEST.COM" created.
I20260923 17:17:03.472750 27646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:03.459112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:51427 (local address 127.11.229.190:36279)
0923 17:17:03.459259 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0923 17:17:03.459263 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:17:03.460552 (+ 1289us) server_negotiation.cc:407] Connection header received
0923 17:17:03.461406 (+ 854us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:17:03.461411 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:17:03.461475 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:17:03.461602 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:17:03.462842 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:03.463747 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:03.465236 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:03.465739 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:03.465875 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:17:03.468620 (+ 2745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:17:03.468624 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:17:03.468627 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:17:03.468661 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:17:03.470476 (+ 1815us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:17:03.471016 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:17:03.471019 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:17:03.471020 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:17:03.471100 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:17:03.471510 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:17:03.471516 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:17:03.471518 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:17:03.471736 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:17:03.471856 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0923 17:17:03.472421 (+ 565us) server_negotiation.cc:299] Negotiation successful
0923 17:17:03.472562 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260923 17:17:03.473757 27800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:03.459602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.129:51427)
0923 17:17:03.460380 (+ 778us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:03.460433 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0923 17:17:03.461213 (+ 780us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:17:03.461779 (+ 566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:17:03.461786 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:17:03.462131 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:17:03.462689 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:17:03.462705 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:17:03.463910 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:17:03.463913 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:17:03.465086 (+ 1173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:17:03.465097 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:17:03.465907 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:17:03.465910 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:17:03.466060 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:17:03.466787 (+ 727us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:17:03.466804 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:17:03.468443 (+ 1639us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:17:03.470598 (+ 2155us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:17:03.470603 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:17:03.470616 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:17:03.470905 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:17:03.471223 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:17:03.471226 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:17:03.471227 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:17:03.471377 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:17:03.471868 (+ 491us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:17:03.471878 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:17:03.472157 (+ 279us) client_negotiation.cc:769] Sending connection context
0923 17:17:03.472363 (+ 206us) client_negotiation.cc:240] Negotiation successful
0923 17:17:03.472737 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":578,"thread_start_us":160,"threads_started":1}
I20260923 17:17:03.475162 27798 heartbeater.cc:347] Connected to a master server at 127.11.229.190:36279
I20260923 17:17:03.475435 27798 heartbeater.cc:464] Registering TS with master...
I20260923 17:17:03.475977 27798 heartbeater.cc:511] Master 127.11.229.190:36279 requested a full tablet report, sending...
I20260923 17:17:03.477685 27607 ts_manager.cc:194] Registered new tserver with Master: 26358176962d45319c4c4c34d54a6fc5 (127.11.229.129:38399)
I20260923 17:17:03.478981 27607 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.129@KRBTEST.COM'} at 127.11.229.129:51427
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab.
Entry for principal kudu/127.11.229.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab.
I20260923 17:17:03.491852 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.130:0
--local_ip_for_outbound_sockets=127.11.229.130
--webserver_interface=127.11.229.130
--webserver_port=0
--tserver_master_addrs=127.11.229.190:36279
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab
--principal=kudu/127.11.229.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:35505
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:17:03.620720 27803 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:17:03.620977 27803 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:17:03.621021 27803 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:17:03.625337 27803 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:17:03.625406 27803 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:17:03.625489 27803 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.130
I20260923 17:17:03.631033 27803 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:35505
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab
--principal=kudu/127.11.229.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.229.130
--webserver_port=0
--tserver_master_addrs=127.11.229.190:36279
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27803
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.130
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:17:03.632066 27803 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:17:03.633054 27803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:17:03.642539 27811 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:17:03.642526 27809 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:17:03.642740 27808 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:17:03.642980 27803 server_base.cc:1034] running on GCE node
I20260923 17:17:03.643381 27803 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:17:03.644011 27803 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:17:03.645232 27803 hybrid_clock.cc:648] HybridClock initialized: now 1790183823645207 us; error 55 us; skew 500 ppm
Sep 23 17:17:03 dist-test-slave-1x1f krb5kdc[27562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183823, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:17:03.647920 27803 init.cc:377] Logged in from keytab as kudu/127.11.229.130@KRBTEST.COM (short username kudu)
I20260923 17:17:03.648845 27803 webserver.cc:460] Webserver started at http://127.11.229.130:45077/ using document root <none> and password file <none>
I20260923 17:17:03.649406 27803 fs_manager.cc:359] Metadata directory not provided
I20260923 17:17:03.649493 27803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:17:03.649714 27803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:17:03.651796 27803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-1/data/instance:
uuid: "423661b82bab474c87565961f49ac5c3"
format_stamp: "Formatted at 2026-09-23 17:17:03 on dist-test-slave-1x1f"
server_key: "3a7fb2a19b17f72ad1ba3254ffdf3aa2"
server_key_iv: "cf00c1517cf52cbfe36b98964fc079e9"
server_key_version: "encryptionkey@0"
I20260923 17:17:03.652379 27803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance:
uuid: "423661b82bab474c87565961f49ac5c3"
format_stamp: "Formatted at 2026-09-23 17:17:03 on dist-test-slave-1x1f"
server_key: "3a7fb2a19b17f72ad1ba3254ffdf3aa2"
server_key_iv: "cf00c1517cf52cbfe36b98964fc079e9"
server_key_version: "encryptionkey@0"
I20260923 17:17:03.656105 27803 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.002s
I20260923 17:17:03.658550 27818 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:17:03.659735 27803 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260923 17:17:03.659869 27803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-1/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-1/wal
uuid: "423661b82bab474c87565961f49ac5c3"
format_stamp: "Formatted at 2026-09-23 17:17:03 on dist-test-slave-1x1f"
server_key: "3a7fb2a19b17f72ad1ba3254ffdf3aa2"
server_key_iv: "cf00c1517cf52cbfe36b98964fc079e9"
server_key_version: "encryptionkey@0"
I20260923 17:17:03.659983 27803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:17:03.682763 27803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:17:03.685737 27803 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:17:03.685931 27803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:17:03.686573 27803 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:17:03.687403 27803 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:17:03.687472 27803 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:17:03.687542 27803 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:17:03.687583 27803 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:17:03.697180 27803 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.130:45883
I20260923 17:17:03.697201 27931 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.130:45883 every 8 connection(s)
I20260923 17:17:03.698436 27803 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
I20260923 17:17:03.701201 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 27803
I20260923 17:17:03.701339 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance
I20260923 17:17:03.701673 12182 external_mini_cluster.cc:1428] Setting key 1055988bb13ddd00fb90187ed5f51088
Sep 23 17:17:03 dist-test-slave-1x1f krb5kdc[27562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183823, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.130@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.229.131@KRBTEST.COM; defaulting to no policy
I20260923 17:17:03.713364 27646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:03.700533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:53557 (local address 127.11.229.190:36279)
0923 17:17:03.700679 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0923 17:17:03.700684 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:17:03.701981 (+ 1297us) server_negotiation.cc:407] Connection header received
0923 17:17:03.703019 (+ 1038us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:17:03.703022 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:17:03.703071 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:17:03.703143 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:17:03.704264 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:03.705153 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:03.706976 (+ 1823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:03.707204 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:03.707374 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:17:03.709814 (+ 2440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:17:03.709818 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:17:03.709820 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:17:03.709854 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:17:03.711359 (+ 1505us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:17:03.711858 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:17:03.711863 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:17:03.711865 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:17:03.711945 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:17:03.712303 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:17:03.712307 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:17:03.712309 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:17:03.712488 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:17:03.712594 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0923 17:17:03.713077 (+ 483us) server_negotiation.cc:299] Negotiation successful
0923 17:17:03.713200 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.131@KRBTEST.COM" created.
I20260923 17:17:03.714318 27934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:03.700941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.130:53557)
0923 17:17:03.701840 (+ 899us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:03.701886 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0923 17:17:03.702826 (+ 940us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:17:03.703318 (+ 492us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:17:03.703325 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:17:03.703666 (+ 341us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:17:03.704125 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:17:03.704138 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:17:03.705292 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:17:03.705295 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:17:03.706849 (+ 1554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:17:03.706864 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:17:03.707414 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:17:03.707419 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:17:03.707594 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:17:03.708209 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:17:03.708225 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:17:03.709632 (+ 1407us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:17:03.711474 (+ 1842us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:17:03.711480 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:17:03.711497 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:17:03.711752 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:17:03.712044 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:17:03.712047 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:17:03.712049 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:17:03.712189 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:17:03.712594 (+ 405us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:17:03.712600 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:17:03.712845 (+ 245us) client_negotiation.cc:769] Sending connection context
0923 17:17:03.713036 (+ 191us) client_negotiation.cc:240] Negotiation successful
0923 17:17:03.713367 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":664,"thread_start_us":200,"threads_started":1}
I20260923 17:17:03.715598 27932 heartbeater.cc:347] Connected to a master server at 127.11.229.190:36279
I20260923 17:17:03.715852 27932 heartbeater.cc:464] Registering TS with master...
I20260923 17:17:03.716323 27932 heartbeater.cc:511] Master 127.11.229.190:36279 requested a full tablet report, sending...
I20260923 17:17:03.717374 27607 ts_manager.cc:194] Registered new tserver with Master: 423661b82bab474c87565961f49ac5c3 (127.11.229.130:45883)
I20260923 17:17:03.718288 27607 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.130@KRBTEST.COM'} at 127.11.229.130:53557
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab.
Entry for principal kudu/127.11.229.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab.
I20260923 17:17:03.735523 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.131:0
--local_ip_for_outbound_sockets=127.11.229.131
--webserver_interface=127.11.229.131
--webserver_port=0
--tserver_master_addrs=127.11.229.190:36279
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab
--principal=kudu/127.11.229.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:35505
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:17:03.847625 27937 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:17:03.847915 27937 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:17:03.847961 27937 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:17:03.852190 27937 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:17:03.852257 27937 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:17:03.852334 27937 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.131
I20260923 17:17:03.858067 27937 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:35505
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab
--principal=kudu/127.11.229.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.229.131
--webserver_port=0
--tserver_master_addrs=127.11.229.190:36279
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27937
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.131
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:17:03.859189 27937 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:17:03.860155 27937 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:17:03.869800 27942 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:17:03.869763 27945 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:17:03.869763 27943 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:17:03.870164 27937 server_base.cc:1034] running on GCE node
I20260923 17:17:03.870657 27937 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:17:03.871440 27937 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:17:03.872670 27937 hybrid_clock.cc:648] HybridClock initialized: now 1790183823872647 us; error 34 us; skew 500 ppm
Sep 23 17:17:03 dist-test-slave-1x1f krb5kdc[27562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183823, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:17:03.875483 27937 init.cc:377] Logged in from keytab as kudu/127.11.229.131@KRBTEST.COM (short username kudu)
I20260923 17:17:03.876338 27937 webserver.cc:460] Webserver started at http://127.11.229.131:44383/ using document root <none> and password file <none>
I20260923 17:17:03.876922 27937 fs_manager.cc:359] Metadata directory not provided
I20260923 17:17:03.876984 27937 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:17:03.877223 27937 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:17:03.879334 27937 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-2/data/instance:
uuid: "c901e423907a457b8b547e20a43cc375"
format_stamp: "Formatted at 2026-09-23 17:17:03 on dist-test-slave-1x1f"
server_key: "6a57eac7997317e1c1408981fec37005"
server_key_iv: "65f34e9ec94a6da1cbcda2ea3f50bc58"
server_key_version: "encryptionkey@0"
I20260923 17:17:03.879890 27937 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance:
uuid: "c901e423907a457b8b547e20a43cc375"
format_stamp: "Formatted at 2026-09-23 17:17:03 on dist-test-slave-1x1f"
server_key: "6a57eac7997317e1c1408981fec37005"
server_key_iv: "65f34e9ec94a6da1cbcda2ea3f50bc58"
server_key_version: "encryptionkey@0"
I20260923 17:17:03.883658 27937 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260923 17:17:03.886201 27952 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:17:03.887569 27937 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260923 17:17:03.887712 27937 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-2/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-2/wal
uuid: "c901e423907a457b8b547e20a43cc375"
format_stamp: "Formatted at 2026-09-23 17:17:03 on dist-test-slave-1x1f"
server_key: "6a57eac7997317e1c1408981fec37005"
server_key_iv: "65f34e9ec94a6da1cbcda2ea3f50bc58"
server_key_version: "encryptionkey@0"
I20260923 17:17:03.887887 27937 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:17:03.909276 27937 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:17:03.912489 27937 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:17:03.912694 27937 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:17:03.913292 27937 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:17:03.914127 27937 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:17:03.914214 27937 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:17:03.914310 27937 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:17:03.914366 27937 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:17:03.923758 27937 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.131:35229
I20260923 17:17:03.923779 28065 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.131:35229 every 8 connection(s)
I20260923 17:17:03.924676 27937 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
I20260923 17:17:03.932449 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 27937
I20260923 17:17:03.932586 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance
I20260923 17:17:03.932940 12182 external_mini_cluster.cc:1428] Setting key 407dc0edb3593dcbeb6aa3abd4e95a2f
Sep 23 17:17:03 dist-test-slave-1x1f krb5kdc[27562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183823, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.131@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:17:03.939404 27646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:03.926650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:36061 (local address 127.11.229.190:36279)
0923 17:17:03.926788 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0923 17:17:03.926792 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:17:03.927745 (+ 953us) server_negotiation.cc:407] Connection header received
0923 17:17:03.929060 (+ 1315us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:17:03.929064 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:17:03.929114 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:17:03.929181 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:17:03.930605 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:03.931140 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:03.932289 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:03.932648 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:03.932777 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:17:03.935936 (+ 3159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:17:03.935940 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:17:03.935943 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:17:03.935972 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:17:03.937203 (+ 1231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:17:03.937795 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:17:03.937798 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:17:03.937800 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:17:03.937888 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:17:03.938271 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:17:03.938274 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:17:03.938276 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:17:03.938468 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:17:03.938580 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0923 17:17:03.939093 (+ 513us) server_negotiation.cc:299] Negotiation successful
0923 17:17:03.939232 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260923 17:17:03.940254 28068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:03.926904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.131:36061)
0923 17:17:03.927589 (+ 685us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:03.927632 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0923 17:17:03.928740 (+ 1108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:17:03.929401 (+ 661us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:17:03.929408 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:17:03.929787 (+ 379us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:17:03.930454 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:17:03.930478 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:17:03.931258 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:17:03.931261 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:17:03.932157 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:17:03.932166 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:17:03.932839 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:17:03.932842 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:17:03.933068 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:17:03.933841 (+ 773us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:17:03.933860 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:17:03.935767 (+ 1907us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:17:03.937394 (+ 1627us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:17:03.937400 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:17:03.937415 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:17:03.937677 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:17:03.937987 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:17:03.937990 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:17:03.937992 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:17:03.938137 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:17:03.938576 (+ 439us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:17:03.938583 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:17:03.938852 (+ 269us) client_negotiation.cc:769] Sending connection context
0923 17:17:03.939037 (+ 185us) client_negotiation.cc:240] Negotiation successful
0923 17:17:03.939371 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":502,"thread_start_us":125,"threads_started":1}
I20260923 17:17:03.941505 28066 heartbeater.cc:347] Connected to a master server at 127.11.229.190:36279
I20260923 17:17:03.941772 28066 heartbeater.cc:464] Registering TS with master...
I20260923 17:17:03.942341 28066 heartbeater.cc:511] Master 127.11.229.190:36279 requested a full tablet report, sending...
I20260923 17:17:03.943403 27607 ts_manager.cc:194] Registered new tserver with Master: c901e423907a457b8b547e20a43cc375 (127.11.229.131:35229)
I20260923 17:17:03.943948 27607 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.131@KRBTEST.COM'} at 127.11.229.131:36061
I20260923 17:17:03.947242 12182 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 17:17:03.956969 27646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:03.949245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58840 (local address 127.11.229.190:36279)
0923 17:17:03.949409 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0923 17:17:03.949412 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 17:17:03.949511 (+ 99us) server_negotiation.cc:407] Connection header received
0923 17:17:03.949621 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:17:03.949623 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:17:03.949659 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:17:03.949725 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:17:03.950526 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:03.951035 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:03.951893 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:03.952101 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:03.952193 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:17:03.953595 (+ 1402us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:17:03.953598 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:17:03.953600 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:17:03.953622 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:17:03.955024 (+ 1402us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:17:03.955637 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:17:03.955640 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:17:03.955641 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:17:03.955741 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:17:03.956037 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:17:03.956040 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:17:03.956041 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:17:03.956249 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:17:03.956350 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0923 17:17:03.956546 (+ 196us) server_negotiation.cc:299] Negotiation successful
0923 17:17:03.956640 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260923 17:17:03.959959 27607 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58840:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 17:17:03.963037 27607 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 17:17:03.977854 28082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:03.972189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35948 (local address 127.11.229.130:45883)
0923 17:17:03.972657 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0923 17:17:03.972666 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 17:17:03.972708 (+ 42us) server_negotiation.cc:407] Connection header received
0923 17:17:03.972784 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:17:03.972792 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:17:03.973009 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:17:03.973158 (+ 149us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:17:03.973585 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:03.974825 (+ 1240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:03.976548 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:03.977159 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:03.977361 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:17:03.977499 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0923 17:17:03.977584 (+ 85us) server_negotiation.cc:299] Negotiation successful
0923 17:17:03.977671 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":364,"thread_start_us":148,"threads_started":1}
I20260923 17:17:03.977839 28080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:03.971517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.130:45883 (local address 127.0.0.1:35948)
0923 17:17:03.972193 (+ 676us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:03.972241 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0923 17:17:03.972381 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:17:03.973320 (+ 939us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:17:03.973323 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:17:03.973341 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:17:03.973438 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:17:03.973442 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:17:03.975055 (+ 1613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:17:03.975059 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:17:03.976405 (+ 1346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:17:03.976415 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:17:03.977288 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:17:03.977291 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:17:03.977407 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:17:03.977444 (+ 37us) client_negotiation.cc:769] Sending connection context
0923 17:17:03.977558 (+ 114us) client_negotiation.cc:240] Negotiation successful
0923 17:17:03.977672 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":564,"mutex_wait_us":31,"spinlock_wait_cycles":8576,"thread_start_us":95,"threads_started":1}
I20260923 17:17:03.978504 28077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:03.971444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.131:35229 (local address 127.0.0.1:36682)
0923 17:17:03.972192 (+ 748us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:03.972240 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0923 17:17:03.972382 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:17:03.973522 (+ 1140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:17:03.973527 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:17:03.973545 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:17:03.973639 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:17:03.973645 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:17:03.974770 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:17:03.974776 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:17:03.976557 (+ 1781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:17:03.976564 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:17:03.977812 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:17:03.977820 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:17:03.978032 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:17:03.978093 (+ 61us) client_negotiation.cc:769] Sending connection context
0923 17:17:03.978187 (+ 94us) client_negotiation.cc:240] Negotiation successful
0923 17:17:03.978317 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":586,"mutex_wait_us":168,"spinlock_wait_cycles":3456,"thread_start_us":78,"threads_started":1}
I20260923 17:17:03.978504 28078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:03.971783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:38399 (local address 127.0.0.1:37082)
0923 17:17:03.972611 (+ 828us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:03.972624 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 17:17:03.972730 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:17:03.973239 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:17:03.973245 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:17:03.973268 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:17:03.973403 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:17:03.973410 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:17:03.975004 (+ 1594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:17:03.975007 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:17:03.976388 (+ 1381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:17:03.976398 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:17:03.977852 (+ 1454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:17:03.977855 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:17:03.978034 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:17:03.978099 (+ 65us) client_negotiation.cc:769] Sending connection context
0923 17:17:03.978180 (+ 81us) client_negotiation.cc:240] Negotiation successful
0923 17:17:03.978317 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":775,"mutex_wait_us":205,"thread_start_us":103,"threads_started":1}
I20260923 17:17:03.979142 28081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:03.972057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37082 (local address 127.11.229.129:38399)
0923 17:17:03.972476 (+ 419us) server_negotiation.cc:206] Beginning negotiation
0923 17:17:03.972491 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0923 17:17:03.972719 (+ 228us) server_negotiation.cc:407] Connection header received
0923 17:17:03.972833 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:17:03.972837 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:17:03.973008 (+ 171us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:17:03.973158 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:17:03.973770 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:03.974912 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:03.976534 (+ 1622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:03.977491 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:03.977632 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:17:03.977797 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0923 17:17:03.978853 (+ 1056us) server_negotiation.cc:299] Negotiation successful
0923 17:17:03.978976 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":313,"thread_start_us":103,"threads_started":1}
I20260923 17:17:03.979573 28079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:03.971550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36682 (local address 127.11.229.131:35229)
0923 17:17:03.972957 (+ 1407us) server_negotiation.cc:206] Beginning negotiation
0923 17:17:03.972971 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0923 17:17:03.973091 (+ 120us) server_negotiation.cc:407] Connection header received
0923 17:17:03.973172 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:17:03.973180 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:17:03.973389 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:17:03.973532 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:17:03.973743 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:03.974638 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:03.976691 (+ 2053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:03.977648 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:03.979181 (+ 1533us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:17:03.979322 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0923 17:17:03.979377 (+ 55us) server_negotiation.cc:299] Negotiation successful
0923 17:17:03.979458 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1307,"thread_start_us":110,"threads_started":1}
I20260923 17:17:03.981299 27866 tablet_service.cc:1467] Processing CreateTablet for tablet 11666cc1d4a94cbea12c9d6096cd0ce6 (DEFAULT_TABLE table=test-table [id=027d15e267ba42b8b5ac84be39c76515]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:17:03.982487 27866 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11666cc1d4a94cbea12c9d6096cd0ce6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:17:03.982143 28000 tablet_service.cc:1467] Processing CreateTablet for tablet 11666cc1d4a94cbea12c9d6096cd0ce6 (DEFAULT_TABLE table=test-table [id=027d15e267ba42b8b5ac84be39c76515]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:17:03.983144 28000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11666cc1d4a94cbea12c9d6096cd0ce6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:17:03.984107 27732 tablet_service.cc:1467] Processing CreateTablet for tablet 11666cc1d4a94cbea12c9d6096cd0ce6 (DEFAULT_TABLE table=test-table [id=027d15e267ba42b8b5ac84be39c76515]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:17:03.984877 27732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11666cc1d4a94cbea12c9d6096cd0ce6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:17:03.990118 28083 tablet_bootstrap.cc:492] T 11666cc1d4a94cbea12c9d6096cd0ce6 P c901e423907a457b8b547e20a43cc375: Bootstrap starting.
I20260923 17:17:03.991174 28084 tablet_bootstrap.cc:492] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 423661b82bab474c87565961f49ac5c3: Bootstrap starting.
I20260923 17:17:03.991562 28085 tablet_bootstrap.cc:492] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 26358176962d45319c4c4c34d54a6fc5: Bootstrap starting.
I20260923 17:17:03.993534 28085 tablet_bootstrap.cc:654] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 26358176962d45319c4c4c34d54a6fc5: Neither blocks nor log segments found. Creating new log.
I20260923 17:17:03.993916 28084 tablet_bootstrap.cc:654] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 423661b82bab474c87565961f49ac5c3: Neither blocks nor log segments found. Creating new log.
I20260923 17:17:03.994369 28085 log.cc:824] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 26358176962d45319c4c4c34d54a6fc5: Log is configured to *not* fsync() on all Append() calls
I20260923 17:17:03.994791 28084 log.cc:824] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 423661b82bab474c87565961f49ac5c3: Log is configured to *not* fsync() on all Append() calls
I20260923 17:17:03.996402 28085 tablet_bootstrap.cc:492] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 26358176962d45319c4c4c34d54a6fc5: No bootstrap required, opened a new log
I20260923 17:17:03.996562 28084 tablet_bootstrap.cc:492] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 423661b82bab474c87565961f49ac5c3: No bootstrap required, opened a new log
I20260923 17:17:03.996613 28085 ts_tablet_manager.cc:1397] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 26358176962d45319c4c4c34d54a6fc5: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.003s
I20260923 17:17:03.996781 28084 ts_tablet_manager.cc:1397] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 423661b82bab474c87565961f49ac5c3: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260923 17:17:03.997119 28083 tablet_bootstrap.cc:654] T 11666cc1d4a94cbea12c9d6096cd0ce6 P c901e423907a457b8b547e20a43cc375: Neither blocks nor log segments found. Creating new log.
I20260923 17:17:03.998301 28083 log.cc:824] T 11666cc1d4a94cbea12c9d6096cd0ce6 P c901e423907a457b8b547e20a43cc375: Log is configured to *not* fsync() on all Append() calls
I20260923 17:17:04.000039 28083 tablet_bootstrap.cc:492] T 11666cc1d4a94cbea12c9d6096cd0ce6 P c901e423907a457b8b547e20a43cc375: No bootstrap required, opened a new log
I20260923 17:17:04.000244 28083 ts_tablet_manager.cc:1397] T 11666cc1d4a94cbea12c9d6096cd0ce6 P c901e423907a457b8b547e20a43cc375: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.000s
I20260923 17:17:04.000893 28084 raft_consensus.cc:348] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 423661b82bab474c87565961f49ac5c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c901e423907a457b8b547e20a43cc375" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 35229 } } peers { permanent_uuid: "423661b82bab474c87565961f49ac5c3" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 45883 } } peers { permanent_uuid: "26358176962d45319c4c4c34d54a6fc5" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38399 } }
I20260923 17:17:04.001194 28084 raft_consensus.cc:374] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 423661b82bab474c87565961f49ac5c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:17:04.001291 28084 raft_consensus.cc:729] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 423661b82bab474c87565961f49ac5c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 423661b82bab474c87565961f49ac5c3, State: Initialized, Role: FOLLOWER
I20260923 17:17:04.001384 28085 raft_consensus.cc:348] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 26358176962d45319c4c4c34d54a6fc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c901e423907a457b8b547e20a43cc375" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 35229 } } peers { permanent_uuid: "423661b82bab474c87565961f49ac5c3" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 45883 } } peers { permanent_uuid: "26358176962d45319c4c4c34d54a6fc5" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38399 } }
I20260923 17:17:04.001715 28085 raft_consensus.cc:374] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 26358176962d45319c4c4c34d54a6fc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:17:04.001814 28085 raft_consensus.cc:729] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 26358176962d45319c4c4c34d54a6fc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26358176962d45319c4c4c34d54a6fc5, State: Initialized, Role: FOLLOWER
I20260923 17:17:04.001794 28084 consensus_queue.cc:260] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 423661b82bab474c87565961f49ac5c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c901e423907a457b8b547e20a43cc375" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 35229 } } peers { permanent_uuid: "423661b82bab474c87565961f49ac5c3" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 45883 } } peers { permanent_uuid: "26358176962d45319c4c4c34d54a6fc5" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38399 } }
I20260923 17:17:04.002306 28085 consensus_queue.cc:260] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 26358176962d45319c4c4c34d54a6fc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c901e423907a457b8b547e20a43cc375" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 35229 } } peers { permanent_uuid: "423661b82bab474c87565961f49ac5c3" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 45883 } } peers { permanent_uuid: "26358176962d45319c4c4c34d54a6fc5" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38399 } }
I20260923 17:17:04.002521 27932 heartbeater.cc:503] Master 127.11.229.190:36279 was elected leader, sending a full tablet report...
I20260923 17:17:04.002889 28084 ts_tablet_manager.cc:1428] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 423661b82bab474c87565961f49ac5c3: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260923 17:17:04.002979 27798 heartbeater.cc:503] Master 127.11.229.190:36279 was elected leader, sending a full tablet report...
I20260923 17:17:04.004192 28085 ts_tablet_manager.cc:1428] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 26358176962d45319c4c4c34d54a6fc5: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260923 17:17:04.006244 28083 raft_consensus.cc:348] T 11666cc1d4a94cbea12c9d6096cd0ce6 P c901e423907a457b8b547e20a43cc375 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c901e423907a457b8b547e20a43cc375" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 35229 } } peers { permanent_uuid: "423661b82bab474c87565961f49ac5c3" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 45883 } } peers { permanent_uuid: "26358176962d45319c4c4c34d54a6fc5" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38399 } }
I20260923 17:17:04.006510 28083 raft_consensus.cc:374] T 11666cc1d4a94cbea12c9d6096cd0ce6 P c901e423907a457b8b547e20a43cc375 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:17:04.006562 28083 raft_consensus.cc:729] T 11666cc1d4a94cbea12c9d6096cd0ce6 P c901e423907a457b8b547e20a43cc375 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c901e423907a457b8b547e20a43cc375, State: Initialized, Role: FOLLOWER
I20260923 17:17:04.007022 28083 consensus_queue.cc:260] T 11666cc1d4a94cbea12c9d6096cd0ce6 P c901e423907a457b8b547e20a43cc375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c901e423907a457b8b547e20a43cc375" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 35229 } } peers { permanent_uuid: "423661b82bab474c87565961f49ac5c3" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 45883 } } peers { permanent_uuid: "26358176962d45319c4c4c34d54a6fc5" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38399 } }
I20260923 17:17:04.007643 28066 heartbeater.cc:503] Master 127.11.229.190:36279 was elected leader, sending a full tablet report...
I20260923 17:17:04.008798 28083 ts_tablet_manager.cc:1428] T 11666cc1d4a94cbea12c9d6096cd0ce6 P c901e423907a457b8b547e20a43cc375: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260923 17:17:04.009272 28090 raft_consensus.cc:482] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 26358176962d45319c4c4c34d54a6fc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 17:17:04.009457 28090 raft_consensus.cc:504] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 26358176962d45319c4c4c34d54a6fc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c901e423907a457b8b547e20a43cc375" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 35229 } } peers { permanent_uuid: "423661b82bab474c87565961f49ac5c3" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 45883 } } peers { permanent_uuid: "26358176962d45319c4c4c34d54a6fc5" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38399 } }
I20260923 17:17:04.010617 28090 leader_election.cc:288] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 26358176962d45319c4c4c34d54a6fc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c901e423907a457b8b547e20a43cc375 (127.11.229.131:35229), 423661b82bab474c87565961f49ac5c3 (127.11.229.130:45883)
I20260923 17:17:04.016119 28079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:04.011174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:33559 (local address 127.11.229.131:35229)
0923 17:17:04.011265 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0923 17:17:04.011269 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:17:04.011528 (+ 259us) server_negotiation.cc:407] Connection header received
0923 17:17:04.011628 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:17:04.011630 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:17:04.011668 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:17:04.011739 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:17:04.012006 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:04.012718 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:04.014696 (+ 1978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:04.015287 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:04.015392 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:17:04.015443 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0923 17:17:04.015902 (+ 459us) server_negotiation.cc:299] Negotiation successful
0923 17:17:04.015982 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260923 17:17:04.016130 28082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:04.011015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:60429 (local address 127.11.229.130:45883)
0923 17:17:04.011134 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0923 17:17:04.011138 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:17:04.011306 (+ 168us) server_negotiation.cc:407] Connection header received
0923 17:17:04.011447 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:17:04.011450 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:17:04.011489 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:17:04.011592 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:17:04.011898 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:04.012687 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:04.014614 (+ 1927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:04.015273 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:04.015392 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:17:04.015443 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0923 17:17:04.015897 (+ 454us) server_negotiation.cc:299] Negotiation successful
0923 17:17:04.015982 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260923 17:17:04.016172 28093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:04.010797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.131:35229 (local address 127.11.229.129:33559)
0923 17:17:04.011443 (+ 646us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:04.011455 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 17:17:04.011539 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:17:04.011766 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:17:04.011769 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:17:04.011783 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:17:04.011909 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:17:04.011914 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:17:04.012830 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:17:04.012833 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:17:04.014404 (+ 1571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:17:04.014415 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:17:04.015414 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:17:04.015417 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:17:04.015635 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:17:04.015748 (+ 113us) client_negotiation.cc:769] Sending connection context
0923 17:17:04.015828 (+ 80us) client_negotiation.cc:240] Negotiation successful
0923 17:17:04.015974 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":574,"mutex_wait_us":486,"thread_start_us":80,"threads_started":1}
I20260923 17:17:04.016172 28092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:04.010800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.130:45883 (local address 127.11.229.129:60429)
0923 17:17:04.011225 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:04.011242 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 17:17:04.011354 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:17:04.011613 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:17:04.011617 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:17:04.011633 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:17:04.011785 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:17:04.011793 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:17:04.012830 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:17:04.012833 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:17:04.014447 (+ 1614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:17:04.014457 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:17:04.015414 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:17:04.015418 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:17:04.015633 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:17:04.015750 (+ 117us) client_negotiation.cc:769] Sending connection context
0923 17:17:04.015828 (+ 78us) client_negotiation.cc:240] Negotiation successful
0923 17:17:04.015974 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"mutex_wait_us":234,"thread_start_us":97,"threads_started":1}
I20260923 17:17:04.016858 28020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11666cc1d4a94cbea12c9d6096cd0ce6" candidate_uuid: "26358176962d45319c4c4c34d54a6fc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c901e423907a457b8b547e20a43cc375" is_pre_election: true
I20260923 17:17:04.017167 27886 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11666cc1d4a94cbea12c9d6096cd0ce6" candidate_uuid: "26358176962d45319c4c4c34d54a6fc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "423661b82bab474c87565961f49ac5c3" is_pre_election: true
I20260923 17:17:04.017189 28020 raft_consensus.cc:2454] T 11666cc1d4a94cbea12c9d6096cd0ce6 P c901e423907a457b8b547e20a43cc375 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26358176962d45319c4c4c34d54a6fc5 in term 0.
I20260923 17:17:04.017413 27886 raft_consensus.cc:2454] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 423661b82bab474c87565961f49ac5c3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26358176962d45319c4c4c34d54a6fc5 in term 0.
I20260923 17:17:04.017768 27688 leader_election.cc:302] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 26358176962d45319c4c4c34d54a6fc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26358176962d45319c4c4c34d54a6fc5, c901e423907a457b8b547e20a43cc375; no voters:
I20260923 17:17:04.018086 28090 raft_consensus.cc:2781] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 26358176962d45319c4c4c34d54a6fc5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 17:17:04.018168 28090 raft_consensus.cc:482] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 26358176962d45319c4c4c34d54a6fc5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 17:17:04.018198 28090 raft_consensus.cc:3037] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 26358176962d45319c4c4c34d54a6fc5 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:17:04.019245 28090 raft_consensus.cc:504] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 26358176962d45319c4c4c34d54a6fc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c901e423907a457b8b547e20a43cc375" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 35229 } } peers { permanent_uuid: "423661b82bab474c87565961f49ac5c3" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 45883 } } peers { permanent_uuid: "26358176962d45319c4c4c34d54a6fc5" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38399 } }
I20260923 17:17:04.019608 28090 leader_election.cc:288] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 26358176962d45319c4c4c34d54a6fc5 [CANDIDATE]: Term 1 election: Requested vote from peers c901e423907a457b8b547e20a43cc375 (127.11.229.131:35229), 423661b82bab474c87565961f49ac5c3 (127.11.229.130:45883)
I20260923 17:17:04.019966 28020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11666cc1d4a94cbea12c9d6096cd0ce6" candidate_uuid: "26358176962d45319c4c4c34d54a6fc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c901e423907a457b8b547e20a43cc375"
I20260923 17:17:04.020092 27886 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11666cc1d4a94cbea12c9d6096cd0ce6" candidate_uuid: "26358176962d45319c4c4c34d54a6fc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "423661b82bab474c87565961f49ac5c3"
I20260923 17:17:04.020109 28020 raft_consensus.cc:3037] T 11666cc1d4a94cbea12c9d6096cd0ce6 P c901e423907a457b8b547e20a43cc375 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:17:04.020241 27886 raft_consensus.cc:3037] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 423661b82bab474c87565961f49ac5c3 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:17:04.021214 28020 raft_consensus.cc:2454] T 11666cc1d4a94cbea12c9d6096cd0ce6 P c901e423907a457b8b547e20a43cc375 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26358176962d45319c4c4c34d54a6fc5 in term 1.
I20260923 17:17:04.021226 27886 raft_consensus.cc:2454] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 423661b82bab474c87565961f49ac5c3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26358176962d45319c4c4c34d54a6fc5 in term 1.
I20260923 17:17:04.021543 27688 leader_election.cc:302] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 26358176962d45319c4c4c34d54a6fc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26358176962d45319c4c4c34d54a6fc5, c901e423907a457b8b547e20a43cc375; no voters:
I20260923 17:17:04.021744 28090 raft_consensus.cc:2781] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 26358176962d45319c4c4c34d54a6fc5 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:17:04.021965 28090 raft_consensus.cc:686] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 26358176962d45319c4c4c34d54a6fc5 [term 1 LEADER]: Becoming Leader. State: Replica: 26358176962d45319c4c4c34d54a6fc5, State: Running, Role: LEADER
I20260923 17:17:04.022383 28090 consensus_queue.cc:237] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 26358176962d45319c4c4c34d54a6fc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c901e423907a457b8b547e20a43cc375" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 35229 } } peers { permanent_uuid: "423661b82bab474c87565961f49ac5c3" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 45883 } } peers { permanent_uuid: "26358176962d45319c4c4c34d54a6fc5" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38399 } }
I20260923 17:17:04.025945 27607 catalog_manager.cc:5495] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 26358176962d45319c4c4c34d54a6fc5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 26358176962d45319c4c4c34d54a6fc5 (127.11.229.129). New cstate: current_term: 1 leader_uuid: "26358176962d45319c4c4c34d54a6fc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c901e423907a457b8b547e20a43cc375" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 35229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "423661b82bab474c87565961f49ac5c3" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 45883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26358176962d45319c4c4c34d54a6fc5" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38399 } health_report { overall_health: HEALTHY } } }
I20260923 17:17:04.047650 28081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:04.043671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37098 (local address 127.11.229.129:38399)
0923 17:17:04.043800 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0923 17:17:04.043805 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:17:04.043820 (+ 15us) server_negotiation.cc:407] Connection header received
0923 17:17:04.043942 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:17:04.043944 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:17:04.044006 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:17:04.044111 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 17:17:04.044393 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:04.044888 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:04.045875 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:04.046111 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:04.046378 (+ 267us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:17:04.046741 (+ 363us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 17:17:04.047198 (+ 457us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 17:17:04.047339 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0923 17:17:04.047380 (+ 41us) server_negotiation.cc:299] Negotiation successful
0923 17:17:04.047443 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260923 17:17:04.053812 28020 raft_consensus.cc:1261] T 11666cc1d4a94cbea12c9d6096cd0ce6 P c901e423907a457b8b547e20a43cc375 [term 1 FOLLOWER]: Refusing update from remote peer 26358176962d45319c4c4c34d54a6fc5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:17:04.053812 27886 raft_consensus.cc:1261] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 423661b82bab474c87565961f49ac5c3 [term 1 FOLLOWER]: Refusing update from remote peer 26358176962d45319c4c4c34d54a6fc5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:17:04.054615 28094 consensus_queue.cc:1035] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 26358176962d45319c4c4c34d54a6fc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c901e423907a457b8b547e20a43cc375" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 35229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:17:04.054800 28090 consensus_queue.cc:1035] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 26358176962d45319c4c4c34d54a6fc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "423661b82bab474c87565961f49ac5c3" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 45883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:17:04.062960 28097 mvcc.cc:205] Tried to move back new op lower bound from 7332592943316848640 to 7332592943198384128. Current Snapshot: MvccSnapshot[applied={T|T < 7332592943316848640}]
I20260923 17:17:04.073089 27606 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58840:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:17:04.073334 27606 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58840:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:17:04.076150 27606 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13: Sending DeleteTablet for 3 replicas of tablet 11666cc1d4a94cbea12c9d6096cd0ce6
I20260923 17:17:04.077021 27866 tablet_service.cc:1514] Processing DeleteTablet for tablet 11666cc1d4a94cbea12c9d6096cd0ce6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:17:04 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:35948
I20260923 17:17:04.077170 28000 tablet_service.cc:1514] Processing DeleteTablet for tablet 11666cc1d4a94cbea12c9d6096cd0ce6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:17:04 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:36682
I20260923 17:17:04.077270 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 27669
I20260923 17:17:04.078617 28107 tablet_replica.cc:330] T 11666cc1d4a94cbea12c9d6096cd0ce6 P c901e423907a457b8b547e20a43cc375: stopping tablet replica
I20260923 17:17:04.079022 28107 raft_consensus.cc:2229] T 11666cc1d4a94cbea12c9d6096cd0ce6 P c901e423907a457b8b547e20a43cc375 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:17:04.079157 28106 tablet_replica.cc:330] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 423661b82bab474c87565961f49ac5c3: stopping tablet replica
I20260923 17:17:04.079455 28106 raft_consensus.cc:2229] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 423661b82bab474c87565961f49ac5c3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:17:04.079474 28107 raft_consensus.cc:2258] T 11666cc1d4a94cbea12c9d6096cd0ce6 P c901e423907a457b8b547e20a43cc375 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:17:04.079735 28106 raft_consensus.cc:2258] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 423661b82bab474c87565961f49ac5c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:17:04.081171 28106 ts_tablet_manager.cc:1905] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 423661b82bab474c87565961f49ac5c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:17:04.081171 28107 ts_tablet_manager.cc:1905] T 11666cc1d4a94cbea12c9d6096cd0ce6 P c901e423907a457b8b547e20a43cc375: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:17:04.084154 28107 ts_tablet_manager.cc:1918] T 11666cc1d4a94cbea12c9d6096cd0ce6 P c901e423907a457b8b547e20a43cc375: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 17:17:04.084154 28106 ts_tablet_manager.cc:1918] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 423661b82bab474c87565961f49ac5c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 17:17:04.084259 28107 log.cc:1196] T 11666cc1d4a94cbea12c9d6096cd0ce6 P c901e423907a457b8b547e20a43cc375: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-2/wal/wals/11666cc1d4a94cbea12c9d6096cd0ce6
I20260923 17:17:04.084259 28106 log.cc:1196] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 423661b82bab474c87565961f49ac5c3: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-1/wal/wals/11666cc1d4a94cbea12c9d6096cd0ce6
W20260923 17:17:04.084306 27593 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.229.129:38399 (error 108)
I20260923 17:17:04.084594 28107 ts_tablet_manager.cc:1939] T 11666cc1d4a94cbea12c9d6096cd0ce6 P c901e423907a457b8b547e20a43cc375: Deleting consensus metadata
I20260923 17:17:04.084595 28106 ts_tablet_manager.cc:1939] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 423661b82bab474c87565961f49ac5c3: Deleting consensus metadata
I20260923 17:17:04.084583 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 27803
I20260923 17:17:04.086465 27594 catalog_manager.cc:4841] TS c901e423907a457b8b547e20a43cc375 (127.11.229.131:35229): tablet 11666cc1d4a94cbea12c9d6096cd0ce6 (table test-table [id=027d15e267ba42b8b5ac84be39c76515]) successfully deleted
I20260923 17:17:04.086598 28078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:04.086254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:38399 (local address 127.0.0.1:37108)
0923 17:17:04.086369 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:04.086439 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.129:38399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260923 17:17:04.086798 27593 catalog_manager.cc:4584] TS 26358176962d45319c4c4c34d54a6fc5 (127.11.229.129:38399): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 11666cc1d4a94cbea12c9d6096cd0ce6: Network error: Client connection negotiation failed: client connection to 127.11.229.129:38399: connect: Connection refused (error 111)
I20260923 17:17:04.091205 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 27937
I20260923 17:17:04.092242 28078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:04.091432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.130:45883 (local address 127.0.0.1:35962)
0923 17:17:04.092053 (+ 621us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:04.092125 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.130:45883: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":518}
I20260923 17:17:04.096832 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 27575
I20260923 17:17:24.103634 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:36279
--webserver_interface=127.11.229.190
--webserver_port=33075
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:35505
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:36279
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:17:24.214418 28109 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:17:24.214668 28109 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:17:24.214705 28109 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:17:24.218545 28109 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260923 17:17:24.218588 28109 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260923 17:17:24.218609 28109 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260923 17:17:24.218623 28109 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:17:24.218640 28109 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:17:24.218657 28109 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:17:24.218673 28109 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:17:24.218688 28109 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:17:24.223814 28109 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:35505
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:36279
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:36279
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.229.190
--webserver_port=33075
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28109
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:17:24.224759 28109 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:17:24.225684 28109 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:17:24.238581 28118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:17:24.238593 28109 server_base.cc:1034] running on GCE node
W20260923 17:17:24.238590 28116 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:17:24.238596 28115 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:17:24.239385 28109 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:17:24.240574 28109 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:17:24.241779 28109 hybrid_clock.cc:648] HybridClock initialized: now 1790183844241756 us; error 34 us; skew 500 ppm
Sep 23 17:17:24 dist-test-slave-1x1f krb5kdc[27562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183844, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:17:24.250741 28109 init.cc:377] Logged in from keytab as kudu/127.11.229.190@KRBTEST.COM (short username kudu)
I20260923 17:17:24.251636 28109 webserver.cc:460] Webserver started at http://127.11.229.190:33075/ using document root <none> and password file <none>
I20260923 17:17:24.252187 28109 fs_manager.cc:359] Metadata directory not provided
I20260923 17:17:24.252256 28109 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:17:24.256044 28109 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260923 17:17:24.258141 28125 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:17:24.259405 28109 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 17:17:24.259508 28109 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "1a1c758878174c29a8ea96431421db13"
format_stamp: "Formatted at 2026-09-23 17:17:03 on dist-test-slave-1x1f"
server_key: "44938f7212d65a051bdbde8a1fb143f0"
server_key_iv: "4acbf9b95984fd33256fe3650db6b0aa"
server_key_version: "encryptionkey@0"
I20260923 17:17:24.260078 28109 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:17:24.273643 28109 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:17:24.276693 28109 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:17:24.276923 28109 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:17:24.284682 28109 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.190:36279
I20260923 17:17:24.285013 28177 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.190:36279 every 8 connection(s)
I20260923 17:17:24.285827 28109 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:17:24.290548 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 28109
I20260923 17:17:24.290679 28178 sys_catalog.cc:263] Verifying existing consensus state
I20260923 17:17:24.291023 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.129:38399
--local_ip_for_outbound_sockets=127.11.229.129
--tserver_master_addrs=127.11.229.190:36279
--webserver_port=34387
--webserver_interface=127.11.229.129
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab
--principal=kudu/127.11.229.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:35505
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 17:17:24.292560 28178 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13: Bootstrap starting.
I20260923 17:17:24.318629 28178 log.cc:824] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13: Log is configured to *not* fsync() on all Append() calls
I20260923 17:17:24.330317 28178 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260923 17:17:24.330802 28178 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13: Bootstrap complete.
I20260923 17:17:24.336589 28178 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a1c758878174c29a8ea96431421db13" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 36279 } }
I20260923 17:17:24.337129 28178 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a1c758878174c29a8ea96431421db13, State: Initialized, Role: FOLLOWER
I20260923 17:17:24.337733 28178 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a1c758878174c29a8ea96431421db13" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 36279 } }
I20260923 17:17:24.337924 28178 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:17:24.338017 28178 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:17:24.338135 28178 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [term 1 FOLLOWER]: Advancing to term 2
I20260923 17:17:24.340793 28178 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a1c758878174c29a8ea96431421db13" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 36279 } }
I20260923 17:17:24.341167 28178 leader_election.cc:302] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1a1c758878174c29a8ea96431421db13; no voters:
I20260923 17:17:24.341517 28178 leader_election.cc:288] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260923 17:17:24.341675 28182 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [term 2 FOLLOWER]: Leader election won for term 2
I20260923 17:17:24.341959 28182 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [term 2 LEADER]: Becoming Leader. State: Replica: 1a1c758878174c29a8ea96431421db13, State: Running, Role: LEADER
I20260923 17:17:24.342276 28182 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a1c758878174c29a8ea96431421db13" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 36279 } }
I20260923 17:17:24.342852 28178 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:17:24.343123 28184 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1a1c758878174c29a8ea96431421db13. Latest consensus state: current_term: 2 leader_uuid: "1a1c758878174c29a8ea96431421db13" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a1c758878174c29a8ea96431421db13" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 36279 } } }
I20260923 17:17:24.343246 28184 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [sys.catalog]: This master's current role is: LEADER
I20260923 17:17:24.343544 28183 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "1a1c758878174c29a8ea96431421db13" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a1c758878174c29a8ea96431421db13" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 36279 } } }
I20260923 17:17:24.343621 28183 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [sys.catalog]: This master's current role is: LEADER
I20260923 17:17:24.343655 28186 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:17:24.348690 28186 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:17:24.349634 28186 catalog_manager.cc:1259] Loaded cluster ID: 22ed4c47d61a4d62810a8152b4eff9d6
I20260923 17:17:24.349695 28186 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:17:24.352164 28186 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:17:24.352867 28186 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13: Loaded TSK: 0
I20260923 17:17:24.366581 28186 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13: Generated new TSK 1
I20260923 17:17:24.366851 28186 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260923 17:17:24.425439 28180 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:17:24.425737 28180 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:17:24.425813 28180 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:17:24.429977 28180 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:17:24.430069 28180 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:17:24.430162 28180 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.129
I20260923 17:17:24.435585 28180 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:35505
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab
--principal=kudu/127.11.229.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.129:38399
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.229.129
--webserver_port=34387
--tserver_master_addrs=127.11.229.190:36279
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28180
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.129
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:17:24.436586 28180 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:17:24.437654 28180 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:17:24.448464 28208 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:17:24.448621 28206 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:17:24.448793 28180 server_base.cc:1034] running on GCE node
W20260923 17:17:24.448477 28205 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:17:24.449265 28180 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:17:24.449945 28180 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:17:24.451149 28180 hybrid_clock.cc:648] HybridClock initialized: now 1790183844451129 us; error 38 us; skew 500 ppm
Sep 23 17:17:24 dist-test-slave-1x1f krb5kdc[27562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183844, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:17:24.454008 28180 init.cc:377] Logged in from keytab as kudu/127.11.229.129@KRBTEST.COM (short username kudu)
I20260923 17:17:24.455046 28180 webserver.cc:460] Webserver started at http://127.11.229.129:34387/ using document root <none> and password file <none>
I20260923 17:17:24.455621 28180 fs_manager.cc:359] Metadata directory not provided
I20260923 17:17:24.455695 28180 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:17:24.459929 28180 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260923 17:17:24.462278 28215 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:17:24.463658 28180 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 17:17:24.463804 28180 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-0/wal
uuid: "26358176962d45319c4c4c34d54a6fc5"
format_stamp: "Formatted at 2026-09-23 17:17:03 on dist-test-slave-1x1f"
server_key: "d3d58befc684202d7afff505cd01d688"
server_key_iv: "341c9e25f50e17a49ee23fa3d4b0db6a"
server_key_version: "encryptionkey@0"
I20260923 17:17:24.464414 28180 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:17:24.488637 28180 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:17:24.492060 28180 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:17:24.492283 28180 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:17:24.492899 28180 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:17:24.493969 28222 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260923 17:17:24.497908 28180 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260923 17:17:24.497988 28180 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.004s user 0.000s sys 0.000s
I20260923 17:17:24.498070 28180 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260923 17:17:24.499779 28180 ts_tablet_manager.cc:610] Registered 1 tablets
I20260923 17:17:24.499850 28180 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260923 17:17:24.500103 28222 tablet_bootstrap.cc:492] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 26358176962d45319c4c4c34d54a6fc5: Bootstrap starting.
I20260923 17:17:24.509935 28180 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.129:38399
I20260923 17:17:24.509975 28329 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.129:38399 every 8 connection(s)
I20260923 17:17:24.510921 28180 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
I20260923 17:17:24.518628 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 28180
I20260923 17:17:24.519066 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.130:45883
--local_ip_for_outbound_sockets=127.11.229.130
--tserver_master_addrs=127.11.229.190:36279
--webserver_port=45077
--webserver_interface=127.11.229.130
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab
--principal=kudu/127.11.229.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:35505
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 17:17:24.519924 28222 log.cc:824] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 26358176962d45319c4c4c34d54a6fc5: Log is configured to *not* fsync() on all Append() calls
Sep 23 17:17:24 dist-test-slave-1x1f krb5kdc[27562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183844, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.129@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:17:24.528101 28222 tablet_bootstrap.cc:492] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 26358176962d45319c4c4c34d54a6fc5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260923 17:17:24.528514 28222 tablet_bootstrap.cc:492] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 26358176962d45319c4c4c34d54a6fc5: Bootstrap complete.
I20260923 17:17:24.529749 28222 ts_tablet_manager.cc:1397] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 26358176962d45319c4c4c34d54a6fc5: Time spent bootstrapping tablet: real 0.030s user 0.026s sys 0.000s
I20260923 17:17:24.530637 28332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:24.512908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:56841 (local address 127.11.229.190:36279)
0923 17:17:24.513295 (+ 387us) server_negotiation.cc:206] Beginning negotiation
0923 17:17:24.513314 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0923 17:17:24.513759 (+ 445us) server_negotiation.cc:407] Connection header received
0923 17:17:24.515119 (+ 1360us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:17:24.515130 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:17:24.515415 (+ 285us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:17:24.515671 (+ 256us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:17:24.517221 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:24.518184 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:24.519762 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:24.520577 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:24.520785 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:17:24.523813 (+ 3028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:17:24.523819 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:17:24.523834 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:17:24.523868 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:17:24.526023 (+ 2155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:17:24.526663 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:17:24.526668 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:17:24.526673 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:17:24.526816 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:17:24.527297 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:17:24.527300 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:17:24.527302 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:17:24.527722 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:17:24.527856 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0923 17:17:24.529393 (+ 1537us) server_negotiation.cc:299] Negotiation successful
0923 17:17:24.529691 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":247,"thread_start_us":125,"threads_started":1}
I20260923 17:17:24.530714 28333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:24.512892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.129:56841)
0923 17:17:24.513557 (+ 665us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:24.513618 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0923 17:17:24.514705 (+ 1087us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:17:24.515795 (+ 1090us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:17:24.515804 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:17:24.516404 (+ 600us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:17:24.517044 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:17:24.517063 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:17:24.518380 (+ 1317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:17:24.518384 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:17:24.519629 (+ 1245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:17:24.519639 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:17:24.520743 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:17:24.520747 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:17:24.520937 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:17:24.521591 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:17:24.521612 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:17:24.523590 (+ 1978us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:17:24.526157 (+ 2567us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:17:24.526162 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:17:24.526173 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:17:24.526521 (+ 348us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:17:24.526934 (+ 413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:17:24.526939 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:17:24.526943 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:17:24.527163 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:17:24.527857 (+ 694us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:17:24.527866 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:17:24.529001 (+ 1135us) client_negotiation.cc:769] Sending connection context
0923 17:17:24.529236 (+ 235us) client_negotiation.cc:240] Negotiation successful
0923 17:17:24.529636 (+ 400us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":399,"thread_start_us":152,"threads_started":1}
I20260923 17:17:24.532485 28222 raft_consensus.cc:348] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 26358176962d45319c4c4c34d54a6fc5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c901e423907a457b8b547e20a43cc375" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 35229 } } peers { permanent_uuid: "423661b82bab474c87565961f49ac5c3" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 45883 } } peers { permanent_uuid: "26358176962d45319c4c4c34d54a6fc5" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38399 } }
I20260923 17:17:24.533002 28222 raft_consensus.cc:729] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 26358176962d45319c4c4c34d54a6fc5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26358176962d45319c4c4c34d54a6fc5, State: Initialized, Role: FOLLOWER
I20260923 17:17:24.533450 28222 consensus_queue.cc:260] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 26358176962d45319c4c4c34d54a6fc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c901e423907a457b8b547e20a43cc375" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 35229 } } peers { permanent_uuid: "423661b82bab474c87565961f49ac5c3" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 45883 } } peers { permanent_uuid: "26358176962d45319c4c4c34d54a6fc5" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38399 } }
I20260923 17:17:24.534272 28330 heartbeater.cc:347] Connected to a master server at 127.11.229.190:36279
I20260923 17:17:24.534438 28222 ts_tablet_manager.cc:1428] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 26358176962d45319c4c4c34d54a6fc5: Time spent starting tablet: real 0.005s user 0.008s sys 0.000s
I20260923 17:17:24.534511 28330 heartbeater.cc:464] Registering TS with master...
I20260923 17:17:24.535022 28330 heartbeater.cc:511] Master 127.11.229.190:36279 requested a full tablet report, sending...
I20260923 17:17:24.537411 28142 ts_manager.cc:194] Registered new tserver with Master: 26358176962d45319c4c4c34d54a6fc5 (127.11.229.129:38399)
I20260923 17:17:24.540807 28142 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.129@KRBTEST.COM'} at 127.11.229.129:56841
I20260923 17:17:24.543293 28330 heartbeater.cc:503] Master 127.11.229.190:36279 was elected leader, sending a full tablet report...
Sep 23 17:17:24 dist-test-slave-1x1f krb5kdc[27562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183844, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for kudu/127.11.229.129@KRBTEST.COM
I20260923 17:17:24.551237 28337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:24.540108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:38399 (local address 127.0.0.1:37350)
0923 17:17:24.540702 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:24.540749 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0923 17:17:24.540873 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:17:24.541422 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:17:24.541428 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:17:24.541842 (+ 414us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:17:24.541971 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:17:24.541980 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:17:24.543528 (+ 1548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:17:24.543531 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:17:24.544446 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:17:24.544458 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:17:24.545226 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:17:24.545229 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:17:24.545312 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:17:24.545845 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:17:24.545856 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:17:24.547418 (+ 1562us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:17:24.549528 (+ 2110us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:17:24.549535 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:17:24.549539 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:17:24.549774 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:17:24.550084 (+ 310us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:17:24.550086 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:17:24.550088 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:17:24.550180 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:17:24.550735 (+ 555us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:17:24.550740 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:17:24.550837 (+ 97us) client_negotiation.cc:769] Sending connection context
0923 17:17:24.550949 (+ 112us) client_negotiation.cc:240] Negotiation successful
0923 17:17:24.551090 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":417,"thread_start_us":105,"threads_started":1}
I20260923 17:17:24.551393 28338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:24.540212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37350 (local address 127.11.229.129:38399)
0923 17:17:24.540820 (+ 608us) server_negotiation.cc:206] Beginning negotiation
0923 17:17:24.540833 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 17:17:24.540857 (+ 24us) server_negotiation.cc:407] Connection header received
0923 17:17:24.541054 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:17:24.541059 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:17:24.541256 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:17:24.541399 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:17:24.542105 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:24.543345 (+ 1240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:24.544576 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:24.545060 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:24.545226 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:17:24.547550 (+ 2324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:17:24.547560 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:17:24.547572 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:17:24.547599 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:17:24.549414 (+ 1815us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:17:24.549889 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:17:24.549895 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:17:24.549897 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:17:24.549988 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:17:24.550333 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:17:24.550336 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:17:24.550338 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:17:24.550620 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:17:24.550750 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0923 17:17:24.551054 (+ 304us) server_negotiation.cc:299] Negotiation successful
0923 17:17:24.551219 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":59,"server-negotiator.queue_time_us":506,"thread_start_us":113,"threads_started":1}
I20260923 17:17:24.552309 28264 tablet_service.cc:1514] Processing DeleteTablet for tablet 11666cc1d4a94cbea12c9d6096cd0ce6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:17:04 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:37350
I20260923 17:17:24.553154 28339 tablet_replica.cc:330] stopping tablet replica
I20260923 17:17:24.553440 28339 raft_consensus.cc:2229] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 26358176962d45319c4c4c34d54a6fc5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:17:24.553685 28339 raft_consensus.cc:2258] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 26358176962d45319c4c4c34d54a6fc5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:17:24.554718 28339 ts_tablet_manager.cc:1905] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 26358176962d45319c4c4c34d54a6fc5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:17:24.558403 28339 ts_tablet_manager.cc:1918] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 26358176962d45319c4c4c34d54a6fc5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 17:17:24.558523 28339 log.cc:1196] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 26358176962d45319c4c4c34d54a6fc5: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-0/wal/wals/11666cc1d4a94cbea12c9d6096cd0ce6
I20260923 17:17:24.558813 28339 ts_tablet_manager.cc:1939] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 26358176962d45319c4c4c34d54a6fc5: Deleting consensus metadata
I20260923 17:17:24.560437 28128 catalog_manager.cc:4841] TS 26358176962d45319c4c4c34d54a6fc5 (127.11.229.129:38399): tablet 11666cc1d4a94cbea12c9d6096cd0ce6 (table test-table [id=027d15e267ba42b8b5ac84be39c76515]) successfully deleted
W20260923 17:17:24.638931 28335 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:17:24.639204 28335 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:17:24.639276 28335 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:17:24.643571 28335 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:17:24.643636 28335 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:17:24.643782 28335 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.130
I20260923 17:17:24.649144 28335 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:35505
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab
--principal=kudu/127.11.229.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.130:45883
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.229.130
--webserver_port=45077
--tserver_master_addrs=127.11.229.190:36279
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28335
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.130
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:17:24.650066 28335 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:17:24.651060 28335 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:17:24.660369 28347 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:17:24.660418 28344 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:17:24.660405 28345 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:17:24.660637 28335 server_base.cc:1034] running on GCE node
I20260923 17:17:24.661087 28335 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:17:24.661651 28335 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:17:24.662811 28335 hybrid_clock.cc:648] HybridClock initialized: now 1790183844662792 us; error 29 us; skew 500 ppm
Sep 23 17:17:24 dist-test-slave-1x1f krb5kdc[27562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183844, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:17:24.665463 28335 init.cc:377] Logged in from keytab as kudu/127.11.229.130@KRBTEST.COM (short username kudu)
I20260923 17:17:24.666345 28335 webserver.cc:460] Webserver started at http://127.11.229.130:45077/ using document root <none> and password file <none>
I20260923 17:17:24.666880 28335 fs_manager.cc:359] Metadata directory not provided
I20260923 17:17:24.666982 28335 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:17:24.670805 28335 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260923 17:17:24.672853 28354 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:17:24.673969 28335 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 17:17:24.674098 28335 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-1/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-1/wal
uuid: "423661b82bab474c87565961f49ac5c3"
format_stamp: "Formatted at 2026-09-23 17:17:03 on dist-test-slave-1x1f"
server_key: "3a7fb2a19b17f72ad1ba3254ffdf3aa2"
server_key_iv: "cf00c1517cf52cbfe36b98964fc079e9"
server_key_version: "encryptionkey@0"
I20260923 17:17:24.674685 28335 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:17:24.710069 28335 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:17:24.713163 28335 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:17:24.713377 28335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:17:24.713953 28335 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:17:24.715060 28361 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
W20260923 17:17:24.718854 28361 ts_tablet_manager.cc:1852] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 423661b82bab474c87565961f49ac5c3: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260923 17:17:24.719229 28361 ts_tablet_manager.cc:1905] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 423661b82bab474c87565961f49ac5c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:17:24.722868 28361 ts_tablet_manager.cc:1918] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 423661b82bab474c87565961f49ac5c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 17:17:24.723042 28361 ts_tablet_manager.cc:1939] T 11666cc1d4a94cbea12c9d6096cd0ce6 P 423661b82bab474c87565961f49ac5c3: Deleting consensus metadata
I20260923 17:17:24.723683 28335 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260923 17:17:24.723758 28335 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.009s user 0.000s sys 0.000s
I20260923 17:17:24.723835 28335 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:17:24.723879 28335 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:17:24.733039 28335 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.130:45883
I20260923 17:17:24.733090 28468 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.130:45883 every 8 connection(s)
I20260923 17:17:24.733992 28335 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
I20260923 17:17:24.737460 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 28335
I20260923 17:17:24.737948 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.131:35229
--local_ip_for_outbound_sockets=127.11.229.131
--tserver_master_addrs=127.11.229.190:36279
--webserver_port=44383
--webserver_interface=127.11.229.131
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab
--principal=kudu/127.11.229.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:35505
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 23 17:17:24 dist-test-slave-1x1f krb5kdc[27562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183844, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.130@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:17:24.748896 28332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:24.735958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:42721 (local address 127.11.229.190:36279)
0923 17:17:24.736117 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0923 17:17:24.736121 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:17:24.736949 (+ 828us) server_negotiation.cc:407] Connection header received
0923 17:17:24.738332 (+ 1383us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:17:24.738335 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:17:24.738387 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:17:24.738469 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:17:24.739976 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:24.740522 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:24.741645 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:24.741895 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:24.742011 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:17:24.745007 (+ 2996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:17:24.745011 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:17:24.745013 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:17:24.745038 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:17:24.746670 (+ 1632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:17:24.747249 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:17:24.747253 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:17:24.747255 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:17:24.747336 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:17:24.747729 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:17:24.747734 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:17:24.747736 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:17:24.747941 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:17:24.748044 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0923 17:17:24.748594 (+ 550us) server_negotiation.cc:299] Negotiation successful
0923 17:17:24.748731 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260923 17:17:24.749814 28471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:24.736288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.130:42721)
0923 17:17:24.736792 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:24.736833 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0923 17:17:24.737956 (+ 1123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:17:24.738671 (+ 715us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:17:24.738682 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:17:24.739214 (+ 532us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:17:24.739820 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:17:24.739835 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:17:24.740654 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:17:24.740664 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:17:24.741511 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:17:24.741520 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:17:24.742048 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:17:24.742052 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:17:24.742270 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:17:24.742947 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:17:24.742972 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:17:24.744824 (+ 1852us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:17:24.746797 (+ 1973us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:17:24.746804 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:17:24.746819 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:17:24.747135 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:17:24.747468 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:17:24.747474 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:17:24.747476 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:17:24.747631 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:17:24.748043 (+ 412us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:17:24.748049 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:17:24.748350 (+ 301us) client_negotiation.cc:769] Sending connection context
0923 17:17:24.748554 (+ 204us) client_negotiation.cc:240] Negotiation successful
0923 17:17:24.748905 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":144,"threads_started":1}
I20260923 17:17:24.751042 28469 heartbeater.cc:347] Connected to a master server at 127.11.229.190:36279
I20260923 17:17:24.751339 28469 heartbeater.cc:464] Registering TS with master...
I20260923 17:17:24.751822 28469 heartbeater.cc:511] Master 127.11.229.190:36279 requested a full tablet report, sending...
I20260923 17:17:24.752818 28142 ts_manager.cc:194] Registered new tserver with Master: 423661b82bab474c87565961f49ac5c3 (127.11.229.130:45883)
I20260923 17:17:24.753374 28142 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.130@KRBTEST.COM'} at 127.11.229.130:42721
W20260923 17:17:24.848781 28472 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:17:24.849010 28472 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:17:24.849051 28472 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:17:24.852977 28472 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:17:24.853027 28472 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:17:24.853111 28472 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.131
I20260923 17:17:24.858076 28472 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:35505
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab
--principal=kudu/127.11.229.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.131:35229
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.229.131
--webserver_port=44383
--tserver_master_addrs=127.11.229.190:36279
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28472
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.131
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:17:24.859046 28472 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:17:24.860037 28472 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260923 17:17:24.869581 28472 server_base.cc:1034] running on GCE node
W20260923 17:17:24.869513 28477 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:17:24.869517 28478 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:17:24.869513 28480 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:17:24.870064 28472 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:17:24.870755 28472 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:17:24.871955 28472 hybrid_clock.cc:648] HybridClock initialized: now 1790183844871934 us; error 31 us; skew 500 ppm
Sep 23 17:17:24 dist-test-slave-1x1f krb5kdc[27562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183844, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:17:24.874691 28472 init.cc:377] Logged in from keytab as kudu/127.11.229.131@KRBTEST.COM (short username kudu)
I20260923 17:17:24.875432 28472 webserver.cc:460] Webserver started at http://127.11.229.131:44383/ using document root <none> and password file <none>
I20260923 17:17:24.875921 28472 fs_manager.cc:359] Metadata directory not provided
I20260923 17:17:24.875985 28472 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:17:24.879827 28472 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260923 17:17:24.881810 28487 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:17:24.883095 28472 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 17:17:24.883186 28472 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-2/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-2/wal
uuid: "c901e423907a457b8b547e20a43cc375"
format_stamp: "Formatted at 2026-09-23 17:17:03 on dist-test-slave-1x1f"
server_key: "6a57eac7997317e1c1408981fec37005"
server_key_iv: "65f34e9ec94a6da1cbcda2ea3f50bc58"
server_key_version: "encryptionkey@0"
I20260923 17:17:24.883744 28472 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:17:24.912670 28472 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:17:24.915901 28472 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:17:24.916103 28472 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:17:24.916698 28472 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:17:24.917498 28472 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:17:24.917574 28472 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:17:24.917646 28472 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:17:24.917680 28472 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:17:24.927048 28472 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.131:35229
I20260923 17:17:24.927093 28600 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.131:35229 every 8 connection(s)
I20260923 17:17:24.928032 28472 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
I20260923 17:17:24.935281 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 28472
Sep 23 17:17:24 dist-test-slave-1x1f krb5kdc[27562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183844, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.131@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:17:24.942970 28332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:24.929961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:46577 (local address 127.11.229.190:36279)
0923 17:17:24.930105 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0923 17:17:24.930108 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 17:17:24.930919 (+ 811us) server_negotiation.cc:407] Connection header received
0923 17:17:24.932146 (+ 1227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:17:24.932149 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:17:24.932198 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:17:24.932288 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:17:24.933388 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:24.933913 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:24.935147 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:24.935499 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:24.935628 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:17:24.938761 (+ 3133us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:17:24.938766 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:17:24.938769 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:17:24.938796 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:17:24.940547 (+ 1751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:17:24.941149 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:17:24.941153 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:17:24.941155 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:17:24.941247 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:17:24.941645 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:17:24.941649 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:17:24.941651 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:17:24.941851 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:17:24.941968 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0923 17:17:24.942657 (+ 689us) server_negotiation.cc:299] Negotiation successful
0923 17:17:24.942782 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260923 17:17:24.943995 28603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:24.930335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.131:46577)
0923 17:17:24.930759 (+ 424us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:24.930804 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0923 17:17:24.931932 (+ 1128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:17:24.932468 (+ 536us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:17:24.932474 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:17:24.932804 (+ 330us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:17:24.933250 (+ 446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:17:24.933262 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:17:24.934017 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:17:24.934019 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:17:24.934894 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:17:24.934902 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:17:24.935653 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:17:24.935656 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:17:24.935875 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:17:24.936556 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:17:24.936581 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:17:24.938577 (+ 1996us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:17:24.940699 (+ 2122us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:17:24.940705 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:17:24.940721 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:17:24.941007 (+ 286us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:17:24.941364 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:17:24.941368 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:17:24.941370 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:17:24.941523 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:17:24.941966 (+ 443us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:17:24.941973 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:17:24.942315 (+ 342us) client_negotiation.cc:769] Sending connection context
0923 17:17:24.942587 (+ 272us) client_negotiation.cc:240] Negotiation successful
0923 17:17:24.942931 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"thread_start_us":110,"threads_started":1}
I20260923 17:17:24.944568 28605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:24.936090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57218 (local address 127.11.229.190:36279)
0923 17:17:24.936394 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0923 17:17:24.936398 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:17:24.936681 (+ 283us) server_negotiation.cc:407] Connection header received
0923 17:17:24.936847 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:17:24.936849 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:17:24.936886 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:17:24.936956 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:17:24.937907 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:24.938587 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:24.939465 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:24.939691 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:24.939797 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:17:24.941094 (+ 1297us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:17:24.941097 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:17:24.941100 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:17:24.941129 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:17:24.942685 (+ 1556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:17:24.943269 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:17:24.943272 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:17:24.943273 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:17:24.943350 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:17:24.943677 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:17:24.943681 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:17:24.943683 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:17:24.943845 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:17:24.944064 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0923 17:17:24.944325 (+ 261us) server_negotiation.cc:299] Negotiation successful
0923 17:17:24.944432 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":221,"thread_start_us":102,"threads_started":1}
I20260923 17:17:24.945801 28601 heartbeater.cc:347] Connected to a master server at 127.11.229.190:36279
I20260923 17:17:24.946039 28601 heartbeater.cc:464] Registering TS with master...
I20260923 17:17:24.946563 28601 heartbeater.cc:511] Master 127.11.229.190:36279 requested a full tablet report, sending...
I20260923 17:17:24.947592 28142 ts_manager.cc:194] Registered new tserver with Master: c901e423907a457b8b547e20a43cc375 (127.11.229.131:35229)
I20260923 17:17:24.948361 28142 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.131@KRBTEST.COM'} at 127.11.229.131:46577
I20260923 17:17:24.958464 12182 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 17:17:24.963071 28605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:24.959120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57230 (local address 127.11.229.190:36279)
0923 17:17:24.959298 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0923 17:17:24.959303 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:17:24.959457 (+ 154us) server_negotiation.cc:407] Connection header received
0923 17:17:24.959666 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:17:24.959669 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:17:24.959823 (+ 154us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:17:24.959939 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 17:17:24.960257 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:24.960818 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:24.961726 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:24.961976 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:24.962098 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:17:24.962494 (+ 396us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 17:17:24.962649 (+ 155us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0923 17:17:24.962936 (+ 287us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:57230: token expired
Metrics: {"server-negotiator.queue_time_us":79}
W20260923 17:17:24.963140 28605 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:57230: token expired
W20260923 17:17:24.963541 28072 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.11.229.190:36279)
I20260923 17:17:24.971951 28605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:24.963963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57238 (local address 127.11.229.190:36279)
0923 17:17:24.964099 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0923 17:17:24.964104 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:17:24.964119 (+ 15us) server_negotiation.cc:407] Connection header received
0923 17:17:24.964343 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:17:24.964347 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:17:24.964405 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:17:24.964495 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:17:24.965172 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:24.965730 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:24.966685 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:24.966928 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:24.967046 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:17:24.968548 (+ 1502us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:17:24.968552 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:17:24.968555 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:17:24.968596 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:17:24.970036 (+ 1440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:17:24.970618 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:17:24.970622 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:17:24.970624 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:17:24.970712 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:17:24.971017 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:17:24.971020 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:17:24.971022 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:17:24.971224 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:17:24.971373 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0923 17:17:24.971643 (+ 270us) server_negotiation.cc:299] Negotiation successful
0923 17:17:24.971771 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260923 17:17:24.974512 28142 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57238:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 17:17:24.977636 28142 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 17:17:24.986116 28264 tablet_service.cc:1467] Processing CreateTablet for tablet 525232ec562f49d4b9fa0ac1158aea96 (DEFAULT_TABLE table=test-table [id=29b81b9aba90437baa615567db315b97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:17:24.986874 28264 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 525232ec562f49d4b9fa0ac1158aea96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:17:24.989914 28222 tablet_bootstrap.cc:492] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5: Bootstrap starting.
I20260923 17:17:24.990912 28222 tablet_bootstrap.cc:654] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5: Neither blocks nor log segments found. Creating new log.
I20260923 17:17:24.991065 28337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:24.984821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.131:35229 (local address 127.0.0.1:52066)
0923 17:17:24.985029 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:24.985047 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 17:17:24.985135 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:17:24.986102 (+ 967us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:17:24.986105 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:17:24.986126 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:17:24.986274 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:17:24.986282 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:17:24.988401 (+ 2119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:17:24.988405 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:17:24.989492 (+ 1087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:17:24.989499 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:17:24.990605 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:17:24.990608 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:17:24.990702 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:17:24.990746 (+ 44us) client_negotiation.cc:769] Sending connection context
0923 17:17:24.990836 (+ 90us) client_negotiation.cc:240] Negotiation successful
0923 17:17:24.990925 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"mutex_wait_us":4}
I20260923 17:17:24.991078 28610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:24.985044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52066 (local address 127.11.229.131:35229)
0923 17:17:24.985544 (+ 500us) server_negotiation.cc:206] Beginning negotiation
0923 17:17:24.985557 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 17:17:24.985580 (+ 23us) server_negotiation.cc:407] Connection header received
0923 17:17:24.985669 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:17:24.985677 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:17:24.985924 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:17:24.986094 (+ 170us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:17:24.986715 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:24.988275 (+ 1560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:24.989643 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:24.990480 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:24.990620 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:17:24.990761 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0923 17:17:24.990863 (+ 102us) server_negotiation.cc:299] Negotiation successful
0923 17:17:24.990955 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":396,"thread_start_us":156,"threads_started":1}
I20260923 17:17:24.992010 28611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:24.985119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.130:45883 (local address 127.0.0.1:36262)
0923 17:17:24.985384 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:24.985401 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 17:17:24.985492 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:17:24.986388 (+ 896us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:17:24.986391 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:17:24.986409 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:17:24.986550 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:17:24.986556 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:17:24.987968 (+ 1412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:17:24.987973 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:17:24.989280 (+ 1307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:17:24.989291 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:17:24.991103 (+ 1812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:17:24.991107 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:17:24.991672 (+ 565us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:17:24.991700 (+ 28us) client_negotiation.cc:769] Sending connection context
0923 17:17:24.991776 (+ 76us) client_negotiation.cc:240] Negotiation successful
0923 17:17:24.991867 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"mutex_wait_us":28,"thread_start_us":97,"threads_started":1}
I20260923 17:17:24.992643 28612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:24.985545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36262 (local address 127.11.229.130:45883)
0923 17:17:24.985920 (+ 375us) server_negotiation.cc:206] Beginning negotiation
0923 17:17:24.985938 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0923 17:17:24.985959 (+ 21us) server_negotiation.cc:407] Connection header received
0923 17:17:24.986035 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:17:24.986043 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:17:24.986202 (+ 159us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:17:24.986396 (+ 194us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:17:24.986673 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:24.987855 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:24.989571 (+ 1716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:24.990684 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:24.990835 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:17:24.992284 (+ 1449us) server_negotiation.cc:1035] Waiting for connection context
0923 17:17:24.992340 (+ 56us) server_negotiation.cc:299] Negotiation successful
0923 17:17:24.992448 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":292,"thread_start_us":105,"threads_started":1}
I20260923 17:17:24.992832 28222 tablet_bootstrap.cc:492] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5: No bootstrap required, opened a new log
I20260923 17:17:24.992928 28222 ts_tablet_manager.cc:1397] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260923 17:17:24.993402 28222 raft_consensus.cc:348] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c901e423907a457b8b547e20a43cc375" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 35229 } } peers { permanent_uuid: "423661b82bab474c87565961f49ac5c3" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 45883 } } peers { permanent_uuid: "26358176962d45319c4c4c34d54a6fc5" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38399 } }
I20260923 17:17:24.993510 28222 raft_consensus.cc:374] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:17:24.993539 28222 raft_consensus.cc:729] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26358176962d45319c4c4c34d54a6fc5, State: Initialized, Role: FOLLOWER
I20260923 17:17:24.993705 28222 consensus_queue.cc:260] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c901e423907a457b8b547e20a43cc375" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 35229 } } peers { permanent_uuid: "423661b82bab474c87565961f49ac5c3" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 45883 } } peers { permanent_uuid: "26358176962d45319c4c4c34d54a6fc5" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38399 } }
I20260923 17:17:24.993995 28222 ts_tablet_manager.cc:1428] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260923 17:17:24.994040 28535 tablet_service.cc:1467] Processing CreateTablet for tablet 525232ec562f49d4b9fa0ac1158aea96 (DEFAULT_TABLE table=test-table [id=29b81b9aba90437baa615567db315b97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:17:24.995253 28535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 525232ec562f49d4b9fa0ac1158aea96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:17:24.995821 28403 tablet_service.cc:1467] Processing CreateTablet for tablet 525232ec562f49d4b9fa0ac1158aea96 (DEFAULT_TABLE table=test-table [id=29b81b9aba90437baa615567db315b97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:17:24.996870 28403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 525232ec562f49d4b9fa0ac1158aea96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:17:25.000516 28361 tablet_bootstrap.cc:492] T 525232ec562f49d4b9fa0ac1158aea96 P 423661b82bab474c87565961f49ac5c3: Bootstrap starting.
I20260923 17:17:25.002074 28614 tablet_bootstrap.cc:492] T 525232ec562f49d4b9fa0ac1158aea96 P c901e423907a457b8b547e20a43cc375: Bootstrap starting.
I20260923 17:17:25.002964 28361 tablet_bootstrap.cc:654] T 525232ec562f49d4b9fa0ac1158aea96 P 423661b82bab474c87565961f49ac5c3: Neither blocks nor log segments found. Creating new log.
I20260923 17:17:25.003816 28361 log.cc:824] T 525232ec562f49d4b9fa0ac1158aea96 P 423661b82bab474c87565961f49ac5c3: Log is configured to *not* fsync() on all Append() calls
I20260923 17:17:25.004616 28614 tablet_bootstrap.cc:654] T 525232ec562f49d4b9fa0ac1158aea96 P c901e423907a457b8b547e20a43cc375: Neither blocks nor log segments found. Creating new log.
I20260923 17:17:25.005415 28614 log.cc:824] T 525232ec562f49d4b9fa0ac1158aea96 P c901e423907a457b8b547e20a43cc375: Log is configured to *not* fsync() on all Append() calls
I20260923 17:17:25.005864 28361 tablet_bootstrap.cc:492] T 525232ec562f49d4b9fa0ac1158aea96 P 423661b82bab474c87565961f49ac5c3: No bootstrap required, opened a new log
I20260923 17:17:25.006050 28361 ts_tablet_manager.cc:1397] T 525232ec562f49d4b9fa0ac1158aea96 P 423661b82bab474c87565961f49ac5c3: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260923 17:17:25.007098 28614 tablet_bootstrap.cc:492] T 525232ec562f49d4b9fa0ac1158aea96 P c901e423907a457b8b547e20a43cc375: No bootstrap required, opened a new log
I20260923 17:17:25.007289 28614 ts_tablet_manager.cc:1397] T 525232ec562f49d4b9fa0ac1158aea96 P c901e423907a457b8b547e20a43cc375: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260923 17:17:25.008970 28361 raft_consensus.cc:348] T 525232ec562f49d4b9fa0ac1158aea96 P 423661b82bab474c87565961f49ac5c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c901e423907a457b8b547e20a43cc375" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 35229 } } peers { permanent_uuid: "423661b82bab474c87565961f49ac5c3" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 45883 } } peers { permanent_uuid: "26358176962d45319c4c4c34d54a6fc5" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38399 } }
I20260923 17:17:25.009249 28361 raft_consensus.cc:374] T 525232ec562f49d4b9fa0ac1158aea96 P 423661b82bab474c87565961f49ac5c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:17:25.009308 28361 raft_consensus.cc:729] T 525232ec562f49d4b9fa0ac1158aea96 P 423661b82bab474c87565961f49ac5c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 423661b82bab474c87565961f49ac5c3, State: Initialized, Role: FOLLOWER
I20260923 17:17:25.009754 28361 consensus_queue.cc:260] T 525232ec562f49d4b9fa0ac1158aea96 P 423661b82bab474c87565961f49ac5c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c901e423907a457b8b547e20a43cc375" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 35229 } } peers { permanent_uuid: "423661b82bab474c87565961f49ac5c3" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 45883 } } peers { permanent_uuid: "26358176962d45319c4c4c34d54a6fc5" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38399 } }
I20260923 17:17:25.010298 28614 raft_consensus.cc:348] T 525232ec562f49d4b9fa0ac1158aea96 P c901e423907a457b8b547e20a43cc375 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c901e423907a457b8b547e20a43cc375" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 35229 } } peers { permanent_uuid: "423661b82bab474c87565961f49ac5c3" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 45883 } } peers { permanent_uuid: "26358176962d45319c4c4c34d54a6fc5" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38399 } }
I20260923 17:17:25.010461 28469 heartbeater.cc:503] Master 127.11.229.190:36279 was elected leader, sending a full tablet report...
I20260923 17:17:25.010526 28614 raft_consensus.cc:374] T 525232ec562f49d4b9fa0ac1158aea96 P c901e423907a457b8b547e20a43cc375 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:17:25.010561 28614 raft_consensus.cc:729] T 525232ec562f49d4b9fa0ac1158aea96 P c901e423907a457b8b547e20a43cc375 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c901e423907a457b8b547e20a43cc375, State: Initialized, Role: FOLLOWER
I20260923 17:17:25.010730 28361 ts_tablet_manager.cc:1428] T 525232ec562f49d4b9fa0ac1158aea96 P 423661b82bab474c87565961f49ac5c3: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260923 17:17:25.010911 28614 consensus_queue.cc:260] T 525232ec562f49d4b9fa0ac1158aea96 P c901e423907a457b8b547e20a43cc375 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c901e423907a457b8b547e20a43cc375" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 35229 } } peers { permanent_uuid: "423661b82bab474c87565961f49ac5c3" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 45883 } } peers { permanent_uuid: "26358176962d45319c4c4c34d54a6fc5" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38399 } }
I20260923 17:17:25.011473 28601 heartbeater.cc:503] Master 127.11.229.190:36279 was elected leader, sending a full tablet report...
I20260923 17:17:25.011704 28614 ts_tablet_manager.cc:1428] T 525232ec562f49d4b9fa0ac1158aea96 P c901e423907a457b8b547e20a43cc375: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s
W20260923 17:17:25.012077 28331 tablet.cc:2369] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 17:17:25.178952 28602 tablet.cc:2369] T 525232ec562f49d4b9fa0ac1158aea96 P c901e423907a457b8b547e20a43cc375: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 17:17:25.235248 28470 tablet.cc:2369] T 525232ec562f49d4b9fa0ac1158aea96 P 423661b82bab474c87565961f49ac5c3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 17:17:25.370540 28617 raft_consensus.cc:482] T 525232ec562f49d4b9fa0ac1158aea96 P 423661b82bab474c87565961f49ac5c3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 17:17:25.370842 28617 raft_consensus.cc:504] T 525232ec562f49d4b9fa0ac1158aea96 P 423661b82bab474c87565961f49ac5c3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c901e423907a457b8b547e20a43cc375" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 35229 } } peers { permanent_uuid: "423661b82bab474c87565961f49ac5c3" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 45883 } } peers { permanent_uuid: "26358176962d45319c4c4c34d54a6fc5" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38399 } }
I20260923 17:17:25.372114 28617 leader_election.cc:288] T 525232ec562f49d4b9fa0ac1158aea96 P 423661b82bab474c87565961f49ac5c3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c901e423907a457b8b547e20a43cc375 (127.11.229.131:35229), 26358176962d45319c4c4c34d54a6fc5 (127.11.229.129:38399)
I20260923 17:17:25.376070 28610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:25.372474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:39587 (local address 127.11.229.131:35229)
0923 17:17:25.372693 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0923 17:17:25.372697 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:17:25.372834 (+ 137us) server_negotiation.cc:407] Connection header received
0923 17:17:25.373027 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:17:25.373032 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:17:25.373078 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:17:25.373164 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:17:25.373441 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:25.373947 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:25.375140 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:25.375533 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:25.375661 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:17:25.375736 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0923 17:17:25.375888 (+ 152us) server_negotiation.cc:299] Negotiation successful
0923 17:17:25.375951 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123}
I20260923 17:17:25.376106 28619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:25.372364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.131:35229 (local address 127.11.229.130:39587)
0923 17:17:25.372729 (+ 365us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:25.372743 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 17:17:25.372912 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:17:25.373177 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:17:25.373180 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:17:25.373196 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:17:25.373335 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:17:25.373341 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:17:25.374056 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:17:25.374062 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:17:25.375020 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:17:25.375029 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:17:25.375654 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:17:25.375658 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:17:25.375752 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:17:25.375777 (+ 25us) client_negotiation.cc:769] Sending connection context
0923 17:17:25.375874 (+ 97us) client_negotiation.cc:240] Negotiation successful
0923 17:17:25.375942 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"mutex_wait_us":77,"spinlock_wait_cycles":4992,"thread_start_us":72,"threads_started":1}
I20260923 17:17:25.376260 28336 raft_consensus.cc:482] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 17:17:25.376431 28620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:25.372364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:38399 (local address 127.11.229.130:34193)
0923 17:17:25.372694 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:25.372713 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0923 17:17:25.372910 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:17:25.373254 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:17:25.373257 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:17:25.373274 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:17:25.373434 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:17:25.373440 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:17:25.374277 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:17:25.374281 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:17:25.375182 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:17:25.375191 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:17:25.375971 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:17:25.375975 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:17:25.376091 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:17:25.376114 (+ 23us) client_negotiation.cc:769] Sending connection context
0923 17:17:25.376189 (+ 75us) client_negotiation.cc:240] Negotiation successful
0923 17:17:25.376281 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232,"mutex_wait_us":41,"spinlock_wait_cycles":24704,"thread_start_us":105,"threads_started":1}
I20260923 17:17:25.376437 28336 raft_consensus.cc:504] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c901e423907a457b8b547e20a43cc375" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 35229 } } peers { permanent_uuid: "423661b82bab474c87565961f49ac5c3" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 45883 } } peers { permanent_uuid: "26358176962d45319c4c4c34d54a6fc5" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38399 } }
I20260923 17:17:25.376886 28621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:25.372464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:34193 (local address 127.11.229.129:38399)
0923 17:17:25.372705 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0923 17:17:25.372712 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 17:17:25.372824 (+ 112us) server_negotiation.cc:407] Connection header received
0923 17:17:25.373048 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:17:25.373052 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:17:25.373110 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:17:25.373243 (+ 133us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:17:25.373561 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:25.374117 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:25.375316 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:25.375842 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:25.375966 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:17:25.376115 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0923 17:17:25.376705 (+ 590us) server_negotiation.cc:299] Negotiation successful
0923 17:17:25.376785 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":76,"threads_started":1}
I20260923 17:17:25.376917 28555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "525232ec562f49d4b9fa0ac1158aea96" candidate_uuid: "423661b82bab474c87565961f49ac5c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c901e423907a457b8b547e20a43cc375" is_pre_election: true
I20260923 17:17:25.377174 28555 raft_consensus.cc:2454] T 525232ec562f49d4b9fa0ac1158aea96 P c901e423907a457b8b547e20a43cc375 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 423661b82bab474c87565961f49ac5c3 in term 0.
I20260923 17:17:25.377368 28284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "525232ec562f49d4b9fa0ac1158aea96" candidate_uuid: "423661b82bab474c87565961f49ac5c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26358176962d45319c4c4c34d54a6fc5" is_pre_election: true
I20260923 17:17:25.377643 28358 leader_election.cc:302] T 525232ec562f49d4b9fa0ac1158aea96 P 423661b82bab474c87565961f49ac5c3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 423661b82bab474c87565961f49ac5c3, c901e423907a457b8b547e20a43cc375; no voters:
I20260923 17:17:25.377612 28284 raft_consensus.cc:2454] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 423661b82bab474c87565961f49ac5c3 in term 0.
I20260923 17:17:25.377966 28617 raft_consensus.cc:2781] T 525232ec562f49d4b9fa0ac1158aea96 P 423661b82bab474c87565961f49ac5c3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 17:17:25.378042 28617 raft_consensus.cc:482] T 525232ec562f49d4b9fa0ac1158aea96 P 423661b82bab474c87565961f49ac5c3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 17:17:25.378091 28617 raft_consensus.cc:3037] T 525232ec562f49d4b9fa0ac1158aea96 P 423661b82bab474c87565961f49ac5c3 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:17:25.377611 28336 leader_election.cc:288] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c901e423907a457b8b547e20a43cc375 (127.11.229.131:35229), 423661b82bab474c87565961f49ac5c3 (127.11.229.130:45883)
I20260923 17:17:25.379534 28617 raft_consensus.cc:504] T 525232ec562f49d4b9fa0ac1158aea96 P 423661b82bab474c87565961f49ac5c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c901e423907a457b8b547e20a43cc375" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 35229 } } peers { permanent_uuid: "423661b82bab474c87565961f49ac5c3" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 45883 } } peers { permanent_uuid: "26358176962d45319c4c4c34d54a6fc5" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38399 } }
I20260923 17:17:25.379886 28617 leader_election.cc:288] T 525232ec562f49d4b9fa0ac1158aea96 P 423661b82bab474c87565961f49ac5c3 [CANDIDATE]: Term 1 election: Requested vote from peers c901e423907a457b8b547e20a43cc375 (127.11.229.131:35229), 26358176962d45319c4c4c34d54a6fc5 (127.11.229.129:38399)
I20260923 17:17:25.380301 28284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "525232ec562f49d4b9fa0ac1158aea96" candidate_uuid: "423661b82bab474c87565961f49ac5c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26358176962d45319c4c4c34d54a6fc5"
I20260923 17:17:25.380455 28284 raft_consensus.cc:3037] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:17:25.380475 28555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "525232ec562f49d4b9fa0ac1158aea96" candidate_uuid: "423661b82bab474c87565961f49ac5c3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c901e423907a457b8b547e20a43cc375"
I20260923 17:17:25.380579 28555 raft_consensus.cc:3037] T 525232ec562f49d4b9fa0ac1158aea96 P c901e423907a457b8b547e20a43cc375 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:17:25.381654 28284 raft_consensus.cc:2454] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 423661b82bab474c87565961f49ac5c3 in term 1.
I20260923 17:17:25.381834 28555 raft_consensus.cc:2454] T 525232ec562f49d4b9fa0ac1158aea96 P c901e423907a457b8b547e20a43cc375 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 423661b82bab474c87565961f49ac5c3 in term 1.
I20260923 17:17:25.382002 28357 leader_election.cc:302] T 525232ec562f49d4b9fa0ac1158aea96 P 423661b82bab474c87565961f49ac5c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26358176962d45319c4c4c34d54a6fc5, 423661b82bab474c87565961f49ac5c3; no voters:
I20260923 17:17:25.382170 28617 raft_consensus.cc:2781] T 525232ec562f49d4b9fa0ac1158aea96 P 423661b82bab474c87565961f49ac5c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:17:25.382476 28617 raft_consensus.cc:686] T 525232ec562f49d4b9fa0ac1158aea96 P 423661b82bab474c87565961f49ac5c3 [term 1 LEADER]: Becoming Leader. State: Replica: 423661b82bab474c87565961f49ac5c3, State: Running, Role: LEADER
I20260923 17:17:25.382866 28617 consensus_queue.cc:237] T 525232ec562f49d4b9fa0ac1158aea96 P 423661b82bab474c87565961f49ac5c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c901e423907a457b8b547e20a43cc375" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 35229 } } peers { permanent_uuid: "423661b82bab474c87565961f49ac5c3" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 45883 } } peers { permanent_uuid: "26358176962d45319c4c4c34d54a6fc5" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38399 } }
I20260923 17:17:25.383396 28610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:25.378533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:33019 (local address 127.11.229.131:35229)
0923 17:17:25.378683 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0923 17:17:25.378687 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:17:25.378700 (+ 13us) server_negotiation.cc:407] Connection header received
0923 17:17:25.378744 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:17:25.378747 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:17:25.378790 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:17:25.378873 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:17:25.379461 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:25.380245 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:25.381999 (+ 1754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:25.382683 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:25.382775 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:17:25.382821 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0923 17:17:25.383211 (+ 390us) server_negotiation.cc:299] Negotiation successful
0923 17:17:25.383279 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260923 17:17:25.383447 28623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:25.377875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.131:35229 (local address 127.11.229.129:33019)
0923 17:17:25.378132 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:25.378149 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 17:17:25.378261 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:17:25.379114 (+ 853us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:17:25.379117 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:17:25.379161 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:17:25.379282 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:17:25.379288 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:17:25.380367 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:17:25.380372 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:17:25.381848 (+ 1476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:17:25.381861 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:17:25.382922 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:17:25.382926 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:17:25.383036 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:17:25.383075 (+ 39us) client_negotiation.cc:769] Sending connection context
0923 17:17:25.383191 (+ 116us) client_negotiation.cc:240] Negotiation successful
0923 17:17:25.383274 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"mutex_wait_us":28,"spinlock_wait_cycles":896,"thread_start_us":65,"threads_started":1}
I20260923 17:17:25.383744 28612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:25.378211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:57125 (local address 127.11.229.130:45883)
0923 17:17:25.378349 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0923 17:17:25.378355 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 17:17:25.378674 (+ 319us) server_negotiation.cc:407] Connection header received
0923 17:17:25.378851 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:17:25.378858 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:17:25.378920 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:17:25.379002 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:17:25.379331 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:25.380172 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:25.382306 (+ 2134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:25.383026 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:25.383162 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:17:25.383218 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0923 17:17:25.383539 (+ 321us) server_negotiation.cc:299] Negotiation successful
0923 17:17:25.383622 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260923 17:17:25.384039 28555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "525232ec562f49d4b9fa0ac1158aea96" candidate_uuid: "26358176962d45319c4c4c34d54a6fc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c901e423907a457b8b547e20a43cc375" is_pre_election: true
I20260923 17:17:25.384089 28622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:25.377890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.130:45883 (local address 127.11.229.129:57125)
0923 17:17:25.378598 (+ 708us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:25.378611 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 17:17:25.378734 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:17:25.379077 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:17:25.379085 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:17:25.379103 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:17:25.379214 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:17:25.379219 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:17:25.380351 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:17:25.380356 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:17:25.382164 (+ 1808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:17:25.382174 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:17:25.383277 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:17:25.383281 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:17:25.383381 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:17:25.383404 (+ 23us) client_negotiation.cc:769] Sending connection context
0923 17:17:25.383894 (+ 490us) client_negotiation.cc:240] Negotiation successful
0923 17:17:25.383982 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":644,"mutex_wait_us":126,"spinlock_wait_cycles":3456,"thread_start_us":67,"threads_started":1}
I20260923 17:17:25.384212 28555 raft_consensus.cc:2379] T 525232ec562f49d4b9fa0ac1158aea96 P c901e423907a457b8b547e20a43cc375 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26358176962d45319c4c4c34d54a6fc5 in current term 1: Already voted for candidate 423661b82bab474c87565961f49ac5c3 in this term.
I20260923 17:17:25.384749 28423 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "525232ec562f49d4b9fa0ac1158aea96" candidate_uuid: "26358176962d45319c4c4c34d54a6fc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "423661b82bab474c87565961f49ac5c3" is_pre_election: true
I20260923 17:17:25.385314 28216 leader_election.cc:302] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26358176962d45319c4c4c34d54a6fc5; no voters: 423661b82bab474c87565961f49ac5c3, c901e423907a457b8b547e20a43cc375
I20260923 17:17:25.385586 28336 raft_consensus.cc:2726] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260923 17:17:25.386893 28141 catalog_manager.cc:5495] T 525232ec562f49d4b9fa0ac1158aea96 P 423661b82bab474c87565961f49ac5c3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 423661b82bab474c87565961f49ac5c3 (127.11.229.130). New cstate: current_term: 1 leader_uuid: "423661b82bab474c87565961f49ac5c3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c901e423907a457b8b547e20a43cc375" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 35229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "423661b82bab474c87565961f49ac5c3" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 45883 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26358176962d45319c4c4c34d54a6fc5" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38399 } health_report { overall_health: UNKNOWN } } }
I20260923 17:17:25.451452 28612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:25.447773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36264 (local address 127.11.229.130:45883)
0923 17:17:25.447940 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0923 17:17:25.447944 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:17:25.447957 (+ 13us) server_negotiation.cc:407] Connection header received
0923 17:17:25.448055 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:17:25.448057 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:17:25.448111 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:17:25.448213 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 17:17:25.448527 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:25.449086 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:25.449913 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:25.450115 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:25.450189 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:17:25.450521 (+ 332us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 17:17:25.450918 (+ 397us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 17:17:25.451007 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0923 17:17:25.451196 (+ 189us) server_negotiation.cc:299] Negotiation successful
0923 17:17:25.451243 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260923 17:17:25.457465 28555 raft_consensus.cc:1261] T 525232ec562f49d4b9fa0ac1158aea96 P c901e423907a457b8b547e20a43cc375 [term 1 FOLLOWER]: Refusing update from remote peer 423661b82bab474c87565961f49ac5c3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:17:25.457482 28284 raft_consensus.cc:1261] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5 [term 1 FOLLOWER]: Refusing update from remote peer 423661b82bab474c87565961f49ac5c3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:17:25.458098 28624 consensus_queue.cc:1035] T 525232ec562f49d4b9fa0ac1158aea96 P 423661b82bab474c87565961f49ac5c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c901e423907a457b8b547e20a43cc375" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 35229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:17:25.458324 28617 consensus_queue.cc:1035] T 525232ec562f49d4b9fa0ac1158aea96 P 423661b82bab474c87565961f49ac5c3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26358176962d45319c4c4c34d54a6fc5" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:17:25.463606 28627 mvcc.cc:205] Tried to move back new op lower bound from 7332593030986141696 to 7332593030692384768. Current Snapshot: MvccSnapshot[applied={T|T < 7332593030986141696}]
I20260923 17:17:25.463680 28628 mvcc.cc:205] Tried to move back new op lower bound from 7332593030986141696 to 7332593030692384768. Current Snapshot: MvccSnapshot[applied={T|T < 7332593030986141696}]
I20260923 17:17:25.466619 28629 mvcc.cc:205] Tried to move back new op lower bound from 7332593030986141696 to 7332593030692384768. Current Snapshot: MvccSnapshot[applied={T|T < 7332593030986141696}]
I20260923 17:17:25.473318 28142 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57238:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:17:25.473489 28142 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57238:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:17:25.475889 28142 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13: Sending DeleteTablet for 3 replicas of tablet 525232ec562f49d4b9fa0ac1158aea96
I20260923 17:17:25.476573 28535 tablet_service.cc:1514] Processing DeleteTablet for tablet 525232ec562f49d4b9fa0ac1158aea96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:17:25 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:52066
I20260923 17:17:25.476635 28264 tablet_service.cc:1514] Processing DeleteTablet for tablet 525232ec562f49d4b9fa0ac1158aea96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:17:25 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:37350
I20260923 17:17:25.476653 28403 tablet_service.cc:1514] Processing DeleteTablet for tablet 525232ec562f49d4b9fa0ac1158aea96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:17:25 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:36262
I20260923 17:17:25.477006 28637 tablet_replica.cc:330] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5: stopping tablet replica
I20260923 17:17:25.477227 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 28180
I20260923 17:17:25.477226 28638 tablet_replica.cc:330] T 525232ec562f49d4b9fa0ac1158aea96 P c901e423907a457b8b547e20a43cc375: stopping tablet replica
I20260923 17:17:25.477523 28638 raft_consensus.cc:2229] T 525232ec562f49d4b9fa0ac1158aea96 P c901e423907a457b8b547e20a43cc375 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:17:25.477804 28638 raft_consensus.cc:2258] T 525232ec562f49d4b9fa0ac1158aea96 P c901e423907a457b8b547e20a43cc375 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:17:25.478149 28639 tablet_replica.cc:330] T 525232ec562f49d4b9fa0ac1158aea96 P 423661b82bab474c87565961f49ac5c3: stopping tablet replica
I20260923 17:17:25.478442 28639 raft_consensus.cc:2229] T 525232ec562f49d4b9fa0ac1158aea96 P 423661b82bab474c87565961f49ac5c3 [term 1 LEADER]: Raft consensus shutting down.
I20260923 17:17:25.478770 28639 raft_consensus.cc:2258] T 525232ec562f49d4b9fa0ac1158aea96 P 423661b82bab474c87565961f49ac5c3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:17:25.479700 28638 ts_tablet_manager.cc:1905] T 525232ec562f49d4b9fa0ac1158aea96 P c901e423907a457b8b547e20a43cc375: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:17:25.480033 28639 ts_tablet_manager.cc:1905] T 525232ec562f49d4b9fa0ac1158aea96 P 423661b82bab474c87565961f49ac5c3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:17:25.482842 28639 ts_tablet_manager.cc:1918] T 525232ec562f49d4b9fa0ac1158aea96 P 423661b82bab474c87565961f49ac5c3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 17:17:25.482933 28639 log.cc:1196] T 525232ec562f49d4b9fa0ac1158aea96 P 423661b82bab474c87565961f49ac5c3: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-1/wal/wals/525232ec562f49d4b9fa0ac1158aea96
I20260923 17:17:25.483238 28639 ts_tablet_manager.cc:1939] T 525232ec562f49d4b9fa0ac1158aea96 P 423661b82bab474c87565961f49ac5c3: Deleting consensus metadata
I20260923 17:17:25.483539 28638 ts_tablet_manager.cc:1918] T 525232ec562f49d4b9fa0ac1158aea96 P c901e423907a457b8b547e20a43cc375: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 17:17:25.483697 28638 log.cc:1196] T 525232ec562f49d4b9fa0ac1158aea96 P c901e423907a457b8b547e20a43cc375: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-2/wal/wals/525232ec562f49d4b9fa0ac1158aea96
I20260923 17:17:25.484066 28638 ts_tablet_manager.cc:1939] T 525232ec562f49d4b9fa0ac1158aea96 P c901e423907a457b8b547e20a43cc375: Deleting consensus metadata
I20260923 17:17:25.484618 28126 catalog_manager.cc:4841] TS 423661b82bab474c87565961f49ac5c3 (127.11.229.130:45883): tablet 525232ec562f49d4b9fa0ac1158aea96 (table test-table [id=29b81b9aba90437baa615567db315b97]) successfully deleted
I20260923 17:17:25.485397 28129 catalog_manager.cc:4841] TS c901e423907a457b8b547e20a43cc375 (127.11.229.131:35229): tablet 525232ec562f49d4b9fa0ac1158aea96 (table test-table [id=29b81b9aba90437baa615567db315b97]) successfully deleted
W20260923 17:17:25.486786 28128 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.229.129:38399 (error 108)
I20260923 17:17:25.487888 28611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:25.487572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:38399 (local address 127.0.0.1:37366)
0923 17:17:25.487715 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:25.487788 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.129:38399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260923 17:17:25.488042 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 28335
W20260923 17:17:25.488131 28128 catalog_manager.cc:4584] TS 26358176962d45319c4c4c34d54a6fc5 (127.11.229.129:38399): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 525232ec562f49d4b9fa0ac1158aea96: Network error: Client connection negotiation failed: client connection to 127.11.229.129:38399: connect: Connection refused (error 111)
I20260923 17:17:25.494029 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 28472
I20260923 17:17:25.499367 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 28109
I20260923 17:17:45.505771 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:36279
--webserver_interface=127.11.229.190
--webserver_port=33075
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:35505
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:36279
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:17:45.625695 28641 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:17:45.626034 28641 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:17:45.626112 28641 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:17:45.630200 28641 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260923 17:17:45.630304 28641 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260923 17:17:45.630332 28641 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260923 17:17:45.630367 28641 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:17:45.630406 28641 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:17:45.630451 28641 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:17:45.630486 28641 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:17:45.630520 28641 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:17:45.636068 28641 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:35505
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:36279
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:36279
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.229.190
--webserver_port=33075
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28641
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:17:45.637120 28641 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:17:45.638132 28641 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:17:45.646541 28649 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:17:45.646541 28646 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:17:45.646731 28641 server_base.cc:1034] running on GCE node
W20260923 17:17:45.646865 28647 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:17:45.647539 28641 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:17:45.648543 28641 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:17:45.649775 28641 hybrid_clock.cc:648] HybridClock initialized: now 1790183865649761 us; error 25 us; skew 500 ppm
Sep 23 17:17:45 dist-test-slave-1x1f krb5kdc[27562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183865, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:17:45.652688 28641 init.cc:377] Logged in from keytab as kudu/127.11.229.190@KRBTEST.COM (short username kudu)
I20260923 17:17:45.653517 28641 webserver.cc:460] Webserver started at http://127.11.229.190:33075/ using document root <none> and password file <none>
I20260923 17:17:45.653998 28641 fs_manager.cc:359] Metadata directory not provided
I20260923 17:17:45.654054 28641 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:17:45.657678 28641 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260923 17:17:45.659703 28656 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:17:45.660989 28641 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260923 17:17:45.661156 28641 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "1a1c758878174c29a8ea96431421db13"
format_stamp: "Formatted at 2026-09-23 17:17:03 on dist-test-slave-1x1f"
server_key: "44938f7212d65a051bdbde8a1fb143f0"
server_key_iv: "4acbf9b95984fd33256fe3650db6b0aa"
server_key_version: "encryptionkey@0"
I20260923 17:17:45.661693 28641 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:17:45.680460 28641 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:17:45.683702 28641 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:17:45.683915 28641 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:17:45.690809 28641 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.190:36279
I20260923 17:17:45.691097 28708 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.190:36279 every 8 connection(s)
I20260923 17:17:45.691963 28641 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:17:45.692836 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 28641
I20260923 17:17:45.693285 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.129:38399
--local_ip_for_outbound_sockets=127.11.229.129
--tserver_master_addrs=127.11.229.190:36279
--webserver_port=34387
--webserver_interface=127.11.229.129
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab
--principal=kudu/127.11.229.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:35505
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 17:17:45.696971 28709 sys_catalog.cc:263] Verifying existing consensus state
I20260923 17:17:45.699635 28709 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13: Bootstrap starting.
I20260923 17:17:45.723037 28709 log.cc:824] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13: Log is configured to *not* fsync() on all Append() calls
I20260923 17:17:45.736824 28709 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260923 17:17:45.737236 28709 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13: Bootstrap complete.
I20260923 17:17:45.741343 28709 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a1c758878174c29a8ea96431421db13" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 36279 } }
I20260923 17:17:45.741748 28709 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a1c758878174c29a8ea96431421db13, State: Initialized, Role: FOLLOWER
I20260923 17:17:45.742216 28709 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a1c758878174c29a8ea96431421db13" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 36279 } }
I20260923 17:17:45.742411 28709 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:17:45.742501 28709 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:17:45.742615 28709 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [term 2 FOLLOWER]: Advancing to term 3
I20260923 17:17:45.744426 28709 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a1c758878174c29a8ea96431421db13" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 36279 } }
I20260923 17:17:45.744752 28709 leader_election.cc:302] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1a1c758878174c29a8ea96431421db13; no voters:
I20260923 17:17:45.745074 28709 leader_election.cc:288] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260923 17:17:45.745209 28713 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [term 3 FOLLOWER]: Leader election won for term 3
I20260923 17:17:45.745463 28713 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [term 3 LEADER]: Becoming Leader. State: Replica: 1a1c758878174c29a8ea96431421db13, State: Running, Role: LEADER
I20260923 17:17:45.745822 28713 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a1c758878174c29a8ea96431421db13" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 36279 } }
I20260923 17:17:45.746217 28709 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:17:45.747238 28714 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "1a1c758878174c29a8ea96431421db13" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a1c758878174c29a8ea96431421db13" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 36279 } } }
I20260923 17:17:45.747370 28714 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [sys.catalog]: This master's current role is: LEADER
I20260923 17:17:45.748026 28722 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:17:45.747996 28715 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1a1c758878174c29a8ea96431421db13. Latest consensus state: current_term: 3 leader_uuid: "1a1c758878174c29a8ea96431421db13" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a1c758878174c29a8ea96431421db13" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 36279 } } }
I20260923 17:17:45.748410 28715 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13 [sys.catalog]: This master's current role is: LEADER
I20260923 17:17:45.754366 28722 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:17:45.755290 28722 catalog_manager.cc:1259] Loaded cluster ID: 22ed4c47d61a4d62810a8152b4eff9d6
I20260923 17:17:45.755352 28722 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:17:45.757838 28722 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:17:45.758669 28722 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13: Loaded TSK: 0
I20260923 17:17:45.758766 28722 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 1a1c758878174c29a8ea96431421db13: Loaded TSK: 1
F20260923 17:17:45.759579 28722 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f422790d9ad google::LogMessage::Fail() at ??:0
@ 0x7f422791088a google::LogMessage::SendToLog() at ??:0
@ 0x7f422790d4de google::LogMessage::Flush() at ??:0
@ 0x7f422790ea19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f422a5d118d kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f422a5c9f0d kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f42322727bb kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f423224c99c kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f423224d178 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlvE3_clEv at ??:0
@ 0x7f423228edf8 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f42322ad82b std::function<>::operator()() at ??:0
@ 0x7f423224cb4f _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7f423224df3e kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f423224a579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7f423228e640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f4229b5f3d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f4229b5fc83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7f4229b613f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7f4229b50512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f422b1946db start_thread at ??:0
@ 0x7f422640b61f clone at ??:0
W20260923 17:17:45.835608 28711 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:17:45.835901 28711 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:17:45.835980 28711 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:17:45.840396 28711 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:17:45.840440 28711 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:17:45.840497 28711 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.129
I20260923 17:17:45.846256 28711 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:35505
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab
--principal=kudu/127.11.229.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.129:38399
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.229.129
--webserver_port=34387
--tserver_master_addrs=127.11.229.190:36279
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28711
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.129
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:17:45.847429 28711 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:17:45.848506 28711 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:17:45.860318 28756 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:17:45.860316 28759 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:17:45.860643 28711 server_base.cc:1034] running on GCE node
W20260923 17:17:45.860379 28757 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:17:45.861189 28711 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:17:45.861829 28711 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:17:45.863050 28711 hybrid_clock.cc:648] HybridClock initialized: now 1790183865863026 us; error 38 us; skew 500 ppm
Sep 23 17:17:45 dist-test-slave-1x1f krb5kdc[27562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183865, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:17:45.865978 28711 init.cc:377] Logged in from keytab as kudu/127.11.229.129@KRBTEST.COM (short username kudu)
I20260923 17:17:45.866922 28711 webserver.cc:460] Webserver started at http://127.11.229.129:34387/ using document root <none> and password file <none>
I20260923 17:17:45.867486 28711 fs_manager.cc:359] Metadata directory not provided
I20260923 17:17:45.867580 28711 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:17:45.871481 28711 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260923 17:17:45.873718 28766 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:17:45.875061 28711 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 17:17:45.875211 28711 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-0/wal
uuid: "26358176962d45319c4c4c34d54a6fc5"
format_stamp: "Formatted at 2026-09-23 17:17:03 on dist-test-slave-1x1f"
server_key: "d3d58befc684202d7afff505cd01d688"
server_key_iv: "341c9e25f50e17a49ee23fa3d4b0db6a"
server_key_version: "encryptionkey@0"
I20260923 17:17:45.875758 28711 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:17:45.899888 28711 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:17:45.903343 28711 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:17:45.903570 28711 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:17:45.904210 28711 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:17:45.905334 28773 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260923 17:17:45.910797 28711 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260923 17:17:45.910907 28711 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.000s
I20260923 17:17:45.910998 28711 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260923 17:17:45.913255 28711 ts_tablet_manager.cc:610] Registered 1 tablets
I20260923 17:17:45.913334 28711 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260923 17:17:45.913611 28773 tablet_bootstrap.cc:492] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5: Bootstrap starting.
I20260923 17:17:45.924409 28711 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.129:38399
I20260923 17:17:45.924606 28880 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.129:38399 every 8 connection(s)
I20260923 17:17:45.925426 28711 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
I20260923 17:17:45.930742 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 28711
I20260923 17:17:45.931183 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.130:45883
--local_ip_for_outbound_sockets=127.11.229.130
--tserver_master_addrs=127.11.229.190:36279
--webserver_port=45077
--webserver_interface=127.11.229.130
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab
--principal=kudu/127.11.229.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:35505
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 17:17:45.935616 28773 log.cc:824] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5: Log is configured to *not* fsync() on all Append() calls
I20260923 17:17:45.944667 28773 tablet_bootstrap.cc:492] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260923 17:17:45.945125 28773 tablet_bootstrap.cc:492] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5: Bootstrap complete.
I20260923 17:17:45.946606 28773 ts_tablet_manager.cc:1397] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5: Time spent bootstrapping tablet: real 0.033s user 0.025s sys 0.007s
I20260923 17:17:45.949919 28773 raft_consensus.cc:348] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c901e423907a457b8b547e20a43cc375" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 35229 } } peers { permanent_uuid: "423661b82bab474c87565961f49ac5c3" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 45883 } } peers { permanent_uuid: "26358176962d45319c4c4c34d54a6fc5" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38399 } }
I20260923 17:17:45.950486 28773 raft_consensus.cc:729] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26358176962d45319c4c4c34d54a6fc5, State: Initialized, Role: FOLLOWER
I20260923 17:17:45.951025 28773 consensus_queue.cc:260] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c901e423907a457b8b547e20a43cc375" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 35229 } } peers { permanent_uuid: "423661b82bab474c87565961f49ac5c3" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 45883 } } peers { permanent_uuid: "26358176962d45319c4c4c34d54a6fc5" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38399 } }
I20260923 17:17:45.952072 28773 ts_tablet_manager.cc:1428] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
W20260923 17:17:46.001761 28883 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:17:45.927481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.129:56479)
0923 17:17:45.927976 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:45.928028 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0923 17:17:45.928882 (+ 854us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:17:46.000749 (+ 71867us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":145,"threads_started":1}
W20260923 17:17:46.002424 28881 heartbeater.cc:644] Failed to heartbeat to 127.11.229.190:36279 (0 consecutive failures): Network error: Failed to ping master at 127.11.229.190:36279: Client connection negotiation failed: client connection to 127.11.229.190:36279: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260923 17:17:46.003190 28883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:46.002886 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.129:53021)
0923 17:17:46.003048 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:46.003123 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260923 17:17:46.003919 28883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:46.003689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.129:46439)
0923 17:17:46.003808 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:46.003860 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260923 17:17:46.004145 28881 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260923 17:17:46.044909 28884 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:17:46.045182 28884 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:17:46.045229 28884 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:17:46.049602 28884 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:17:46.049670 28884 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:17:46.049732 28884 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.130
I20260923 17:17:46.055045 28884 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:35505
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab
--principal=kudu/127.11.229.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.130:45883
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.229.130
--webserver_port=45077
--tserver_master_addrs=127.11.229.190:36279
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28884
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.130
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:17:46.056144 28884 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:17:46.057174 28884 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:17:46.066982 28894 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:17:46.066980 28891 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:17:46.066974 28892 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:17:46.067261 28884 server_base.cc:1034] running on GCE node
I20260923 17:17:46.067704 28884 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:17:46.068316 28884 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:17:46.069561 28884 hybrid_clock.cc:648] HybridClock initialized: now 1790183866069550 us; error 34 us; skew 500 ppm
Sep 23 17:17:46 dist-test-slave-1x1f krb5kdc[27562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183866, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:17:46.072566 28884 init.cc:377] Logged in from keytab as kudu/127.11.229.130@KRBTEST.COM (short username kudu)
I20260923 17:17:46.073513 28884 webserver.cc:460] Webserver started at http://127.11.229.130:45077/ using document root <none> and password file <none>
I20260923 17:17:46.074110 28884 fs_manager.cc:359] Metadata directory not provided
I20260923 17:17:46.074209 28884 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:17:46.078411 28884 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260923 17:17:46.080654 28901 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:17:46.082000 28884 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 17:17:46.082212 28884 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-1/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-1/wal
uuid: "423661b82bab474c87565961f49ac5c3"
format_stamp: "Formatted at 2026-09-23 17:17:03 on dist-test-slave-1x1f"
server_key: "3a7fb2a19b17f72ad1ba3254ffdf3aa2"
server_key_iv: "cf00c1517cf52cbfe36b98964fc079e9"
server_key_version: "encryptionkey@0"
I20260923 17:17:46.082864 28884 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:17:46.107273 28884 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:17:46.110626 28884 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:17:46.110872 28884 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:17:46.111481 28884 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:17:46.112322 28884 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:17:46.112401 28884 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:17:46.112473 28884 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:17:46.112506 28884 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:17:46.122076 28884 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.130:45883
I20260923 17:17:46.122102 29014 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.130:45883 every 8 connection(s)
I20260923 17:17:46.123082 28884 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
I20260923 17:17:46.126607 29017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:46.125109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.130:50231)
0923 17:17:46.125739 (+ 630us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:46.125843 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":102,"threads_started":1}
W20260923 17:17:46.127128 29015 heartbeater.cc:644] Failed to heartbeat to 127.11.229.190:36279 (0 consecutive failures): Network error: Failed to ping master at 127.11.229.190:36279: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
I20260923 17:17:46.127750 29017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:46.127503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.130:41091)
0923 17:17:46.127640 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:46.127693 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260923 17:17:46.128566 29017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:46.128266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.130:45071)
0923 17:17:46.128399 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:46.128445 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260923 17:17:46.128806 29015 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260923 17:17:46.128824 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 28884
I20260923 17:17:46.129237 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.131:35229
--local_ip_for_outbound_sockets=127.11.229.131
--tserver_master_addrs=127.11.229.190:36279
--webserver_port=44383
--webserver_interface=127.11.229.131
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab
--principal=kudu/127.11.229.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:35505
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:17:46.244302 29018 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:17:46.244673 29018 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:17:46.244765 29018 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:17:46.249759 29018 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:17:46.249819 29018 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:17:46.249909 29018 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.131
I20260923 17:17:46.255870 29018 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:35505
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab
--principal=kudu/127.11.229.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.131:35229
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.229.131
--webserver_port=44383
--tserver_master_addrs=127.11.229.190:36279
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29018
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.131
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:17:46.256916 29018 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:17:46.257902 29018 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:17:46.267611 29026 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:17:46.267710 29018 server_base.cc:1034] running on GCE node
W20260923 17:17:46.267648 29023 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:17:46.267611 29024 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:17:46.268314 29018 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:17:46.268939 29018 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:17:46.270167 29018 hybrid_clock.cc:648] HybridClock initialized: now 1790183866270154 us; error 25 us; skew 500 ppm
Sep 23 17:17:46 dist-test-slave-1x1f krb5kdc[27562](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183866, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:17:46.272969 29018 init.cc:377] Logged in from keytab as kudu/127.11.229.131@KRBTEST.COM (short username kudu)
I20260923 17:17:46.273818 29018 webserver.cc:460] Webserver started at http://127.11.229.131:44383/ using document root <none> and password file <none>
I20260923 17:17:46.274448 29018 fs_manager.cc:359] Metadata directory not provided
I20260923 17:17:46.274537 29018 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:17:46.278220 29018 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260923 17:17:46.280571 29033 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:17:46.281810 29018 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 17:17:46.281952 29018 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-2/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-2/wal
uuid: "c901e423907a457b8b547e20a43cc375"
format_stamp: "Formatted at 2026-09-23 17:17:03 on dist-test-slave-1x1f"
server_key: "6a57eac7997317e1c1408981fec37005"
server_key_iv: "65f34e9ec94a6da1cbcda2ea3f50bc58"
server_key_version: "encryptionkey@0"
I20260923 17:17:46.282539 29018 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:17:46.301821 29018 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:17:46.305086 29018 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:17:46.305331 29018 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:17:46.306176 29018 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:17:46.307111 29018 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:17:46.307186 29018 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:17:46.307260 29018 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:17:46.307305 29018 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:17:46.316581 29018 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.131:35229
I20260923 17:17:46.316606 29146 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.131:35229 every 8 connection(s)
I20260923 17:17:46.317579 29018 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
I20260923 17:17:46.321234 29149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:46.319698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.131:35817)
0923 17:17:46.320360 (+ 662us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:46.320469 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":104,"threads_started":1}
W20260923 17:17:46.321666 29147 heartbeater.cc:644] Failed to heartbeat to 127.11.229.190:36279 (0 consecutive failures): Network error: Failed to ping master at 127.11.229.190:36279: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
I20260923 17:17:46.322340 29149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:46.322058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.131:39269)
0923 17:17:46.322181 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:46.322279 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260923 17:17:46.322990 29149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:46.322788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.131:47375)
0923 17:17:46.322891 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:46.322935 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260923 17:17:46.323167 29147 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260923 17:17:46.326186 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 29018
I20260923 17:17:47.005257 29151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:47.004727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.129:41647)
0923 17:17:47.005015 (+ 288us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:47.005074 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":76,"threads_started":1}
I20260923 17:17:47.129830 29152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:47.129418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.130:54715)
0923 17:17:47.129678 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:47.129735 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":69,"threads_started":1}
I20260923 17:17:47.324234 29153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:47.323722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.131:58051)
0923 17:17:47.324001 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:47.324127 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":71,"threads_started":1}
I20260923 17:17:47.480578 29154 raft_consensus.cc:482] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 17:17:47.480829 29154 raft_consensus.cc:504] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c901e423907a457b8b547e20a43cc375" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 35229 } } peers { permanent_uuid: "423661b82bab474c87565961f49ac5c3" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 45883 } } peers { permanent_uuid: "26358176962d45319c4c4c34d54a6fc5" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38399 } }
I20260923 17:17:47.482035 29154 leader_election.cc:288] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c901e423907a457b8b547e20a43cc375 (127.11.229.131:35229), 423661b82bab474c87565961f49ac5c3 (127.11.229.130:45883)
Sep 23 17:17:47 dist-test-slave-1x1f krb5kdc[27562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183865, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.129@KRBTEST.COM for kudu/127.11.229.131@KRBTEST.COM
Sep 23 17:17:47 dist-test-slave-1x1f krb5kdc[27562](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183865, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.129@KRBTEST.COM for kudu/127.11.229.130@KRBTEST.COM
I20260923 17:17:47.496229 29155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:47.482305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.131:35229 (local address 127.11.229.129:52537)
0923 17:17:47.482768 (+ 463us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:47.482782 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 17:17:47.482857 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:17:47.484438 (+ 1581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:17:47.484444 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:17:47.485014 (+ 570us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:17:47.485544 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:17:47.485557 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:17:47.487059 (+ 1502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:17:47.487062 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:17:47.488121 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:17:47.488131 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:17:47.488811 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:17:47.488815 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:17:47.489051 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:17:47.489762 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:17:47.489775 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:17:47.491449 (+ 1674us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:17:47.493732 (+ 2283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:17:47.493738 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:17:47.493751 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:17:47.494094 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:17:47.494499 (+ 405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:17:47.494504 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:17:47.494506 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:17:47.494638 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:17:47.495344 (+ 706us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:17:47.495353 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:17:47.495626 (+ 273us) client_negotiation.cc:769] Sending connection context
0923 17:17:47.495855 (+ 229us) client_negotiation.cc:240] Negotiation successful
0923 17:17:47.496085 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":413,"mutex_wait_us":288,"spinlock_wait_cycles":20224,"thread_start_us":65,"threads_started":1}
I20260923 17:17:47.496447 29157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:47.482505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:52817 (local address 127.11.229.130:45883)
0923 17:17:47.482860 (+ 355us) server_negotiation.cc:206] Beginning negotiation
0923 17:17:47.482878 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0923 17:17:47.482909 (+ 31us) server_negotiation.cc:407] Connection header received
0923 17:17:47.483577 (+ 668us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:17:47.483582 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:17:47.483961 (+ 379us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:17:47.484377 (+ 416us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:17:47.485671 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:47.486915 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:47.488238 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:47.488681 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:47.488856 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:17:47.491985 (+ 3129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:17:47.491989 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:17:47.492000 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:17:47.492025 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:17:47.493714 (+ 1689us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:17:47.494258 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:17:47.494264 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:17:47.494269 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:17:47.494396 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:17:47.494756 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:17:47.494759 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:17:47.494761 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:17:47.495220 (+ 459us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:17:47.495366 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0923 17:17:47.495975 (+ 609us) server_negotiation.cc:299] Negotiation successful
0923 17:17:47.496244 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":264,"thread_start_us":70,"threads_started":1}
I20260923 17:17:47.496892 29151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:47.482301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.130:45883 (local address 127.11.229.129:52817)
0923 17:17:47.482469 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:47.482487 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 17:17:47.482595 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:17:47.484438 (+ 1843us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:17:47.484444 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:17:47.485014 (+ 570us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:17:47.485503 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:17:47.485519 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:17:47.487067 (+ 1548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:17:47.487071 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:17:47.488115 (+ 1044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:17:47.488125 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:17:47.488804 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:17:47.488807 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:17:47.489047 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:17:47.489732 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:17:47.489747 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:17:47.491792 (+ 2045us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:17:47.493830 (+ 2038us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:17:47.493836 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:17:47.493839 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:17:47.494123 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:17:47.494492 (+ 369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:17:47.494496 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:17:47.494498 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:17:47.494635 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:17:47.495342 (+ 707us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:17:47.495348 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:17:47.495632 (+ 284us) client_negotiation.cc:769] Sending connection context
0923 17:17:47.495857 (+ 225us) client_negotiation.cc:240] Negotiation successful
0923 17:17:47.496159 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":89,"mutex_wait_us":252,"spinlock_wait_cycles":31488}
I20260923 17:17:47.497171 29156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:47.482437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:52537 (local address 127.11.229.131:35229)
0923 17:17:47.482775 (+ 338us) server_negotiation.cc:206] Beginning negotiation
0923 17:17:47.482807 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0923 17:17:47.482852 (+ 45us) server_negotiation.cc:407] Connection header received
0923 17:17:47.483561 (+ 709us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:17:47.483590 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:17:47.483959 (+ 369us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:17:47.484261 (+ 302us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:17:47.485711 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:47.486887 (+ 1176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:47.488245 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:17:47.488690 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:17:47.488860 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:17:47.491715 (+ 2855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:17:47.491720 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:17:47.491733 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:17:47.491760 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:17:47.493597 (+ 1837us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:17:47.494264 (+ 667us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:17:47.494273 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:17:47.494278 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:17:47.494403 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:17:47.494746 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:17:47.494749 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:17:47.494751 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:17:47.495138 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:17:47.495297 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0923 17:17:47.496713 (+ 1416us) server_negotiation.cc:299] Negotiation successful
0923 17:17:47.496976 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":220,"thread_start_us":108,"threads_started":1}
W20260923 17:17:47.499276 28770 leader_election.cc:341] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c901e423907a457b8b547e20a43cc375 (127.11.229.131:35229): Not found: Tablet not found: 525232ec562f49d4b9fa0ac1158aea96
W20260923 17:17:47.499423 28767 leader_election.cc:341] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 423661b82bab474c87565961f49ac5c3 (127.11.229.130:45883): Not found: Tablet not found: 525232ec562f49d4b9fa0ac1158aea96
I20260923 17:17:47.499557 28767 leader_election.cc:302] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26358176962d45319c4c4c34d54a6fc5; no voters: 423661b82bab474c87565961f49ac5c3, c901e423907a457b8b547e20a43cc375
I20260923 17:17:47.499817 29154 raft_consensus.cc:2726] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260923 17:17:48.006641 29158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:48.006170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.129:48359)
0923 17:17:48.006466 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:48.006525 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":128,"threads_started":1}
I20260923 17:17:48.131050 29159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:48.130633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.130:53535)
0923 17:17:48.130907 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:48.130961 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":100,"threads_started":1}
I20260923 17:17:48.325417 29160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:48.325030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.131:58219)
0923 17:17:48.325269 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:48.325326 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":76,"threads_started":1}
I20260923 17:17:49.007889 29161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:49.007463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.129:37275)
0923 17:17:49.007735 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:49.007793 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":76,"threads_started":1}
I20260923 17:17:49.132380 29162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:49.131915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.130:52337)
0923 17:17:49.132217 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:49.132278 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":88,"threads_started":1}
I20260923 17:17:49.292186 29163 raft_consensus.cc:482] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 17:17:49.292379 29163 raft_consensus.cc:504] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c901e423907a457b8b547e20a43cc375" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 35229 } } peers { permanent_uuid: "423661b82bab474c87565961f49ac5c3" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 45883 } } peers { permanent_uuid: "26358176962d45319c4c4c34d54a6fc5" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38399 } }
I20260923 17:17:49.292856 29163 leader_election.cc:288] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c901e423907a457b8b547e20a43cc375 (127.11.229.131:35229), 423661b82bab474c87565961f49ac5c3 (127.11.229.130:45883)
W20260923 17:17:49.293934 28767 leader_election.cc:341] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 423661b82bab474c87565961f49ac5c3 (127.11.229.130:45883): Not found: Tablet not found: 525232ec562f49d4b9fa0ac1158aea96
W20260923 17:17:49.294047 28770 leader_election.cc:341] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c901e423907a457b8b547e20a43cc375 (127.11.229.131:35229): Not found: Tablet not found: 525232ec562f49d4b9fa0ac1158aea96
I20260923 17:17:49.294114 28770 leader_election.cc:302] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26358176962d45319c4c4c34d54a6fc5; no voters: 423661b82bab474c87565961f49ac5c3, c901e423907a457b8b547e20a43cc375
I20260923 17:17:49.294289 29163 raft_consensus.cc:2726] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260923 17:17:49.326675 29164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:49.326182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.131:36947)
0923 17:17:49.326521 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:49.326574 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":165,"threads_started":1}
I20260923 17:17:50.009181 29165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:50.008710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.129:34829)
0923 17:17:50.009000 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:50.009075 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":74,"threads_started":1}
I20260923 17:17:50.133563 29166 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:50.133102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.130:57305)
0923 17:17:50.133417 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:50.133471 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":88,"threads_started":1}
I20260923 17:17:50.327917 29167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:50.327488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.131:46777)
0923 17:17:50.327743 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:50.327797 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":95,"threads_started":1}
I20260923 17:17:51.010681 29168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:51.010168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.129:45527)
0923 17:17:51.010526 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:51.010584 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":147,"threads_started":1}
I20260923 17:17:51.134944 29169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:51.134492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.130:35375)
0923 17:17:51.134794 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:51.134853 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":93,"threads_started":1}
I20260923 17:17:51.329269 29170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:51.328811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.131:34975)
0923 17:17:51.329102 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:51.329166 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":86,"threads_started":1}
I20260923 17:17:51.806798 29171 raft_consensus.cc:482] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 17:17:51.806933 29171 raft_consensus.cc:504] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c901e423907a457b8b547e20a43cc375" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 35229 } } peers { permanent_uuid: "423661b82bab474c87565961f49ac5c3" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 45883 } } peers { permanent_uuid: "26358176962d45319c4c4c34d54a6fc5" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38399 } }
I20260923 17:17:51.807377 29171 leader_election.cc:288] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c901e423907a457b8b547e20a43cc375 (127.11.229.131:35229), 423661b82bab474c87565961f49ac5c3 (127.11.229.130:45883)
W20260923 17:17:51.808271 28770 leader_election.cc:341] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c901e423907a457b8b547e20a43cc375 (127.11.229.131:35229): Not found: Tablet not found: 525232ec562f49d4b9fa0ac1158aea96
W20260923 17:17:51.808386 28767 leader_election.cc:341] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 423661b82bab474c87565961f49ac5c3 (127.11.229.130:45883): Not found: Tablet not found: 525232ec562f49d4b9fa0ac1158aea96
I20260923 17:17:51.808475 28767 leader_election.cc:302] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26358176962d45319c4c4c34d54a6fc5; no voters: 423661b82bab474c87565961f49ac5c3, c901e423907a457b8b547e20a43cc375
I20260923 17:17:51.808643 29171 raft_consensus.cc:2726] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260923 17:17:52.011931 29172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:52.011526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.129:41275)
0923 17:17:52.011782 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:52.011838 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":88,"threads_started":1}
I20260923 17:17:52.136363 29173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:52.135861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.130:39765)
0923 17:17:52.136153 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:52.136244 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":117,"threads_started":1}
I20260923 17:17:52.330631 29174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:52.330137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.131:32879)
0923 17:17:52.330468 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:52.330535 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":139,"threads_started":1}
I20260923 17:17:53.013188 29175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:53.012776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.129:34125)
0923 17:17:53.013044 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:53.013096 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":198,"thread_start_us":92,"threads_started":1}
I20260923 17:17:53.137691 29176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:53.137187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.130:39323)
0923 17:17:53.137529 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:53.137593 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":82,"threads_started":1}
I20260923 17:17:53.331928 29177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:53.331404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.131:52343)
0923 17:17:53.331783 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:53.331836 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":122,"threads_started":1}
I20260923 17:17:54.014505 29178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:54.014006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.129:37133)
0923 17:17:54.014341 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:54.014400 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":89,"threads_started":1}
I20260923 17:17:54.082746 29179 raft_consensus.cc:482] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 17:17:54.082882 29179 raft_consensus.cc:504] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c901e423907a457b8b547e20a43cc375" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 35229 } } peers { permanent_uuid: "423661b82bab474c87565961f49ac5c3" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 45883 } } peers { permanent_uuid: "26358176962d45319c4c4c34d54a6fc5" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38399 } }
I20260923 17:17:54.083259 29179 leader_election.cc:288] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c901e423907a457b8b547e20a43cc375 (127.11.229.131:35229), 423661b82bab474c87565961f49ac5c3 (127.11.229.130:45883)
W20260923 17:17:54.084324 28767 leader_election.cc:341] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 423661b82bab474c87565961f49ac5c3 (127.11.229.130:45883): Not found: Tablet not found: 525232ec562f49d4b9fa0ac1158aea96
W20260923 17:17:54.084434 28770 leader_election.cc:341] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c901e423907a457b8b547e20a43cc375 (127.11.229.131:35229): Not found: Tablet not found: 525232ec562f49d4b9fa0ac1158aea96
I20260923 17:17:54.084484 28770 leader_election.cc:302] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26358176962d45319c4c4c34d54a6fc5; no voters: 423661b82bab474c87565961f49ac5c3, c901e423907a457b8b547e20a43cc375
I20260923 17:17:54.084635 29179 raft_consensus.cc:2726] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260923 17:17:54.139053 29180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:54.138624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.130:42641)
0923 17:17:54.138888 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:54.138950 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":76,"threads_started":1}
I20260923 17:17:54.333009 29181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:54.332607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.131:37741)
0923 17:17:54.332864 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:54.332920 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":82,"threads_started":1}
I20260923 17:17:55.015931 29182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:55.015462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.129:35185)
0923 17:17:55.015767 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:55.015829 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":75,"threads_started":1}
I20260923 17:17:55.140367 29183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:55.139911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.130:60977)
0923 17:17:55.140215 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:55.140273 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":83,"threads_started":1}
I20260923 17:17:55.334447 29184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:55.333850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.131:38035)
0923 17:17:55.334120 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:55.334180 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":102,"threads_started":1}
I20260923 17:17:56.017357 29185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:56.016876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.129:50501)
0923 17:17:56.017169 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:56.017228 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":90,"threads_started":1}
I20260923 17:17:56.141753 29186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:56.141304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.130:50057)
0923 17:17:56.141580 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:56.141650 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":80,"threads_started":1}
I20260923 17:17:56.335744 29187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:56.335280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.131:57661)
0923 17:17:56.335578 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:56.335647 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":90,"threads_started":1}
I20260923 17:17:57.009104 29188 raft_consensus.cc:482] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 17:17:57.009330 29188 raft_consensus.cc:504] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c901e423907a457b8b547e20a43cc375" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 35229 } } peers { permanent_uuid: "423661b82bab474c87565961f49ac5c3" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 45883 } } peers { permanent_uuid: "26358176962d45319c4c4c34d54a6fc5" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38399 } }
I20260923 17:17:57.009819 29188 leader_election.cc:288] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c901e423907a457b8b547e20a43cc375 (127.11.229.131:35229), 423661b82bab474c87565961f49ac5c3 (127.11.229.130:45883)
W20260923 17:17:57.010694 28770 leader_election.cc:341] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer c901e423907a457b8b547e20a43cc375 (127.11.229.131:35229): Not found: Tablet not found: 525232ec562f49d4b9fa0ac1158aea96
W20260923 17:17:57.010784 28767 leader_election.cc:341] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 423661b82bab474c87565961f49ac5c3 (127.11.229.130:45883): Not found: Tablet not found: 525232ec562f49d4b9fa0ac1158aea96
I20260923 17:17:57.010848 28767 leader_election.cc:302] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26358176962d45319c4c4c34d54a6fc5; no voters: 423661b82bab474c87565961f49ac5c3, c901e423907a457b8b547e20a43cc375
I20260923 17:17:57.010984 29188 raft_consensus.cc:2726] T 525232ec562f49d4b9fa0ac1158aea96 P 26358176962d45319c4c4c34d54a6fc5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260923 17:17:57.018610 29189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:57.018134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.129:48377)
0923 17:17:57.018448 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:57.018509 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":115,"threads_started":1}
I20260923 17:17:57.142989 29190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:57.142591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.130:46349)
0923 17:17:57.142837 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:57.142897 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":75,"threads_started":1}
I20260923 17:17:57.336997 29191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:57.336551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.131:38907)
0923 17:17:57.336847 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:57.336908 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":102,"threads_started":1}
I20260923 17:17:58.019845 29192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:58.019381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.129:43121)
0923 17:17:58.019660 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:58.019733 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":80,"threads_started":1}
I20260923 17:17:58.144344 29193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:58.143858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.130:36555)
0923 17:17:58.144186 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:58.144248 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":74,"threads_started":1}
I20260923 17:17:58.338433 29194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:58.337859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.131:37295)
0923 17:17:58.338194 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:58.338330 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":85,"threads_started":1}
I20260923 17:17:59.021081 29195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:59.020679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.129:33661)
0923 17:17:59.020917 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:59.020979 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":93,"threads_started":1}
I20260923 17:17:59.145555 29196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:59.145127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.130:60357)
0923 17:17:59.145400 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:59.145459 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":89,"threads_started":1}
I20260923 17:17:59.339751 29197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:17:59.339280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.131:48389)
0923 17:17:59.339588 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0923 17:17:59.339651 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":101,"threads_started":1}
I20260923 17:18:00.022356 29198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:00.021871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.129:40053)
0923 17:18:00.022147 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:00.022199 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":76,"threads_started":1}
I20260923 17:18:00.146791 29199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:00.146360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.130:57973)
0923 17:18:00.146620 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:00.146680 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":87,"threads_started":1}
I20260923 17:18:00.340927 29200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:00.340527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.131:52755)
0923 17:18:00.340782 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:00.340835 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":104,"threads_started":1}
I20260923 17:18:01.023779 29201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:01.023352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.129:44479)
0923 17:18:01.023613 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:01.023684 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":68,"threads_started":1}
I20260923 17:18:01.148114 29202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:01.147714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.130:59755)
0923 17:18:01.147970 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:01.148022 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":80,"threads_started":1}
I20260923 17:18:01.331678 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 28711
I20260923 17:18:01.337954 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 28884
I20260923 17:18:01.342454 29203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:01.341955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36279 (local address 127.11.229.131:43179)
0923 17:18:01.342309 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:01.342366 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.190:36279: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":83,"threads_started":1}
I20260923 17:18:01.343963 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 29018
2026-09-23T17:18:01Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (59561 ms)
[----------] 30 tests from SecurityITest (247598 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 17:18:01 dist-test-slave-1x1f krb5kdc[29206](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 17:18:01 dist-test-slave-1x1f krb5kdc[29206](info): set up 2 sockets
Sep 23 17:18:01 dist-test-slave-1x1f krb5kdc[29206](info): commencing operation
krb5kdc: starting...
W20260923 17:18:02.407078 12182 mini_kdc.cc:121] Time spent starting KDC: real 1.041s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Sep 23 17:18:02 dist-test-slave-1x1f krb5kdc[29206](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183882, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T17:18:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:18:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.229.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
I20260923 17:18:02.533811 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:36547
--webserver_interface=127.11.229.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:34069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:36547
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:18:02.640426 29219 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:18:02.640760 29219 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:18:02.640848 29219 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:18:02.644920 29219 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:18:02.645015 29219 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:18:02.645053 29219 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:18:02.645092 29219 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:18:02.645121 29219 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:18:02.650473 29219 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:34069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:36547
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:36547
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.229.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29219
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:18:02.651615 29219 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:18:02.652633 29219 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:18:02.661799 29227 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:02.661887 29224 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:02.661861 29219 server_base.cc:1034] running on GCE node
W20260923 17:18:02.662259 29225 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:02.662801 29219 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:18:02.663892 29219 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:18:02.665076 29219 hybrid_clock.cc:648] HybridClock initialized: now 1790183882665034 us; error 52 us; skew 500 ppm
Sep 23 17:18:02 dist-test-slave-1x1f krb5kdc[29206](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183882, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:18:02.674712 29219 init.cc:377] Logged in from keytab as kudu/127.11.229.190@KRBTEST.COM (short username kudu)
I20260923 17:18:02.675619 29219 webserver.cc:460] Webserver started at http://127.11.229.190:40995/ using document root <none> and password file <none>
I20260923 17:18:02.676226 29219 fs_manager.cc:359] Metadata directory not provided
I20260923 17:18:02.676295 29219 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:18:02.676457 29219 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:18:02.678457 29219 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "86e8a0cd85c747b2b58d32da2db917f3"
format_stamp: "Formatted at 2026-09-23 17:18:02 on dist-test-slave-1x1f"
server_key: "9a2adfae0f44fbf0ee2b176a13ed16fa"
server_key_iv: "85bb577e518ea02df7eab806b956cea0"
server_key_version: "encryptionkey@0"
I20260923 17:18:02.678956 29219 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "86e8a0cd85c747b2b58d32da2db917f3"
format_stamp: "Formatted at 2026-09-23 17:18:02 on dist-test-slave-1x1f"
server_key: "9a2adfae0f44fbf0ee2b176a13ed16fa"
server_key_iv: "85bb577e518ea02df7eab806b956cea0"
server_key_version: "encryptionkey@0"
I20260923 17:18:02.682518 29219 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260923 17:18:02.684794 29234 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:02.686173 29219 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 17:18:02.686379 29219 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "86e8a0cd85c747b2b58d32da2db917f3"
format_stamp: "Formatted at 2026-09-23 17:18:02 on dist-test-slave-1x1f"
server_key: "9a2adfae0f44fbf0ee2b176a13ed16fa"
server_key_iv: "85bb577e518ea02df7eab806b956cea0"
server_key_version: "encryptionkey@0"
I20260923 17:18:02.686477 29219 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:18:02.700217 29219 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:18:02.703369 29219 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:18:02.703567 29219 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:18:02.711093 29219 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.190:36547
I20260923 17:18:02.711119 29286 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.190:36547 every 8 connection(s)
I20260923 17:18:02.712111 29219 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:18:02.714970 29287 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:18:02.720211 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 29219
I20260923 17:18:02.720335 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:18:02.720652 12182 external_mini_cluster.cc:1428] Setting key b000f584256ed1dac4013d4039c73cd0
I20260923 17:18:02.720652 29287 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86e8a0cd85c747b2b58d32da2db917f3: Bootstrap starting.
I20260923 17:18:02.723381 29287 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 86e8a0cd85c747b2b58d32da2db917f3: Neither blocks nor log segments found. Creating new log.
I20260923 17:18:02.724246 29287 log.cc:824] T 00000000000000000000000000000000 P 86e8a0cd85c747b2b58d32da2db917f3: Log is configured to *not* fsync() on all Append() calls
I20260923 17:18:02.726608 29287 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86e8a0cd85c747b2b58d32da2db917f3: No bootstrap required, opened a new log
Sep 23 17:18:02 dist-test-slave-1x1f krb5kdc[29206](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183882, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:18:02.731103 29287 raft_consensus.cc:348] T 00000000000000000000000000000000 P 86e8a0cd85c747b2b58d32da2db917f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86e8a0cd85c747b2b58d32da2db917f3" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 36547 } }
I20260923 17:18:02.731380 29287 raft_consensus.cc:374] T 00000000000000000000000000000000 P 86e8a0cd85c747b2b58d32da2db917f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:18:02.731451 29287 raft_consensus.cc:729] T 00000000000000000000000000000000 P 86e8a0cd85c747b2b58d32da2db917f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86e8a0cd85c747b2b58d32da2db917f3, State: Initialized, Role: FOLLOWER
I20260923 17:18:02.731983 29287 consensus_queue.cc:260] T 00000000000000000000000000000000 P 86e8a0cd85c747b2b58d32da2db917f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86e8a0cd85c747b2b58d32da2db917f3" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 36547 } }
I20260923 17:18:02.732178 29287 raft_consensus.cc:388] T 00000000000000000000000000000000 P 86e8a0cd85c747b2b58d32da2db917f3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:18:02.732262 29287 raft_consensus.cc:482] T 00000000000000000000000000000000 P 86e8a0cd85c747b2b58d32da2db917f3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:18:02.732363 29287 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 86e8a0cd85c747b2b58d32da2db917f3 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:18:02.733382 29287 raft_consensus.cc:504] T 00000000000000000000000000000000 P 86e8a0cd85c747b2b58d32da2db917f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86e8a0cd85c747b2b58d32da2db917f3" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 36547 } }
I20260923 17:18:02.733772 29287 leader_election.cc:302] T 00000000000000000000000000000000 P 86e8a0cd85c747b2b58d32da2db917f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 86e8a0cd85c747b2b58d32da2db917f3; no voters:
I20260923 17:18:02.734120 29287 leader_election.cc:288] T 00000000000000000000000000000000 P 86e8a0cd85c747b2b58d32da2db917f3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 17:18:02.734323 29292 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 86e8a0cd85c747b2b58d32da2db917f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:18:02.734545 29292 raft_consensus.cc:686] T 00000000000000000000000000000000 P 86e8a0cd85c747b2b58d32da2db917f3 [term 1 LEADER]: Becoming Leader. State: Replica: 86e8a0cd85c747b2b58d32da2db917f3, State: Running, Role: LEADER
I20260923 17:18:02.734932 29292 consensus_queue.cc:237] T 00000000000000000000000000000000 P 86e8a0cd85c747b2b58d32da2db917f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86e8a0cd85c747b2b58d32da2db917f3" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 36547 } }
I20260923 17:18:02.735492 29287 sys_catalog.cc:564] T 00000000000000000000000000000000 P 86e8a0cd85c747b2b58d32da2db917f3 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:18:02.736567 29294 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86e8a0cd85c747b2b58d32da2db917f3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 86e8a0cd85c747b2b58d32da2db917f3. Latest consensus state: current_term: 1 leader_uuid: "86e8a0cd85c747b2b58d32da2db917f3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86e8a0cd85c747b2b58d32da2db917f3" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 36547 } } }
I20260923 17:18:02.736699 29294 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86e8a0cd85c747b2b58d32da2db917f3 [sys.catalog]: This master's current role is: LEADER
I20260923 17:18:02.736749 29290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:02.722034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50254 (local address 127.11.229.190:36547)
0923 17:18:02.722493 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:02.722516 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:02.722557 (+ 41us) server_negotiation.cc:407] Connection header received
0923 17:18:02.723433 (+ 876us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:02.723458 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:02.723893 (+ 435us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:02.724261 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:02.725196 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:02.726630 (+ 1434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:02.727539 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:02.728224 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:02.728434 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:02.731026 (+ 2592us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:02.731031 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:02.731044 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:02.731069 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:02.732930 (+ 1861us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:02.733457 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:02.733462 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:02.733494 (+ 32us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:02.733637 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:02.733968 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:02.733972 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:02.733973 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:02.734641 (+ 668us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:02.734840 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:02.735431 (+ 591us) server_negotiation.cc:299] Negotiation successful
0923 17:18:02.735740 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":312,"thread_start_us":179,"threads_started":1}
I20260923 17:18:02.737165 29293 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86e8a0cd85c747b2b58d32da2db917f3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "86e8a0cd85c747b2b58d32da2db917f3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86e8a0cd85c747b2b58d32da2db917f3" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 36547 } } }
I20260923 17:18:02.737362 29293 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86e8a0cd85c747b2b58d32da2db917f3 [sys.catalog]: This master's current role is: LEADER
W20260923 17:18:02.740217 29307 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 86e8a0cd85c747b2b58d32da2db917f3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 17:18:02.740309 29307 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 17:18:02.740394 29301 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:18:02.741129 29301 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:18:02.746598 29301 catalog_manager.cc:1347] Generated new cluster ID: 9d35912e15b741f684cec4d8b5bd7b8c
I20260923 17:18:02.746663 29301 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:18:02.753736 29301 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:18:02.754753 29301 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:18:02.764434 29301 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 86e8a0cd85c747b2b58d32da2db917f3: Generated new TSK 0
I20260923 17:18:02.765249 29301 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.229.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab.
Entry for principal kudu/127.11.229.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab.
I20260923 17:18:02.801684 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.129:0
--local_ip_for_outbound_sockets=127.11.229.129
--webserver_interface=127.11.229.129
--webserver_port=0
--tserver_master_addrs=127.11.229.190:36547
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab
--principal=kudu/127.11.229.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:34069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:18:02.910852 29313 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:18:02.911125 29313 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:18:02.911170 29313 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:18:02.915122 29313 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:18:02.915185 29313 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:18:02.915246 29313 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.129
I20260923 17:18:02.921919 29313 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:34069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab
--principal=kudu/127.11.229.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.229.129
--webserver_port=0
--tserver_master_addrs=127.11.229.190:36547
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29313
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.129
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:18:02.923036 29313 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:18:02.923983 29313 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:18:02.933880 29319 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:02.933890 29318 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:02.933872 29313 server_base.cc:1034] running on GCE node
W20260923 17:18:02.933856 29321 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:02.934526 29313 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:18:02.935089 29313 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:18:02.936278 29313 hybrid_clock.cc:648] HybridClock initialized: now 1790183882936257 us; error 30 us; skew 500 ppm
Sep 23 17:18:02 dist-test-slave-1x1f krb5kdc[29206](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183882, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:18:02.939453 29313 init.cc:377] Logged in from keytab as kudu/127.11.229.129@KRBTEST.COM (short username kudu)
I20260923 17:18:02.940249 29313 webserver.cc:460] Webserver started at http://127.11.229.129:43399/ using document root <none> and password file <none>
I20260923 17:18:02.940752 29313 fs_manager.cc:359] Metadata directory not provided
I20260923 17:18:02.940810 29313 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:18:02.940973 29313 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:18:02.942950 29313 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-0/data/instance:
uuid: "a927ec1e0d6f44299330f6e749c32fc2"
format_stamp: "Formatted at 2026-09-23 17:18:02 on dist-test-slave-1x1f"
server_key: "a811acad74eab11470cf015254d15cc2"
server_key_iv: "8d7f31c6529ccc57b75dad4fb8f974f1"
server_key_version: "encryptionkey@0"
I20260923 17:18:02.943454 29313 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance:
uuid: "a927ec1e0d6f44299330f6e749c32fc2"
format_stamp: "Formatted at 2026-09-23 17:18:02 on dist-test-slave-1x1f"
server_key: "a811acad74eab11470cf015254d15cc2"
server_key_iv: "8d7f31c6529ccc57b75dad4fb8f974f1"
server_key_version: "encryptionkey@0"
I20260923 17:18:02.946954 29313 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260923 17:18:02.949187 29328 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:02.950443 29313 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 17:18:02.950534 29313 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-0/wal
uuid: "a927ec1e0d6f44299330f6e749c32fc2"
format_stamp: "Formatted at 2026-09-23 17:18:02 on dist-test-slave-1x1f"
server_key: "a811acad74eab11470cf015254d15cc2"
server_key_iv: "8d7f31c6529ccc57b75dad4fb8f974f1"
server_key_version: "encryptionkey@0"
I20260923 17:18:02.950613 29313 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:18:02.961732 29313 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:18:02.964929 29313 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:18:02.965085 29313 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:18:02.965600 29313 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:18:02.966432 29313 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:18:02.966481 29313 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:02.966521 29313 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:18:02.966543 29313 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:02.975185 29313 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.129:38377
I20260923 17:18:02.975360 29441 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.129:38377 every 8 connection(s)
I20260923 17:18:02.976116 29313 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
I20260923 17:18:02.977900 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 29313
I20260923 17:18:02.978039 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance
I20260923 17:18:02.978412 12182 external_mini_cluster.cc:1428] Setting key 823b86875ec09b3e5ae52b787efb76e8
Sep 23 17:18:02 dist-test-slave-1x1f krb5kdc[29206](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183882, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.129@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.229.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.130@KRBTEST.COM" created.
I20260923 17:18:02.991309 29290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:02.978130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:39371 (local address 127.11.229.190:36547)
0923 17:18:02.978311 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:02.978316 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:02.979254 (+ 938us) server_negotiation.cc:407] Connection header received
0923 17:18:02.980936 (+ 1682us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:02.980939 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:02.980980 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:02.981120 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:02.982519 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:02.983057 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:02.984298 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:02.984540 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:02.984647 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:02.987196 (+ 2549us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:02.987206 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:02.987209 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:02.987232 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:02.988753 (+ 1521us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:02.989282 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:02.989285 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:02.989287 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:02.989366 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:02.989759 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:02.989764 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:02.989769 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:02.990072 (+ 303us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:02.990219 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:02.990975 (+ 756us) server_negotiation.cc:299] Negotiation successful
0923 17:18:02.991119 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260923 17:18:02.992345 29444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:02.978571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36547 (local address 127.11.229.129:39371)
0923 17:18:02.979087 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:02.979142 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:02.980688 (+ 1546us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:02.981228 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:02.981240 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:02.981772 (+ 532us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:18:02.982373 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:02.982388 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:02.983192 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:02.983196 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:02.984170 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:02.984180 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:02.984706 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:02.984710 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:02.984879 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:02.985497 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:18:02.985513 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:18:02.987011 (+ 1498us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:18:02.988890 (+ 1879us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:02.988896 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:02.988911 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:02.989174 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:02.989459 (+ 285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:02.989463 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:02.989465 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:02.989647 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:02.990257 (+ 610us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:18:02.990265 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:18:02.990645 (+ 380us) client_negotiation.cc:769] Sending connection context
0923 17:18:02.990879 (+ 234us) client_negotiation.cc:240] Negotiation successful
0923 17:18:02.991219 (+ 340us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":144,"threads_started":1}
I20260923 17:18:02.993758 29442 heartbeater.cc:347] Connected to a master server at 127.11.229.190:36547
I20260923 17:18:02.993997 29442 heartbeater.cc:464] Registering TS with master...
I20260923 17:18:02.994652 29442 heartbeater.cc:511] Master 127.11.229.190:36547 requested a full tablet report, sending...
I20260923 17:18:02.996167 29251 ts_manager.cc:194] Registered new tserver with Master: a927ec1e0d6f44299330f6e749c32fc2 (127.11.229.129:38377)
I20260923 17:18:02.997287 29251 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.129@KRBTEST.COM'} at 127.11.229.129:39371
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab.
Entry for principal kudu/127.11.229.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab.
I20260923 17:18:03.008869 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.130:0
--local_ip_for_outbound_sockets=127.11.229.130
--webserver_interface=127.11.229.130
--webserver_port=0
--tserver_master_addrs=127.11.229.190:36547
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab
--principal=kudu/127.11.229.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:34069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:18:03.119207 29447 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:18:03.119472 29447 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:18:03.119515 29447 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:18:03.123762 29447 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:18:03.123821 29447 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:18:03.123911 29447 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.130
I20260923 17:18:03.129144 29447 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:34069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab
--principal=kudu/127.11.229.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.229.130
--webserver_port=0
--tserver_master_addrs=127.11.229.190:36547
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29447
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.130
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:18:03.130172 29447 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:18:03.131192 29447 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:18:03.140990 29453 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:03.141067 29455 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:03.141106 29452 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:03.141270 29447 server_base.cc:1034] running on GCE node
I20260923 17:18:03.141676 29447 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:18:03.142426 29447 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:18:03.143611 29447 hybrid_clock.cc:648] HybridClock initialized: now 1790183883143595 us; error 27 us; skew 500 ppm
Sep 23 17:18:03 dist-test-slave-1x1f krb5kdc[29206](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183883, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:18:03.146458 29447 init.cc:377] Logged in from keytab as kudu/127.11.229.130@KRBTEST.COM (short username kudu)
I20260923 17:18:03.147331 29447 webserver.cc:460] Webserver started at http://127.11.229.130:33323/ using document root <none> and password file <none>
I20260923 17:18:03.147898 29447 fs_manager.cc:359] Metadata directory not provided
I20260923 17:18:03.147990 29447 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:18:03.148204 29447 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:18:03.150218 29447 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-1/data/instance:
uuid: "2914ba72362a40f3b33f31b7c967e643"
format_stamp: "Formatted at 2026-09-23 17:18:03 on dist-test-slave-1x1f"
server_key: "a50cfd3d634950a14ca75e073a1e8541"
server_key_iv: "5c9801e92f9f8a8d42b5a0af470ce326"
server_key_version: "encryptionkey@0"
I20260923 17:18:03.150849 29447 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance:
uuid: "2914ba72362a40f3b33f31b7c967e643"
format_stamp: "Formatted at 2026-09-23 17:18:03 on dist-test-slave-1x1f"
server_key: "a50cfd3d634950a14ca75e073a1e8541"
server_key_iv: "5c9801e92f9f8a8d42b5a0af470ce326"
server_key_version: "encryptionkey@0"
I20260923 17:18:03.154605 29447 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260923 17:18:03.157037 29462 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:03.158461 29447 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 17:18:03.158617 29447 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-1/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-1/wal
uuid: "2914ba72362a40f3b33f31b7c967e643"
format_stamp: "Formatted at 2026-09-23 17:18:03 on dist-test-slave-1x1f"
server_key: "a50cfd3d634950a14ca75e073a1e8541"
server_key_iv: "5c9801e92f9f8a8d42b5a0af470ce326"
server_key_version: "encryptionkey@0"
I20260923 17:18:03.158732 29447 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:18:03.200759 29447 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:18:03.204011 29447 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:18:03.204227 29447 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:18:03.204826 29447 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:18:03.205662 29447 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:18:03.205734 29447 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:03.205802 29447 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:18:03.205850 29447 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:03.215010 29447 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.130:44683
I20260923 17:18:03.215039 29575 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.130:44683 every 8 connection(s)
I20260923 17:18:03.215950 29447 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
I20260923 17:18:03.225697 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 29447
I20260923 17:18:03.225855 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance
I20260923 17:18:03.226143 12182 external_mini_cluster.cc:1428] Setting key 8f26d71749637a8b668d742d1034af6b
Sep 23 17:18:03 dist-test-slave-1x1f krb5kdc[29206](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183883, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.130@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:18:03.231252 29290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:03.217843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:33851 (local address 127.11.229.190:36547)
0923 17:18:03.217996 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:03.218001 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:03.219025 (+ 1024us) server_negotiation.cc:407] Connection header received
0923 17:18:03.220313 (+ 1288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:03.220316 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:03.220362 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:03.220463 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:03.221653 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:03.222214 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:03.223597 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:03.223829 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:03.223922 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:03.226878 (+ 2956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:03.226881 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:03.226883 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:03.226909 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:03.228535 (+ 1626us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:03.229269 (+ 734us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:03.229271 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:03.229272 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:03.229346 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:03.229804 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:03.229809 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:03.229812 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:03.230062 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:03.230168 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:03.230850 (+ 682us) server_negotiation.cc:299] Negotiation successful
0923 17:18:03.230995 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260923 17:18:03.232179 29578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:03.218402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36547 (local address 127.11.229.130:33851)
0923 17:18:03.218870 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:03.218912 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:03.220095 (+ 1183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:03.220627 (+ 532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:03.220634 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:03.220974 (+ 340us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:18:03.221505 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:03.221518 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:03.222406 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:03.222409 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:03.223450 (+ 1041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:03.223460 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:03.223997 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:03.224000 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:03.224166 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:03.224919 (+ 753us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:18:03.224937 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:18:03.226667 (+ 1730us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:18:03.228665 (+ 1998us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:03.228682 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:03.228704 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:03.229138 (+ 434us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:03.229441 (+ 303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:03.229448 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:03.229453 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:03.229690 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:03.230312 (+ 622us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:18:03.230318 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:18:03.230593 (+ 275us) client_negotiation.cc:769] Sending connection context
0923 17:18:03.230773 (+ 180us) client_negotiation.cc:240] Negotiation successful
0923 17:18:03.231052 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":114,"threads_started":1}
I20260923 17:18:03.233438 29576 heartbeater.cc:347] Connected to a master server at 127.11.229.190:36547
I20260923 17:18:03.233722 29576 heartbeater.cc:464] Registering TS with master...
I20260923 17:18:03.234369 29576 heartbeater.cc:511] Master 127.11.229.190:36547 requested a full tablet report, sending...
I20260923 17:18:03.235641 29251 ts_manager.cc:194] Registered new tserver with Master: 2914ba72362a40f3b33f31b7c967e643 (127.11.229.130:44683)
WARNING: no policy specified for kudu/127.11.229.131@KRBTEST.COM; defaulting to no policy
I20260923 17:18:03.236476 29251 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.130@KRBTEST.COM'} at 127.11.229.130:33851
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab.
Entry for principal kudu/127.11.229.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab.
I20260923 17:18:03.253388 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.131:0
--local_ip_for_outbound_sockets=127.11.229.131
--webserver_interface=127.11.229.131
--webserver_port=0
--tserver_master_addrs=127.11.229.190:36547
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab
--principal=kudu/127.11.229.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:34069
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:18:03.360333 29581 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:18:03.360579 29581 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:18:03.360622 29581 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:18:03.365027 29581 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:18:03.365093 29581 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:18:03.365206 29581 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.131
I20260923 17:18:03.370647 29581 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:34069
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab
--principal=kudu/127.11.229.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.229.131
--webserver_port=0
--tserver_master_addrs=127.11.229.190:36547
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29581
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.131
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:18:03.371672 29581 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:18:03.372644 29581 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260923 17:18:03.382722 29581 server_base.cc:1034] running on GCE node
W20260923 17:18:03.382700 29587 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:03.382666 29589 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:03.382666 29586 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:03.383497 29581 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:18:03.384217 29581 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:18:03.385413 29581 hybrid_clock.cc:648] HybridClock initialized: now 1790183883385394 us; error 32 us; skew 500 ppm
Sep 23 17:18:03 dist-test-slave-1x1f krb5kdc[29206](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183883, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:18:03.388433 29581 init.cc:377] Logged in from keytab as kudu/127.11.229.131@KRBTEST.COM (short username kudu)
I20260923 17:18:03.389390 29581 webserver.cc:460] Webserver started at http://127.11.229.131:44847/ using document root <none> and password file <none>
I20260923 17:18:03.390010 29581 fs_manager.cc:359] Metadata directory not provided
I20260923 17:18:03.390106 29581 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:18:03.390388 29581 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:18:03.392547 29581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-2/data/instance:
uuid: "4562a2025b3345429d3e29b6a7b395aa"
format_stamp: "Formatted at 2026-09-23 17:18:03 on dist-test-slave-1x1f"
server_key: "d3517cad93be024118cf767dc16e48fc"
server_key_iv: "b1528da49b1f465e5b89bc6457d9dbcf"
server_key_version: "encryptionkey@0"
I20260923 17:18:03.393162 29581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance:
uuid: "4562a2025b3345429d3e29b6a7b395aa"
format_stamp: "Formatted at 2026-09-23 17:18:03 on dist-test-slave-1x1f"
server_key: "d3517cad93be024118cf767dc16e48fc"
server_key_iv: "b1528da49b1f465e5b89bc6457d9dbcf"
server_key_version: "encryptionkey@0"
I20260923 17:18:03.397060 29581 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260923 17:18:03.400022 29596 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:03.401173 29581 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260923 17:18:03.401307 29581 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-2/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-2/wal
uuid: "4562a2025b3345429d3e29b6a7b395aa"
format_stamp: "Formatted at 2026-09-23 17:18:03 on dist-test-slave-1x1f"
server_key: "d3517cad93be024118cf767dc16e48fc"
server_key_iv: "b1528da49b1f465e5b89bc6457d9dbcf"
server_key_version: "encryptionkey@0"
I20260923 17:18:03.401427 29581 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:18:03.412127 29581 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:18:03.415282 29581 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:18:03.415481 29581 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:18:03.416045 29581 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:18:03.417117 29581 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:18:03.417202 29581 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:03.417277 29581 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:18:03.417333 29581 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:03.426843 29581 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.131:35655
I20260923 17:18:03.426875 29709 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.131:35655 every 8 connection(s)
I20260923 17:18:03.427798 29581 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
I20260923 17:18:03.429677 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 29581
I20260923 17:18:03.429817 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance
I20260923 17:18:03.430178 12182 external_mini_cluster.cc:1428] Setting key f97b5687b994286b32e55c57eb4462d6
Sep 23 17:18:03 dist-test-slave-1x1f krb5kdc[29206](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183883, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.131@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:18:03.441843 29290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:03.429616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:34797 (local address 127.11.229.190:36547)
0923 17:18:03.429795 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:03.429800 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:03.430692 (+ 892us) server_negotiation.cc:407] Connection header received
0923 17:18:03.432314 (+ 1622us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:03.432320 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:03.432386 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:03.432467 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:03.433651 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:03.434266 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:03.435498 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:03.435760 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:03.435928 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:03.438600 (+ 2672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:03.438603 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:03.438605 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:03.438628 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:03.439902 (+ 1274us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:03.440392 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:03.440395 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:03.440396 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:03.440486 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:03.440814 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:03.440816 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:03.440818 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:03.440991 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:03.441072 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:03.441620 (+ 548us) server_negotiation.cc:299] Negotiation successful
0923 17:18:03.441721 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260923 17:18:03.442847 29712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:03.430001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:36547 (local address 127.11.229.131:34797)
0923 17:18:03.430517 (+ 516us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:03.430572 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:03.432062 (+ 1490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:03.432667 (+ 605us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:03.432674 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:03.433014 (+ 340us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:18:03.433486 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:03.433499 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:03.434373 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:03.434376 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:03.435377 (+ 1001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:03.435387 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:03.435957 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:03.435960 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:03.436146 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:03.436798 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:18:03.436814 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:18:03.438452 (+ 1638us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:18:03.440002 (+ 1550us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:03.440007 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:03.440019 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:03.440277 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:03.440590 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:03.440592 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:03.440593 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:03.440729 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:03.441120 (+ 391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:18:03.441125 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:18:03.441391 (+ 266us) client_negotiation.cc:769] Sending connection context
0923 17:18:03.441571 (+ 180us) client_negotiation.cc:240] Negotiation successful
0923 17:18:03.441854 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":109,"threads_started":1}
I20260923 17:18:03.444003 29710 heartbeater.cc:347] Connected to a master server at 127.11.229.190:36547
I20260923 17:18:03.444270 29710 heartbeater.cc:464] Registering TS with master...
I20260923 17:18:03.444859 29710 heartbeater.cc:511] Master 127.11.229.190:36547 requested a full tablet report, sending...
I20260923 17:18:03.445906 29250 ts_manager.cc:194] Registered new tserver with Master: 4562a2025b3345429d3e29b6a7b395aa (127.11.229.131:35655)
I20260923 17:18:03.446710 29250 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.131@KRBTEST.COM'} at 127.11.229.131:34797
I20260923 17:18:03.456455 12182 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 17:18:03.465622 29290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:03.458526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50260 (local address 127.11.229.190:36547)
0923 17:18:03.458642 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:03.458646 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:03.458810 (+ 164us) server_negotiation.cc:407] Connection header received
0923 17:18:03.458895 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:03.458897 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:03.458935 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:03.458999 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:03.459700 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:03.460196 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:03.461014 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:03.461211 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:03.461300 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:03.462938 (+ 1638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:03.462941 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:03.462943 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:03.462965 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:03.464166 (+ 1201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:03.464525 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:03.464528 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:03.464529 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:03.464596 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:03.464815 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:03.464817 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:03.464818 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:03.465010 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:03.465110 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:03.465368 (+ 258us) server_negotiation.cc:299] Negotiation successful
0923 17:18:03.465509 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260923 17:18:03.468982 29250 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50260:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 17:18:03.472007 29250 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 17:18:03.486219 29725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:03.481261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57158 (local address 127.11.229.131:35655)
0923 17:18:03.481729 (+ 468us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:03.481742 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:03.481835 (+ 93us) server_negotiation.cc:407] Connection header received
0923 17:18:03.481940 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:03.481944 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:03.482090 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:03.482248 (+ 158us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:18:03.482653 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:03.483401 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:03.484917 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:03.485545 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:03.485674 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:03.485820 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:03.485976 (+ 156us) server_negotiation.cc:299] Negotiation successful
0923 17:18:03.486072 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":358,"thread_start_us":139,"threads_started":1}
I20260923 17:18:03.486218 29724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:03.481068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.131:35655 (local address 127.0.0.1:57158)
0923 17:18:03.481718 (+ 650us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:03.481746 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:03.481841 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:03.482381 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:03.482383 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:03.482409 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:18:03.482522 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:03.482530 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:03.483537 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:03.483540 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:03.484796 (+ 1256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:03.484805 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:03.485665 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:03.485669 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:03.485783 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:03.485825 (+ 42us) client_negotiation.cc:769] Sending connection context
0923 17:18:03.485936 (+ 111us) client_negotiation.cc:240] Negotiation successful
0923 17:18:03.486048 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":587,"mutex_wait_us":55,"thread_start_us":86,"threads_started":1}
I20260923 17:18:03.487099 29721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:03.480403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:38377 (local address 127.0.0.1:41282)
0923 17:18:03.481372 (+ 969us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:03.481386 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:03.481459 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:03.482481 (+ 1022us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:03.482485 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:03.482502 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:18:03.482614 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:03.482620 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:03.483944 (+ 1324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:03.483947 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:03.485356 (+ 1409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:03.485367 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:03.486639 (+ 1272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:03.486642 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:03.486767 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:03.486793 (+ 26us) client_negotiation.cc:769] Sending connection context
0923 17:18:03.486869 (+ 76us) client_negotiation.cc:240] Negotiation successful
0923 17:18:03.486946 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":905,"mutex_wait_us":83,"thread_start_us":77,"threads_started":1}
I20260923 17:18:03.487396 29726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:03.481347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41282 (local address 127.11.229.129:38377)
0923 17:18:03.481875 (+ 528us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:03.481893 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:03.481918 (+ 25us) server_negotiation.cc:407] Connection header received
0923 17:18:03.481996 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:03.482000 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:03.482171 (+ 171us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:03.482337 (+ 166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:18:03.482733 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:03.483815 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:03.485490 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:03.486371 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:03.486490 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:03.486587 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:03.486927 (+ 340us) server_negotiation.cc:299] Negotiation successful
0923 17:18:03.487039 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":430,"thread_start_us":85,"threads_started":1}
I20260923 17:18:03.487396 29723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:03.480452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55252 (local address 127.11.229.130:44683)
0923 17:18:03.480750 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:03.480763 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:03.481575 (+ 812us) server_negotiation.cc:407] Connection header received
0923 17:18:03.481796 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:03.481804 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:03.482013 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:03.482183 (+ 170us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:18:03.482499 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:03.483718 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:03.485512 (+ 1794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:03.486380 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:03.486501 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:03.486624 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:03.487164 (+ 540us) server_negotiation.cc:299] Negotiation successful
0923 17:18:03.487270 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":198,"thread_start_us":108,"threads_started":1}
I20260923 17:18:03.487636 29722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:03.480336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.130:44683 (local address 127.0.0.1:55252)
0923 17:18:03.480927 (+ 591us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:03.480963 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:03.481116 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:03.482178 (+ 1062us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:03.482185 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:03.482206 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:18:03.482379 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:03.482388 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:03.483873 (+ 1485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:03.483879 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:03.485356 (+ 1477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:03.485367 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:03.486696 (+ 1329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:03.486700 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:03.486886 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:03.486911 (+ 25us) client_negotiation.cc:769] Sending connection context
0923 17:18:03.486983 (+ 72us) client_negotiation.cc:240] Negotiation successful
0923 17:18:03.487065 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":443,"mutex_wait_us":189,"thread_start_us":79,"threads_started":1}
I20260923 17:18:03.490419 29510 tablet_service.cc:1467] Processing CreateTablet for tablet ba107bb3430a4e318a9e86990c1ac208 (DEFAULT_TABLE table=test-table [id=9db7e4fc7a2b4e8caf5c1079067892e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:18:03.490420 29644 tablet_service.cc:1467] Processing CreateTablet for tablet ba107bb3430a4e318a9e86990c1ac208 (DEFAULT_TABLE table=test-table [id=9db7e4fc7a2b4e8caf5c1079067892e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:18:03.490420 29376 tablet_service.cc:1467] Processing CreateTablet for tablet ba107bb3430a4e318a9e86990c1ac208 (DEFAULT_TABLE table=test-table [id=9db7e4fc7a2b4e8caf5c1079067892e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:18:03.491446 29644 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba107bb3430a4e318a9e86990c1ac208. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:18:03.491446 29376 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba107bb3430a4e318a9e86990c1ac208. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:18:03.491463 29510 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ba107bb3430a4e318a9e86990c1ac208. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:18:03.497352 29727 tablet_bootstrap.cc:492] T ba107bb3430a4e318a9e86990c1ac208 P 2914ba72362a40f3b33f31b7c967e643: Bootstrap starting.
I20260923 17:18:03.498708 29729 tablet_bootstrap.cc:492] T ba107bb3430a4e318a9e86990c1ac208 P a927ec1e0d6f44299330f6e749c32fc2: Bootstrap starting.
I20260923 17:18:03.499876 29727 tablet_bootstrap.cc:654] T ba107bb3430a4e318a9e86990c1ac208 P 2914ba72362a40f3b33f31b7c967e643: Neither blocks nor log segments found. Creating new log.
I20260923 17:18:03.500774 29729 tablet_bootstrap.cc:654] T ba107bb3430a4e318a9e86990c1ac208 P a927ec1e0d6f44299330f6e749c32fc2: Neither blocks nor log segments found. Creating new log.
I20260923 17:18:03.501138 29727 log.cc:824] T ba107bb3430a4e318a9e86990c1ac208 P 2914ba72362a40f3b33f31b7c967e643: Log is configured to *not* fsync() on all Append() calls
I20260923 17:18:03.501549 29729 log.cc:824] T ba107bb3430a4e318a9e86990c1ac208 P a927ec1e0d6f44299330f6e749c32fc2: Log is configured to *not* fsync() on all Append() calls
I20260923 17:18:03.501876 29728 tablet_bootstrap.cc:492] T ba107bb3430a4e318a9e86990c1ac208 P 4562a2025b3345429d3e29b6a7b395aa: Bootstrap starting.
I20260923 17:18:03.503109 29727 tablet_bootstrap.cc:492] T ba107bb3430a4e318a9e86990c1ac208 P 2914ba72362a40f3b33f31b7c967e643: No bootstrap required, opened a new log
I20260923 17:18:03.503324 29727 ts_tablet_manager.cc:1397] T ba107bb3430a4e318a9e86990c1ac208 P 2914ba72362a40f3b33f31b7c967e643: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260923 17:18:03.503429 29729 tablet_bootstrap.cc:492] T ba107bb3430a4e318a9e86990c1ac208 P a927ec1e0d6f44299330f6e749c32fc2: No bootstrap required, opened a new log
I20260923 17:18:03.503607 29729 ts_tablet_manager.cc:1397] T ba107bb3430a4e318a9e86990c1ac208 P a927ec1e0d6f44299330f6e749c32fc2: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260923 17:18:03.503890 29728 tablet_bootstrap.cc:654] T ba107bb3430a4e318a9e86990c1ac208 P 4562a2025b3345429d3e29b6a7b395aa: Neither blocks nor log segments found. Creating new log.
I20260923 17:18:03.505038 29728 log.cc:824] T ba107bb3430a4e318a9e86990c1ac208 P 4562a2025b3345429d3e29b6a7b395aa: Log is configured to *not* fsync() on all Append() calls
I20260923 17:18:03.507014 29728 tablet_bootstrap.cc:492] T ba107bb3430a4e318a9e86990c1ac208 P 4562a2025b3345429d3e29b6a7b395aa: No bootstrap required, opened a new log
I20260923 17:18:03.507211 29728 ts_tablet_manager.cc:1397] T ba107bb3430a4e318a9e86990c1ac208 P 4562a2025b3345429d3e29b6a7b395aa: Time spent bootstrapping tablet: real 0.005s user 0.005s sys 0.000s
I20260923 17:18:03.507151 29727 raft_consensus.cc:348] T ba107bb3430a4e318a9e86990c1ac208 P 2914ba72362a40f3b33f31b7c967e643 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2914ba72362a40f3b33f31b7c967e643" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44683 } } peers { permanent_uuid: "a927ec1e0d6f44299330f6e749c32fc2" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38377 } } peers { permanent_uuid: "4562a2025b3345429d3e29b6a7b395aa" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 35655 } }
I20260923 17:18:03.507431 29727 raft_consensus.cc:374] T ba107bb3430a4e318a9e86990c1ac208 P 2914ba72362a40f3b33f31b7c967e643 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:18:03.507479 29727 raft_consensus.cc:729] T ba107bb3430a4e318a9e86990c1ac208 P 2914ba72362a40f3b33f31b7c967e643 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2914ba72362a40f3b33f31b7c967e643, State: Initialized, Role: FOLLOWER
I20260923 17:18:03.507581 29729 raft_consensus.cc:348] T ba107bb3430a4e318a9e86990c1ac208 P a927ec1e0d6f44299330f6e749c32fc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2914ba72362a40f3b33f31b7c967e643" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44683 } } peers { permanent_uuid: "a927ec1e0d6f44299330f6e749c32fc2" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38377 } } peers { permanent_uuid: "4562a2025b3345429d3e29b6a7b395aa" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 35655 } }
I20260923 17:18:03.507850 29729 raft_consensus.cc:374] T ba107bb3430a4e318a9e86990c1ac208 P a927ec1e0d6f44299330f6e749c32fc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:18:03.507900 29729 raft_consensus.cc:729] T ba107bb3430a4e318a9e86990c1ac208 P a927ec1e0d6f44299330f6e749c32fc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a927ec1e0d6f44299330f6e749c32fc2, State: Initialized, Role: FOLLOWER
I20260923 17:18:03.507910 29727 consensus_queue.cc:260] T ba107bb3430a4e318a9e86990c1ac208 P 2914ba72362a40f3b33f31b7c967e643 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2914ba72362a40f3b33f31b7c967e643" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44683 } } peers { permanent_uuid: "a927ec1e0d6f44299330f6e749c32fc2" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38377 } } peers { permanent_uuid: "4562a2025b3345429d3e29b6a7b395aa" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 35655 } }
I20260923 17:18:03.508368 29729 consensus_queue.cc:260] T ba107bb3430a4e318a9e86990c1ac208 P a927ec1e0d6f44299330f6e749c32fc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2914ba72362a40f3b33f31b7c967e643" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44683 } } peers { permanent_uuid: "a927ec1e0d6f44299330f6e749c32fc2" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38377 } } peers { permanent_uuid: "4562a2025b3345429d3e29b6a7b395aa" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 35655 } }
I20260923 17:18:03.508607 29576 heartbeater.cc:503] Master 127.11.229.190:36547 was elected leader, sending a full tablet report...
I20260923 17:18:03.508885 29727 ts_tablet_manager.cc:1428] T ba107bb3430a4e318a9e86990c1ac208 P 2914ba72362a40f3b33f31b7c967e643: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260923 17:18:03.509233 29729 ts_tablet_manager.cc:1428] T ba107bb3430a4e318a9e86990c1ac208 P a927ec1e0d6f44299330f6e749c32fc2: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260923 17:18:03.509555 29442 heartbeater.cc:503] Master 127.11.229.190:36547 was elected leader, sending a full tablet report...
I20260923 17:18:03.510814 29728 raft_consensus.cc:348] T ba107bb3430a4e318a9e86990c1ac208 P 4562a2025b3345429d3e29b6a7b395aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2914ba72362a40f3b33f31b7c967e643" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44683 } } peers { permanent_uuid: "a927ec1e0d6f44299330f6e749c32fc2" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38377 } } peers { permanent_uuid: "4562a2025b3345429d3e29b6a7b395aa" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 35655 } }
I20260923 17:18:03.510993 29728 raft_consensus.cc:374] T ba107bb3430a4e318a9e86990c1ac208 P 4562a2025b3345429d3e29b6a7b395aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:18:03.511065 29728 raft_consensus.cc:729] T ba107bb3430a4e318a9e86990c1ac208 P 4562a2025b3345429d3e29b6a7b395aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4562a2025b3345429d3e29b6a7b395aa, State: Initialized, Role: FOLLOWER
I20260923 17:18:03.511474 29728 consensus_queue.cc:260] T ba107bb3430a4e318a9e86990c1ac208 P 4562a2025b3345429d3e29b6a7b395aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2914ba72362a40f3b33f31b7c967e643" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44683 } } peers { permanent_uuid: "a927ec1e0d6f44299330f6e749c32fc2" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38377 } } peers { permanent_uuid: "4562a2025b3345429d3e29b6a7b395aa" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 35655 } }
I20260923 17:18:03.512048 29710 heartbeater.cc:503] Master 127.11.229.190:36547 was elected leader, sending a full tablet report...
I20260923 17:18:03.512346 29728 ts_tablet_manager.cc:1428] T ba107bb3430a4e318a9e86990c1ac208 P 4562a2025b3345429d3e29b6a7b395aa: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260923 17:18:03.547219 29733 raft_consensus.cc:482] T ba107bb3430a4e318a9e86990c1ac208 P 2914ba72362a40f3b33f31b7c967e643 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 17:18:03.547410 29733 raft_consensus.cc:504] T ba107bb3430a4e318a9e86990c1ac208 P 2914ba72362a40f3b33f31b7c967e643 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2914ba72362a40f3b33f31b7c967e643" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44683 } } peers { permanent_uuid: "a927ec1e0d6f44299330f6e749c32fc2" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38377 } } peers { permanent_uuid: "4562a2025b3345429d3e29b6a7b395aa" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 35655 } }
I20260923 17:18:03.548532 29733 leader_election.cc:288] T ba107bb3430a4e318a9e86990c1ac208 P 2914ba72362a40f3b33f31b7c967e643 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a927ec1e0d6f44299330f6e749c32fc2 (127.11.229.129:38377), 4562a2025b3345429d3e29b6a7b395aa (127.11.229.131:35655)
I20260923 17:18:03.553902 29725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:03.549229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:33629 (local address 127.11.229.131:35655)
0923 17:18:03.549338 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:03.549344 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:03.549569 (+ 225us) server_negotiation.cc:407] Connection header received
0923 17:18:03.549642 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:03.549644 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:03.549713 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:03.549802 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:18:03.550031 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:03.550859 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:03.552388 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:03.553034 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:03.553143 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:03.553197 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:03.553690 (+ 493us) server_negotiation.cc:299] Negotiation successful
0923 17:18:03.553784 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260923 17:18:03.553902 29726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:03.548945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:55905 (local address 127.11.229.129:38377)
0923 17:18:03.549086 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:03.549090 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:03.549107 (+ 17us) server_negotiation.cc:407] Connection header received
0923 17:18:03.549274 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:03.549280 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:03.549347 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:03.549443 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:18:03.549762 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:03.550746 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:03.552388 (+ 1642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:03.553010 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:03.553143 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:03.553212 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:03.553690 (+ 478us) server_negotiation.cc:299] Negotiation successful
0923 17:18:03.553774 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260923 17:18:03.553918 29578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:03.548828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:38377 (local address 127.11.229.130:55905)
0923 17:18:03.548976 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:03.548992 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:03.549104 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:03.549462 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:03.549466 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:03.549493 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:18:03.549633 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:03.549639 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:03.550848 (+ 1209us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:03.550850 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:03.552260 (+ 1410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:03.552270 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:03.553192 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:03.553195 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:03.553454 (+ 259us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:03.553545 (+ 91us) client_negotiation.cc:769] Sending connection context
0923 17:18:03.553631 (+ 86us) client_negotiation.cc:240] Negotiation successful
0923 17:18:03.553747 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59,"mutex_wait_us":220}
I20260923 17:18:03.553927 29736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:03.549120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.131:35655 (local address 127.11.229.130:33629)
0923 17:18:03.549457 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:03.549470 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:03.549562 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:03.549813 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:03.549815 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:03.549829 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:18:03.549923 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:03.549926 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:03.550959 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:03.550961 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:03.552204 (+ 1243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:03.552217 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:03.553178 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:03.553182 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:03.553453 (+ 271us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:03.553545 (+ 92us) client_negotiation.cc:769] Sending connection context
0923 17:18:03.553631 (+ 86us) client_negotiation.cc:240] Negotiation successful
0923 17:18:03.553747 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"mutex_wait_us":162,"thread_start_us":144,"threads_started":1}
I20260923 17:18:03.554783 29396 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba107bb3430a4e318a9e86990c1ac208" candidate_uuid: "2914ba72362a40f3b33f31b7c967e643" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a927ec1e0d6f44299330f6e749c32fc2" is_pre_election: true
I20260923 17:18:03.554816 29664 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba107bb3430a4e318a9e86990c1ac208" candidate_uuid: "2914ba72362a40f3b33f31b7c967e643" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4562a2025b3345429d3e29b6a7b395aa" is_pre_election: true
I20260923 17:18:03.555071 29396 raft_consensus.cc:2454] T ba107bb3430a4e318a9e86990c1ac208 P a927ec1e0d6f44299330f6e749c32fc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2914ba72362a40f3b33f31b7c967e643 in term 0.
I20260923 17:18:03.555079 29664 raft_consensus.cc:2454] T ba107bb3430a4e318a9e86990c1ac208 P 4562a2025b3345429d3e29b6a7b395aa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2914ba72362a40f3b33f31b7c967e643 in term 0.
I20260923 17:18:03.555550 29466 leader_election.cc:302] T ba107bb3430a4e318a9e86990c1ac208 P 2914ba72362a40f3b33f31b7c967e643 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2914ba72362a40f3b33f31b7c967e643, a927ec1e0d6f44299330f6e749c32fc2; no voters:
I20260923 17:18:03.555816 29733 raft_consensus.cc:2781] T ba107bb3430a4e318a9e86990c1ac208 P 2914ba72362a40f3b33f31b7c967e643 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 17:18:03.555905 29733 raft_consensus.cc:482] T ba107bb3430a4e318a9e86990c1ac208 P 2914ba72362a40f3b33f31b7c967e643 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 17:18:03.555948 29733 raft_consensus.cc:3037] T ba107bb3430a4e318a9e86990c1ac208 P 2914ba72362a40f3b33f31b7c967e643 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:18:03.556957 29733 raft_consensus.cc:504] T ba107bb3430a4e318a9e86990c1ac208 P 2914ba72362a40f3b33f31b7c967e643 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2914ba72362a40f3b33f31b7c967e643" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44683 } } peers { permanent_uuid: "a927ec1e0d6f44299330f6e749c32fc2" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38377 } } peers { permanent_uuid: "4562a2025b3345429d3e29b6a7b395aa" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 35655 } }
I20260923 17:18:03.557286 29733 leader_election.cc:288] T ba107bb3430a4e318a9e86990c1ac208 P 2914ba72362a40f3b33f31b7c967e643 [CANDIDATE]: Term 1 election: Requested vote from peers a927ec1e0d6f44299330f6e749c32fc2 (127.11.229.129:38377), 4562a2025b3345429d3e29b6a7b395aa (127.11.229.131:35655)
I20260923 17:18:03.557629 29396 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba107bb3430a4e318a9e86990c1ac208" candidate_uuid: "2914ba72362a40f3b33f31b7c967e643" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a927ec1e0d6f44299330f6e749c32fc2"
I20260923 17:18:03.557637 29664 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ba107bb3430a4e318a9e86990c1ac208" candidate_uuid: "2914ba72362a40f3b33f31b7c967e643" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4562a2025b3345429d3e29b6a7b395aa"
I20260923 17:18:03.557762 29396 raft_consensus.cc:3037] T ba107bb3430a4e318a9e86990c1ac208 P a927ec1e0d6f44299330f6e749c32fc2 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:18:03.557783 29664 raft_consensus.cc:3037] T ba107bb3430a4e318a9e86990c1ac208 P 4562a2025b3345429d3e29b6a7b395aa [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:18:03.558902 29396 raft_consensus.cc:2454] T ba107bb3430a4e318a9e86990c1ac208 P a927ec1e0d6f44299330f6e749c32fc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2914ba72362a40f3b33f31b7c967e643 in term 1.
I20260923 17:18:03.558966 29664 raft_consensus.cc:2454] T ba107bb3430a4e318a9e86990c1ac208 P 4562a2025b3345429d3e29b6a7b395aa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2914ba72362a40f3b33f31b7c967e643 in term 1.
I20260923 17:18:03.559336 29466 leader_election.cc:302] T ba107bb3430a4e318a9e86990c1ac208 P 2914ba72362a40f3b33f31b7c967e643 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2914ba72362a40f3b33f31b7c967e643, 4562a2025b3345429d3e29b6a7b395aa; no voters:
I20260923 17:18:03.559554 29733 raft_consensus.cc:2781] T ba107bb3430a4e318a9e86990c1ac208 P 2914ba72362a40f3b33f31b7c967e643 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:18:03.559845 29733 raft_consensus.cc:686] T ba107bb3430a4e318a9e86990c1ac208 P 2914ba72362a40f3b33f31b7c967e643 [term 1 LEADER]: Becoming Leader. State: Replica: 2914ba72362a40f3b33f31b7c967e643, State: Running, Role: LEADER
I20260923 17:18:03.560281 29733 consensus_queue.cc:237] T ba107bb3430a4e318a9e86990c1ac208 P 2914ba72362a40f3b33f31b7c967e643 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2914ba72362a40f3b33f31b7c967e643" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44683 } } peers { permanent_uuid: "a927ec1e0d6f44299330f6e749c32fc2" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38377 } } peers { permanent_uuid: "4562a2025b3345429d3e29b6a7b395aa" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 35655 } }
I20260923 17:18:03.563584 29250 catalog_manager.cc:5495] T ba107bb3430a4e318a9e86990c1ac208 P 2914ba72362a40f3b33f31b7c967e643 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2914ba72362a40f3b33f31b7c967e643 (127.11.229.130). New cstate: current_term: 1 leader_uuid: "2914ba72362a40f3b33f31b7c967e643" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2914ba72362a40f3b33f31b7c967e643" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a927ec1e0d6f44299330f6e749c32fc2" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38377 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4562a2025b3345429d3e29b6a7b395aa" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 35655 } health_report { overall_health: UNKNOWN } } }
I20260923 17:18:03.587697 29723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:03.584089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55256 (local address 127.11.229.130:44683)
0923 17:18:03.584226 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:03.584233 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:03.584252 (+ 19us) server_negotiation.cc:407] Connection header received
0923 17:18:03.584335 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:03.584337 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:03.584391 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:03.584502 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 17:18:03.584788 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:03.585382 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:03.586265 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:03.586482 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:03.586592 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:03.586893 (+ 301us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 17:18:03.587304 (+ 411us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 17:18:03.587435 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:03.587496 (+ 61us) server_negotiation.cc:299] Negotiation successful
0923 17:18:03.587552 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260923 17:18:03.593612 29664 raft_consensus.cc:1261] T ba107bb3430a4e318a9e86990c1ac208 P 4562a2025b3345429d3e29b6a7b395aa [term 1 FOLLOWER]: Refusing update from remote peer 2914ba72362a40f3b33f31b7c967e643: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:18:03.593658 29396 raft_consensus.cc:1261] T ba107bb3430a4e318a9e86990c1ac208 P a927ec1e0d6f44299330f6e749c32fc2 [term 1 FOLLOWER]: Refusing update from remote peer 2914ba72362a40f3b33f31b7c967e643: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:18:03.594440 29733 consensus_queue.cc:1035] T ba107bb3430a4e318a9e86990c1ac208 P 2914ba72362a40f3b33f31b7c967e643 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4562a2025b3345429d3e29b6a7b395aa" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 35655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:18:03.594705 29737 consensus_queue.cc:1035] T ba107bb3430a4e318a9e86990c1ac208 P 2914ba72362a40f3b33f31b7c967e643 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a927ec1e0d6f44299330f6e749c32fc2" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38377 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:18:03.602361 29741 mvcc.cc:205] Tried to move back new op lower bound from 7332593187192680448 to 7332593187066052608. Current Snapshot: MvccSnapshot[applied={T|T < 7332593187192680448}]
I20260923 17:18:03.604351 29742 mvcc.cc:205] Tried to move back new op lower bound from 7332593187192680448 to 7332593187066052608. Current Snapshot: MvccSnapshot[applied={T|T < 7332593187192680448}]
I20260923 17:18:03.609944 29249 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50260:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:18:03.610155 29249 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50260:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:18:03.612879 29249 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 86e8a0cd85c747b2b58d32da2db917f3: Sending DeleteTablet for 3 replicas of tablet ba107bb3430a4e318a9e86990c1ac208
I20260923 17:18:03.613675 29510 tablet_service.cc:1514] Processing DeleteTablet for tablet ba107bb3430a4e318a9e86990c1ac208 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:18:03 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:55252
I20260923 17:18:03.613765 29644 tablet_service.cc:1514] Processing DeleteTablet for tablet ba107bb3430a4e318a9e86990c1ac208 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:18:03 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:57158
I20260923 17:18:03.613754 29376 tablet_service.cc:1514] Processing DeleteTablet for tablet ba107bb3430a4e318a9e86990c1ac208 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:18:03 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:41282
I20260923 17:18:03.614285 29752 tablet_replica.cc:330] T ba107bb3430a4e318a9e86990c1ac208 P a927ec1e0d6f44299330f6e749c32fc2: stopping tablet replica
I20260923 17:18:03.614416 29751 tablet_replica.cc:330] T ba107bb3430a4e318a9e86990c1ac208 P 4562a2025b3345429d3e29b6a7b395aa: stopping tablet replica
I20260923 17:18:03.614619 29752 raft_consensus.cc:2229] T ba107bb3430a4e318a9e86990c1ac208 P a927ec1e0d6f44299330f6e749c32fc2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:18:03.614791 29751 raft_consensus.cc:2229] T ba107bb3430a4e318a9e86990c1ac208 P 4562a2025b3345429d3e29b6a7b395aa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:18:03.614905 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 29313
I20260923 17:18:03.614964 29752 raft_consensus.cc:2258] T ba107bb3430a4e318a9e86990c1ac208 P a927ec1e0d6f44299330f6e749c32fc2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:18:03.617141 29751 raft_consensus.cc:2258] T ba107bb3430a4e318a9e86990c1ac208 P 4562a2025b3345429d3e29b6a7b395aa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:18:03.617535 29750 tablet_replica.cc:330] T ba107bb3430a4e318a9e86990c1ac208 P 2914ba72362a40f3b33f31b7c967e643: stopping tablet replica
I20260923 17:18:03.617853 29750 raft_consensus.cc:2229] T ba107bb3430a4e318a9e86990c1ac208 P 2914ba72362a40f3b33f31b7c967e643 [term 1 LEADER]: Raft consensus shutting down.
I20260923 17:18:03.618220 29750 raft_consensus.cc:2258] T ba107bb3430a4e318a9e86990c1ac208 P 2914ba72362a40f3b33f31b7c967e643 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:18:03.619022 29751 ts_tablet_manager.cc:1905] T ba107bb3430a4e318a9e86990c1ac208 P 4562a2025b3345429d3e29b6a7b395aa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:18:03.619738 29750 ts_tablet_manager.cc:1905] T ba107bb3430a4e318a9e86990c1ac208 P 2914ba72362a40f3b33f31b7c967e643: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:18:03.622526 29751 ts_tablet_manager.cc:1918] T ba107bb3430a4e318a9e86990c1ac208 P 4562a2025b3345429d3e29b6a7b395aa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 17:18:03.622539 29750 ts_tablet_manager.cc:1918] T ba107bb3430a4e318a9e86990c1ac208 P 2914ba72362a40f3b33f31b7c967e643: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 17:18:03.622625 29750 log.cc:1196] T ba107bb3430a4e318a9e86990c1ac208 P 2914ba72362a40f3b33f31b7c967e643: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-1/wal/wals/ba107bb3430a4e318a9e86990c1ac208
W20260923 17:18:03.622632 29238 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.229.129:38377 (error 108)
I20260923 17:18:03.622802 29751 log.cc:1196] T ba107bb3430a4e318a9e86990c1ac208 P 4562a2025b3345429d3e29b6a7b395aa: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790183633736342-12182-0/minicluster-data/ts-2/wal/wals/ba107bb3430a4e318a9e86990c1ac208
I20260923 17:18:03.623000 29750 ts_tablet_manager.cc:1939] T ba107bb3430a4e318a9e86990c1ac208 P 2914ba72362a40f3b33f31b7c967e643: Deleting consensus metadata
I20260923 17:18:03.623293 29751 ts_tablet_manager.cc:1939] T ba107bb3430a4e318a9e86990c1ac208 P 4562a2025b3345429d3e29b6a7b395aa: Deleting consensus metadata
I20260923 17:18:03.624151 29722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:03.623822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:38377 (local address 127.0.0.1:41286)
0923 17:18:03.624002 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:03.624069 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.129:38377: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
I20260923 17:18:03.624334 29236 catalog_manager.cc:4841] TS 2914ba72362a40f3b33f31b7c967e643 (127.11.229.130:44683): tablet ba107bb3430a4e318a9e86990c1ac208 (table test-table [id=9db7e4fc7a2b4e8caf5c1079067892e3]) successfully deleted
I20260923 17:18:03.624500 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 29447
W20260923 17:18:03.624545 29238 catalog_manager.cc:4584] TS a927ec1e0d6f44299330f6e749c32fc2 (127.11.229.129:38377): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ba107bb3430a4e318a9e86990c1ac208: Network error: Client connection negotiation failed: client connection to 127.11.229.129:38377: connect: Connection refused (error 111)
I20260923 17:18:03.624753 29238 catalog_manager.cc:4841] TS 4562a2025b3345429d3e29b6a7b395aa (127.11.229.131:35655): tablet ba107bb3430a4e318a9e86990c1ac208 (table test-table [id=9db7e4fc7a2b4e8caf5c1079067892e3]) successfully deleted
I20260923 17:18:03.630733 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 29581
I20260923 17:18:03.636693 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 29219
2026-09-23T17:18:03Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2293 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-09-23T17:18:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:18:03Z Disabled control of system clock
I20260923 17:18:03.667647 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:37175
--webserver_interface=127.11.229.190
--webserver_port=0
--builtin_ntp_servers=127.11.229.148:43991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:37175
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260923 17:18:03.773783 29757 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:18:03.774062 29757 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:18:03.774099 29757 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:18:03.778328 29757 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:18:03.778388 29757 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:18:03.778404 29757 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:18:03.778421 29757 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:18:03.778436 29757 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:18:03.783253 29757 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:43991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:37175
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:37175
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.229.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29757
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:18:03.784266 29757 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:18:03.785558 29757 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:18:03.793956 29765 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:03.793964 29762 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:03.793968 29763 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:03.794441 29757 server_base.cc:1034] running on GCE node
I20260923 17:18:03.795017 29757 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:18:03.796142 29757 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:18:03.797360 29757 hybrid_clock.cc:648] HybridClock initialized: now 1790183883797346 us; error 35 us; skew 500 ppm
I20260923 17:18:03.799494 29757 webserver.cc:460] Webserver started at http://127.11.229.190:46025/ using document root <none> and password file <none>
I20260923 17:18:03.800143 29757 fs_manager.cc:359] Metadata directory not provided
I20260923 17:18:03.800239 29757 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:18:03.800489 29757 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:18:03.803228 29757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "19723cc84ac7429d891efb14dd75a199"
format_stamp: "Formatted at 2026-09-23 17:18:03 on dist-test-slave-1x1f"
server_key: "65fb8a10c5bd54128e5c05f53c8646f3"
server_key_iv: "35f51ffc48d0c0363c66ea23a54c8a9a"
server_key_version: "encryptionkey@0"
I20260923 17:18:03.803824 29757 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "19723cc84ac7429d891efb14dd75a199"
format_stamp: "Formatted at 2026-09-23 17:18:03 on dist-test-slave-1x1f"
server_key: "65fb8a10c5bd54128e5c05f53c8646f3"
server_key_iv: "35f51ffc48d0c0363c66ea23a54c8a9a"
server_key_version: "encryptionkey@0"
I20260923 17:18:03.807694 29757 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260923 17:18:03.810043 29771 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:03.811336 29757 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 17:18:03.811482 29757 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "19723cc84ac7429d891efb14dd75a199"
format_stamp: "Formatted at 2026-09-23 17:18:03 on dist-test-slave-1x1f"
server_key: "65fb8a10c5bd54128e5c05f53c8646f3"
server_key_iv: "35f51ffc48d0c0363c66ea23a54c8a9a"
server_key_version: "encryptionkey@0"
I20260923 17:18:03.811594 29757 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:18:03.833287 29757 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:18:03.834040 29757 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:18:03.834288 29757 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:18:03.841951 29757 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.190:37175
I20260923 17:18:03.841956 29823 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.190:37175 every 8 connection(s)
I20260923 17:18:03.842993 29757 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:18:03.846376 29824 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:18:03.851902 29824 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19723cc84ac7429d891efb14dd75a199: Bootstrap starting.
I20260923 17:18:03.853276 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 29757
I20260923 17:18:03.853379 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:18:03.853700 12182 external_mini_cluster.cc:1428] Setting key 4fd1a03aef977e38a4762fdf16ac6cd9
I20260923 17:18:03.854648 29824 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 19723cc84ac7429d891efb14dd75a199: Neither blocks nor log segments found. Creating new log.
I20260923 17:18:03.855378 29824 log.cc:824] T 00000000000000000000000000000000 P 19723cc84ac7429d891efb14dd75a199: Log is configured to *not* fsync() on all Append() calls
I20260923 17:18:03.857445 29824 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19723cc84ac7429d891efb14dd75a199: No bootstrap required, opened a new log
I20260923 17:18:03.862121 29824 raft_consensus.cc:348] T 00000000000000000000000000000000 P 19723cc84ac7429d891efb14dd75a199 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19723cc84ac7429d891efb14dd75a199" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 37175 } }
I20260923 17:18:03.862452 29824 raft_consensus.cc:374] T 00000000000000000000000000000000 P 19723cc84ac7429d891efb14dd75a199 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:18:03.862516 29824 raft_consensus.cc:729] T 00000000000000000000000000000000 P 19723cc84ac7429d891efb14dd75a199 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19723cc84ac7429d891efb14dd75a199, State: Initialized, Role: FOLLOWER
I20260923 17:18:03.862969 29824 consensus_queue.cc:260] T 00000000000000000000000000000000 P 19723cc84ac7429d891efb14dd75a199 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19723cc84ac7429d891efb14dd75a199" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 37175 } }
I20260923 17:18:03.863091 29824 raft_consensus.cc:388] T 00000000000000000000000000000000 P 19723cc84ac7429d891efb14dd75a199 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:18:03.863142 29824 raft_consensus.cc:482] T 00000000000000000000000000000000 P 19723cc84ac7429d891efb14dd75a199 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:18:03.863248 29824 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 19723cc84ac7429d891efb14dd75a199 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:18:03.863713 29827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:03.854865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56644 (local address 127.11.229.190:37175)
0923 17:18:03.855582 (+ 717us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:03.855600 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:03.855640 (+ 40us) server_negotiation.cc:407] Connection header received
0923 17:18:03.856344 (+ 704us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:03.856362 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:03.856683 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:03.856950 (+ 267us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:03.857276 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:03.858612 (+ 1336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:03.859969 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:03.860451 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:03.860582 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:03.861643 (+ 1061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:03.861648 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:03.861662 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:18:03.862123 (+ 461us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:03.862187 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:18:03.862219 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:03.862366 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:03.862542 (+ 176us) server_negotiation.cc:299] Negotiation successful
0923 17:18:03.862852 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":319,"thread_start_us":154,"threads_started":1}
I20260923 17:18:03.864282 29824 raft_consensus.cc:504] T 00000000000000000000000000000000 P 19723cc84ac7429d891efb14dd75a199 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19723cc84ac7429d891efb14dd75a199" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 37175 } }
I20260923 17:18:03.864609 29824 leader_election.cc:302] T 00000000000000000000000000000000 P 19723cc84ac7429d891efb14dd75a199 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 19723cc84ac7429d891efb14dd75a199; no voters:
I20260923 17:18:03.864907 29824 leader_election.cc:288] T 00000000000000000000000000000000 P 19723cc84ac7429d891efb14dd75a199 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 17:18:03.865006 29829 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 19723cc84ac7429d891efb14dd75a199 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:18:03.865211 29829 raft_consensus.cc:686] T 00000000000000000000000000000000 P 19723cc84ac7429d891efb14dd75a199 [term 1 LEADER]: Becoming Leader. State: Replica: 19723cc84ac7429d891efb14dd75a199, State: Running, Role: LEADER
I20260923 17:18:03.865494 29829 consensus_queue.cc:237] T 00000000000000000000000000000000 P 19723cc84ac7429d891efb14dd75a199 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19723cc84ac7429d891efb14dd75a199" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 37175 } }
I20260923 17:18:03.866312 29824 sys_catalog.cc:564] T 00000000000000000000000000000000 P 19723cc84ac7429d891efb14dd75a199 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:18:03.866721 29831 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19723cc84ac7429d891efb14dd75a199 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 19723cc84ac7429d891efb14dd75a199. Latest consensus state: current_term: 1 leader_uuid: "19723cc84ac7429d891efb14dd75a199" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19723cc84ac7429d891efb14dd75a199" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 37175 } } }
I20260923 17:18:03.866865 29831 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19723cc84ac7429d891efb14dd75a199 [sys.catalog]: This master's current role is: LEADER
I20260923 17:18:03.867105 29830 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19723cc84ac7429d891efb14dd75a199 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "19723cc84ac7429d891efb14dd75a199" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19723cc84ac7429d891efb14dd75a199" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 37175 } } }
I20260923 17:18:03.867198 29830 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19723cc84ac7429d891efb14dd75a199 [sys.catalog]: This master's current role is: LEADER
I20260923 17:18:03.867307 29833 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:18:03.870640 29833 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:18:03.876406 29833 catalog_manager.cc:1347] Generated new cluster ID: e96837a76f134cc797b0c13be51f80ad
I20260923 17:18:03.876477 29833 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:18:03.901109 29833 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:18:03.902441 29833 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:18:03.909006 29833 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 19723cc84ac7429d891efb14dd75a199: Generated new TSK 0
I20260923 17:18:03.909721 29833 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 17:18:03.923463 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.129:0
--local_ip_for_outbound_sockets=127.11.229.129
--webserver_interface=127.11.229.129
--webserver_port=0
--tserver_master_addrs=127.11.229.190:37175
--builtin_ntp_servers=127.11.229.148:43991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260923 17:18:04.038689 29848 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:18:04.038939 29848 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:18:04.038976 29848 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:18:04.042954 29848 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:18:04.043011 29848 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:18:04.043064 29848 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.129
I20260923 17:18:04.047994 29848 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:43991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.229.129
--webserver_port=0
--tserver_master_addrs=127.11.229.190:37175
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29848
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.129
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:18:04.049094 29848 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:18:04.050531 29848 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:18:04.060267 29856 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:04.060421 29848 server_base.cc:1034] running on GCE node
W20260923 17:18:04.060354 29853 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:04.060267 29854 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:04.060966 29848 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:18:04.061632 29848 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:18:04.062857 29848 hybrid_clock.cc:648] HybridClock initialized: now 1790183884062839 us; error 33 us; skew 500 ppm
I20260923 17:18:04.064803 29848 webserver.cc:460] Webserver started at http://127.11.229.129:43391/ using document root <none> and password file <none>
I20260923 17:18:04.065404 29848 fs_manager.cc:359] Metadata directory not provided
I20260923 17:18:04.065495 29848 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:18:04.065738 29848 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:18:04.068117 29848 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-0/data/instance:
uuid: "cb25af4c21d449628ab37eaf61c08f56"
format_stamp: "Formatted at 2026-09-23 17:18:04 on dist-test-slave-1x1f"
server_key: "6babbeaffc1394c57cae61754a1f42c7"
server_key_iv: "707ee268f0b5e4771f94a85bb4889801"
server_key_version: "encryptionkey@0"
I20260923 17:18:04.068717 29848 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance:
uuid: "cb25af4c21d449628ab37eaf61c08f56"
format_stamp: "Formatted at 2026-09-23 17:18:04 on dist-test-slave-1x1f"
server_key: "6babbeaffc1394c57cae61754a1f42c7"
server_key_iv: "707ee268f0b5e4771f94a85bb4889801"
server_key_version: "encryptionkey@0"
I20260923 17:18:04.072321 29848 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260923 17:18:04.074976 29862 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:04.076169 29848 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 17:18:04.076313 29848 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-0/wal
uuid: "cb25af4c21d449628ab37eaf61c08f56"
format_stamp: "Formatted at 2026-09-23 17:18:04 on dist-test-slave-1x1f"
server_key: "6babbeaffc1394c57cae61754a1f42c7"
server_key_iv: "707ee268f0b5e4771f94a85bb4889801"
server_key_version: "encryptionkey@0"
I20260923 17:18:04.076422 29848 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:18:04.110025 29848 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:18:04.110884 29848 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:18:04.111090 29848 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:18:04.111692 29848 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:18:04.112633 29848 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:18:04.112711 29848 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:04.112784 29848 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:18:04.112828 29848 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:04.122068 29848 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.129:36057
I20260923 17:18:04.122097 29975 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.129:36057 every 8 connection(s)
I20260923 17:18:04.123010 29848 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
I20260923 17:18:04.131018 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 29848
I20260923 17:18:04.131235 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance
I20260923 17:18:04.131534 12182 external_mini_cluster.cc:1428] Setting key 41819485d639beef56844b5f603568ed
I20260923 17:18:04.132313 29827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:04.124835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:38353 (local address 127.11.229.190:37175)
0923 17:18:04.124967 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:04.124971 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:04.125959 (+ 988us) server_negotiation.cc:407] Connection header received
0923 17:18:04.127472 (+ 1513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:04.127476 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:04.127545 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:04.127649 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:04.128508 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:04.129069 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:04.130201 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:04.130470 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:04.130597 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:04.131728 (+ 1131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:04.131732 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:04.131735 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:18:04.131750 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:04.131773 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:18:04.131784 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:04.131872 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:04.132101 (+ 229us) server_negotiation.cc:299] Negotiation successful
0923 17:18:04.132172 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260923 17:18:04.133172 29978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:04.125173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:37175 (local address 127.11.229.129:38353)
0923 17:18:04.125814 (+ 641us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:04.125853 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:04.127257 (+ 1404us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:04.127815 (+ 558us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:04.127822 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:04.127902 (+ 80us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:18:04.128367 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:04.128378 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:04.129195 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:04.129203 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:04.130073 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:04.130082 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:04.130632 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:04.130636 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:04.130798 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:04.131435 (+ 637us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 17:18:04.131437 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:18:04.131475 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 17:18:04.131538 (+ 63us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:18:04.131905 (+ 367us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:18:04.131913 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:18:04.131918 (+ 5us) client_negotiation.cc:769] Sending connection context
0923 17:18:04.132147 (+ 229us) client_negotiation.cc:240] Negotiation successful
0923 17:18:04.132443 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":108,"threads_started":1}
I20260923 17:18:04.133813 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.130:0
--local_ip_for_outbound_sockets=127.11.229.130
--webserver_interface=127.11.229.130
--webserver_port=0
--tserver_master_addrs=127.11.229.190:37175
--builtin_ntp_servers=127.11.229.148:43991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260923 17:18:04.134465 29976 heartbeater.cc:347] Connected to a master server at 127.11.229.190:37175
I20260923 17:18:04.134742 29976 heartbeater.cc:464] Registering TS with master...
I20260923 17:18:04.135249 29976 heartbeater.cc:511] Master 127.11.229.190:37175 requested a full tablet report, sending...
I20260923 17:18:04.136736 29788 ts_manager.cc:194] Registered new tserver with Master: cb25af4c21d449628ab37eaf61c08f56 (127.11.229.129:36057)
I20260923 17:18:04.137943 29788 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.229.129:38353
W20260923 17:18:04.243409 29979 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:18:04.243683 29979 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:18:04.243724 29979 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:18:04.247852 29979 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:18:04.247905 29979 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:18:04.248107 29979 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.130
I20260923 17:18:04.253171 29979 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:43991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.229.130
--webserver_port=0
--tserver_master_addrs=127.11.229.190:37175
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29979
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.130
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:18:04.254347 29979 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:18:04.255715 29979 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:18:04.265333 29987 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:04.265333 29984 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:04.265328 29985 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:04.265419 29979 server_base.cc:1034] running on GCE node
I20260923 17:18:04.265926 29979 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:18:04.266763 29979 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:18:04.267961 29979 hybrid_clock.cc:648] HybridClock initialized: now 1790183884267919 us; error 57 us; skew 500 ppm
I20260923 17:18:04.270054 29979 webserver.cc:460] Webserver started at http://127.11.229.130:33285/ using document root <none> and password file <none>
I20260923 17:18:04.270761 29979 fs_manager.cc:359] Metadata directory not provided
I20260923 17:18:04.270864 29979 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:18:04.271113 29979 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:18:04.273311 29979 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-1/data/instance:
uuid: "0c13aca61b0b4a5ca14b0b1bc82abe7d"
format_stamp: "Formatted at 2026-09-23 17:18:04 on dist-test-slave-1x1f"
server_key: "06c24b6a86caaa31cb35b0ccb4998c52"
server_key_iv: "6bb6152e550a36f99c91f333cb92a832"
server_key_version: "encryptionkey@0"
I20260923 17:18:04.273917 29979 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance:
uuid: "0c13aca61b0b4a5ca14b0b1bc82abe7d"
format_stamp: "Formatted at 2026-09-23 17:18:04 on dist-test-slave-1x1f"
server_key: "06c24b6a86caaa31cb35b0ccb4998c52"
server_key_iv: "6bb6152e550a36f99c91f333cb92a832"
server_key_version: "encryptionkey@0"
I20260923 17:18:04.277873 29979 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260923 17:18:04.280804 29993 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:04.282014 29979 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 17:18:04.282161 29979 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-1/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-1/wal
uuid: "0c13aca61b0b4a5ca14b0b1bc82abe7d"
format_stamp: "Formatted at 2026-09-23 17:18:04 on dist-test-slave-1x1f"
server_key: "06c24b6a86caaa31cb35b0ccb4998c52"
server_key_iv: "6bb6152e550a36f99c91f333cb92a832"
server_key_version: "encryptionkey@0"
I20260923 17:18:04.282353 29979 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:18:04.302735 29979 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:18:04.303505 29979 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:18:04.303732 29979 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:18:04.304370 29979 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:18:04.305415 29979 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:18:04.305495 29979 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:04.305575 29979 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:18:04.305641 29979 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:04.315865 29979 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.130:42427
I20260923 17:18:04.315943 30106 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.130:42427 every 8 connection(s)
I20260923 17:18:04.317016 29979 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
I20260923 17:18:04.320784 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 29979
I20260923 17:18:04.320952 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance
I20260923 17:18:04.321354 12182 external_mini_cluster.cc:1428] Setting key 2ce86140ace0801be11f9ae69eb3a678
I20260923 17:18:04.323437 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.131:0
--local_ip_for_outbound_sockets=127.11.229.131
--webserver_interface=127.11.229.131
--webserver_port=0
--tserver_master_addrs=127.11.229.190:37175
--builtin_ntp_servers=127.11.229.148:43991
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260923 17:18:04.326967 29827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:04.319176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:53259 (local address 127.11.229.190:37175)
0923 17:18:04.319318 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:04.319321 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:04.320289 (+ 968us) server_negotiation.cc:407] Connection header received
0923 17:18:04.321869 (+ 1580us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:04.321873 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:04.321934 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:04.322043 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:04.323005 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:04.323545 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:04.324757 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:04.324980 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:04.325091 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:04.326273 (+ 1182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:04.326281 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:04.326283 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:18:04.326314 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:04.326337 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:18:04.326346 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:04.326428 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:04.326643 (+ 215us) server_negotiation.cc:299] Negotiation successful
0923 17:18:04.326727 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260923 17:18:04.327715 30109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:04.319395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:37175 (local address 127.11.229.130:53259)
0923 17:18:04.320099 (+ 704us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:04.320139 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:04.321644 (+ 1505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:04.322271 (+ 627us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:04.322282 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:04.322377 (+ 95us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:18:04.322866 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:04.322878 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:04.323717 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:04.323721 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:04.324629 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:04.324638 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:04.325131 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:04.325134 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:04.325305 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:04.325942 (+ 637us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 17:18:04.325943 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:18:04.325981 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 17:18:04.326047 (+ 66us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:18:04.326443 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:18:04.326452 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:18:04.326458 (+ 6us) client_negotiation.cc:769] Sending connection context
0923 17:18:04.326619 (+ 161us) client_negotiation.cc:240] Negotiation successful
0923 17:18:04.326854 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307,"thread_start_us":128,"threads_started":1}
I20260923 17:18:04.329085 30107 heartbeater.cc:347] Connected to a master server at 127.11.229.190:37175
I20260923 17:18:04.329351 30107 heartbeater.cc:464] Registering TS with master...
I20260923 17:18:04.329914 30107 heartbeater.cc:511] Master 127.11.229.190:37175 requested a full tablet report, sending...
I20260923 17:18:04.331236 29788 ts_manager.cc:194] Registered new tserver with Master: 0c13aca61b0b4a5ca14b0b1bc82abe7d (127.11.229.130:42427)
I20260923 17:18:04.331848 29788 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.229.130:53259
W20260923 17:18:04.443572 30110 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:18:04.443857 30110 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:18:04.443897 30110 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:18:04.448015 30110 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:18:04.448071 30110 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:18:04.448179 30110 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.131
I20260923 17:18:04.453053 30110 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:43991
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.229.131
--webserver_port=0
--tserver_master_addrs=127.11.229.190:37175
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30110
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.131
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:18:04.454144 30110 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:18:04.455576 30110 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:18:04.465376 30116 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:04.465490 30118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:04.465490 30115 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:04.465619 30110 server_base.cc:1034] running on GCE node
I20260923 17:18:04.466076 30110 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:18:04.466847 30110 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:18:04.468020 30110 hybrid_clock.cc:648] HybridClock initialized: now 1790183884468032 us; error 68 us; skew 500 ppm
I20260923 17:18:04.470082 30110 webserver.cc:460] Webserver started at http://127.11.229.131:45485/ using document root <none> and password file <none>
I20260923 17:18:04.470707 30110 fs_manager.cc:359] Metadata directory not provided
I20260923 17:18:04.470767 30110 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:18:04.470973 30110 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:18:04.473084 30110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-2/data/instance:
uuid: "ca1dd6c15bd348e9a4f86da5fdc5ed9e"
format_stamp: "Formatted at 2026-09-23 17:18:04 on dist-test-slave-1x1f"
server_key: "5677f6762d052d9130cc4993c0fd6080"
server_key_iv: "0b0ec6a1b4095cbf9a2a456a565602aa"
server_key_version: "encryptionkey@0"
I20260923 17:18:04.473645 30110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance:
uuid: "ca1dd6c15bd348e9a4f86da5fdc5ed9e"
format_stamp: "Formatted at 2026-09-23 17:18:04 on dist-test-slave-1x1f"
server_key: "5677f6762d052d9130cc4993c0fd6080"
server_key_iv: "0b0ec6a1b4095cbf9a2a456a565602aa"
server_key_version: "encryptionkey@0"
I20260923 17:18:04.477388 30110 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260923 17:18:04.480109 30124 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:04.481421 30110 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 17:18:04.481544 30110 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-2/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-2/wal
uuid: "ca1dd6c15bd348e9a4f86da5fdc5ed9e"
format_stamp: "Formatted at 2026-09-23 17:18:04 on dist-test-slave-1x1f"
server_key: "5677f6762d052d9130cc4993c0fd6080"
server_key_iv: "0b0ec6a1b4095cbf9a2a456a565602aa"
server_key_version: "encryptionkey@0"
I20260923 17:18:04.481652 30110 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:18:04.499578 30110 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:18:04.500352 30110 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:18:04.500557 30110 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:18:04.501179 30110 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:18:04.502146 30110 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:18:04.502197 30110 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:04.502286 30110 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:18:04.502342 30110 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:04.511440 30110 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.131:39461
I20260923 17:18:04.511471 30237 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.131:39461 every 8 connection(s)
I20260923 17:18:04.512360 30110 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
I20260923 17:18:04.520447 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 30110
I20260923 17:18:04.520598 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance
I20260923 17:18:04.520936 12182 external_mini_cluster.cc:1428] Setting key 7c5ddc5c072f07bb1ae663b9ead74aaa
I20260923 17:18:04.521533 29827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:04.514144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:47815 (local address 127.11.229.190:37175)
0923 17:18:04.514406 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:04.514411 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:04.515489 (+ 1078us) server_negotiation.cc:407] Connection header received
0923 17:18:04.516930 (+ 1441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:04.516933 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:04.516980 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:04.517053 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:04.517906 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:04.518438 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:04.519495 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:04.519697 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:04.519769 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:04.520975 (+ 1206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:04.520978 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:04.520980 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:18:04.521012 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:04.521038 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:18:04.521050 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:04.521166 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:04.521326 (+ 160us) server_negotiation.cc:299] Negotiation successful
0923 17:18:04.521390 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162}
I20260923 17:18:04.522629 30240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:04.514580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:37175 (local address 127.11.229.131:47815)
0923 17:18:04.515348 (+ 768us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:04.515387 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:04.516742 (+ 1355us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:04.517228 (+ 486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:04.517234 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:04.517315 (+ 81us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:18:04.517782 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:04.517793 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:04.518543 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:04.518545 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:04.519394 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:04.519403 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:04.519822 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:04.519825 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:04.519954 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:04.520669 (+ 715us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 17:18:04.520671 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:18:04.520724 (+ 53us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 17:18:04.520807 (+ 83us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:18:04.521168 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:18:04.521180 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:18:04.521188 (+ 8us) client_negotiation.cc:769] Sending connection context
0923 17:18:04.521325 (+ 137us) client_negotiation.cc:240] Negotiation successful
0923 17:18:04.521696 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":108,"threads_started":1}
I20260923 17:18:04.523844 30238 heartbeater.cc:347] Connected to a master server at 127.11.229.190:37175
I20260923 17:18:04.524178 30238 heartbeater.cc:464] Registering TS with master...
I20260923 17:18:04.524742 30238 heartbeater.cc:511] Master 127.11.229.190:37175 requested a full tablet report, sending...
I20260923 17:18:04.525753 29788 ts_manager.cc:194] Registered new tserver with Master: ca1dd6c15bd348e9a4f86da5fdc5ed9e (127.11.229.131:39461)
I20260923 17:18:04.526499 29788 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.229.131:47815
I20260923 17:18:04.535148 12182 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 17:18:04.541141 29827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:04.537206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56650 (local address 127.11.229.190:37175)
0923 17:18:04.537388 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:04.537393 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:04.537526 (+ 133us) server_negotiation.cc:407] Connection header received
0923 17:18:04.537682 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:04.537685 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:04.537733 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:04.537824 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:04.538104 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:04.538707 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:04.539559 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:04.539791 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:04.539903 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:04.540721 (+ 818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:04.540725 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:04.540728 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:18:04.540751 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:04.540769 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:18:04.540777 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:04.540855 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:04.540943 (+ 88us) server_negotiation.cc:299] Negotiation successful
0923 17:18:04.540995 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260923 17:18:04.544353 29788 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56650:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 17:18:04.547753 29788 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 17:18:04.563097 30251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:04.556601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38892 (local address 127.11.229.131:39461)
0923 17:18:04.557732 (+ 1131us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:04.557741 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:04.557762 (+ 21us) server_negotiation.cc:407] Connection header received
0923 17:18:04.557822 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:04.557826 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:04.558084 (+ 258us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:04.558277 (+ 193us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:18:04.558565 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:04.559815 (+ 1250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:04.561751 (+ 1936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:04.562384 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:04.562518 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:04.562697 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:04.562818 (+ 121us) server_negotiation.cc:299] Negotiation successful
0923 17:18:04.562921 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1041,"thread_start_us":127,"threads_started":1}
I20260923 17:18:04.563104 30250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:04.556403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.131:39461 (local address 127.0.0.1:38892)
0923 17:18:04.557272 (+ 869us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:04.557326 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:04.557454 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:04.558267 (+ 813us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:04.558273 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:04.558295 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:18:04.558449 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:04.558456 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:04.559937 (+ 1481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:04.559943 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:04.561631 (+ 1688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:04.561640 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:04.562505 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:04.562509 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:04.562625 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:04.562664 (+ 39us) client_negotiation.cc:769] Sending connection context
0923 17:18:04.562788 (+ 124us) client_negotiation.cc:240] Negotiation successful
0923 17:18:04.562932 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":687,"mutex_wait_us":21,"thread_start_us":81,"threads_started":1}
I20260923 17:18:04.563290 30253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:04.557174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35454 (local address 127.11.229.129:36057)
0923 17:18:04.558389 (+ 1215us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:04.558400 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:04.558421 (+ 21us) server_negotiation.cc:407] Connection header received
0923 17:18:04.558495 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:04.558502 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:04.558659 (+ 157us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:04.558810 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:18:04.559177 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:04.560278 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:04.561539 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:04.562374 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:04.562503 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:04.562678 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:04.562996 (+ 318us) server_negotiation.cc:299] Negotiation successful
0923 17:18:04.563092 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1115,"thread_start_us":146,"threads_started":1}
I20260923 17:18:04.563980 30249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:04.556847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.130:42427 (local address 127.0.0.1:39992)
0923 17:18:04.558021 (+ 1174us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:04.558034 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:04.558127 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:04.558728 (+ 601us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:04.558734 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:04.558756 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:18:04.558857 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:04.558864 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:04.560335 (+ 1471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:04.560338 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:04.561530 (+ 1192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:04.561541 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:04.563156 (+ 1615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:04.563574 (+ 418us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:04.563659 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:04.563684 (+ 25us) client_negotiation.cc:769] Sending connection context
0923 17:18:04.563778 (+ 94us) client_negotiation.cc:240] Negotiation successful
0923 17:18:04.563850 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1117,"mutex_wait_us":27,"thread_start_us":101,"threads_started":1}
I20260923 17:18:04.564083 30254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:04.557270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39992 (local address 127.11.229.130:42427)
0923 17:18:04.557870 (+ 600us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:04.557883 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:04.558105 (+ 222us) server_negotiation.cc:407] Connection header received
0923 17:18:04.558262 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:04.558268 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:04.558444 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:04.558581 (+ 137us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:18:04.558987 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:04.560169 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:04.561645 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:04.562389 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:04.562503 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:04.562692 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:04.563818 (+ 1126us) server_negotiation.cc:299] Negotiation successful
0923 17:18:04.563914 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":495,"thread_start_us":131,"threads_started":1}
I20260923 17:18:04.564464 30252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:04.556624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:36057 (local address 127.0.0.1:35454)
0923 17:18:04.557388 (+ 764us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:04.557405 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:04.557495 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:04.558956 (+ 1461us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:04.558962 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:04.558980 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:18:04.559056 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:04.559061 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:04.560399 (+ 1338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:04.560404 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:04.561413 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:04.561422 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:04.562776 (+ 1354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:04.562779 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:04.562845 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:04.562868 (+ 23us) client_negotiation.cc:769] Sending connection context
0923 17:18:04.562963 (+ 95us) client_negotiation.cc:240] Negotiation successful
0923 17:18:04.563033 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":696,"mutex_wait_us":30,"thread_start_us":104,"threads_started":1}
I20260923 17:18:04.566588 30172 tablet_service.cc:1467] Processing CreateTablet for tablet fa3a2c070d294627908a6db934818bfd (DEFAULT_TABLE table=test-table [id=bccb67edd114415f8daacff5b184dcf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:18:04.566977 29910 tablet_service.cc:1467] Processing CreateTablet for tablet fa3a2c070d294627908a6db934818bfd (DEFAULT_TABLE table=test-table [id=bccb67edd114415f8daacff5b184dcf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:18:04.567236 30041 tablet_service.cc:1467] Processing CreateTablet for tablet fa3a2c070d294627908a6db934818bfd (DEFAULT_TABLE table=test-table [id=bccb67edd114415f8daacff5b184dcf4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:18:04.567821 30172 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa3a2c070d294627908a6db934818bfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:18:04.568084 29910 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa3a2c070d294627908a6db934818bfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:18:04.568184 30041 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fa3a2c070d294627908a6db934818bfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:18:04.573958 30255 tablet_bootstrap.cc:492] T fa3a2c070d294627908a6db934818bfd P cb25af4c21d449628ab37eaf61c08f56: Bootstrap starting.
I20260923 17:18:04.576051 30256 tablet_bootstrap.cc:492] T fa3a2c070d294627908a6db934818bfd P ca1dd6c15bd348e9a4f86da5fdc5ed9e: Bootstrap starting.
I20260923 17:18:04.576051 30257 tablet_bootstrap.cc:492] T fa3a2c070d294627908a6db934818bfd P 0c13aca61b0b4a5ca14b0b1bc82abe7d: Bootstrap starting.
I20260923 17:18:04.576354 30255 tablet_bootstrap.cc:654] T fa3a2c070d294627908a6db934818bfd P cb25af4c21d449628ab37eaf61c08f56: Neither blocks nor log segments found. Creating new log.
I20260923 17:18:04.577072 30255 log.cc:824] T fa3a2c070d294627908a6db934818bfd P cb25af4c21d449628ab37eaf61c08f56: Log is configured to *not* fsync() on all Append() calls
I20260923 17:18:04.578188 30256 tablet_bootstrap.cc:654] T fa3a2c070d294627908a6db934818bfd P ca1dd6c15bd348e9a4f86da5fdc5ed9e: Neither blocks nor log segments found. Creating new log.
I20260923 17:18:04.578188 30257 tablet_bootstrap.cc:654] T fa3a2c070d294627908a6db934818bfd P 0c13aca61b0b4a5ca14b0b1bc82abe7d: Neither blocks nor log segments found. Creating new log.
I20260923 17:18:04.578902 30255 tablet_bootstrap.cc:492] T fa3a2c070d294627908a6db934818bfd P cb25af4c21d449628ab37eaf61c08f56: No bootstrap required, opened a new log
I20260923 17:18:04.579052 30256 log.cc:824] T fa3a2c070d294627908a6db934818bfd P ca1dd6c15bd348e9a4f86da5fdc5ed9e: Log is configured to *not* fsync() on all Append() calls
I20260923 17:18:04.579052 30257 log.cc:824] T fa3a2c070d294627908a6db934818bfd P 0c13aca61b0b4a5ca14b0b1bc82abe7d: Log is configured to *not* fsync() on all Append() calls
I20260923 17:18:04.579103 30255 ts_tablet_manager.cc:1397] T fa3a2c070d294627908a6db934818bfd P cb25af4c21d449628ab37eaf61c08f56: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260923 17:18:04.581266 30256 tablet_bootstrap.cc:492] T fa3a2c070d294627908a6db934818bfd P ca1dd6c15bd348e9a4f86da5fdc5ed9e: No bootstrap required, opened a new log
I20260923 17:18:04.581422 30257 tablet_bootstrap.cc:492] T fa3a2c070d294627908a6db934818bfd P 0c13aca61b0b4a5ca14b0b1bc82abe7d: No bootstrap required, opened a new log
I20260923 17:18:04.581486 30256 ts_tablet_manager.cc:1397] T fa3a2c070d294627908a6db934818bfd P ca1dd6c15bd348e9a4f86da5fdc5ed9e: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260923 17:18:04.581602 30257 ts_tablet_manager.cc:1397] T fa3a2c070d294627908a6db934818bfd P 0c13aca61b0b4a5ca14b0b1bc82abe7d: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260923 17:18:04.583730 30255 raft_consensus.cc:348] T fa3a2c070d294627908a6db934818bfd P cb25af4c21d449628ab37eaf61c08f56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1dd6c15bd348e9a4f86da5fdc5ed9e" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39461 } } peers { permanent_uuid: "cb25af4c21d449628ab37eaf61c08f56" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 36057 } } peers { permanent_uuid: "0c13aca61b0b4a5ca14b0b1bc82abe7d" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42427 } }
I20260923 17:18:04.584013 30255 raft_consensus.cc:374] T fa3a2c070d294627908a6db934818bfd P cb25af4c21d449628ab37eaf61c08f56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:18:04.584069 30255 raft_consensus.cc:729] T fa3a2c070d294627908a6db934818bfd P cb25af4c21d449628ab37eaf61c08f56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb25af4c21d449628ab37eaf61c08f56, State: Initialized, Role: FOLLOWER
I20260923 17:18:04.584538 30255 consensus_queue.cc:260] T fa3a2c070d294627908a6db934818bfd P cb25af4c21d449628ab37eaf61c08f56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1dd6c15bd348e9a4f86da5fdc5ed9e" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39461 } } peers { permanent_uuid: "cb25af4c21d449628ab37eaf61c08f56" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 36057 } } peers { permanent_uuid: "0c13aca61b0b4a5ca14b0b1bc82abe7d" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42427 } }
I20260923 17:18:04.585219 29976 heartbeater.cc:503] Master 127.11.229.190:37175 was elected leader, sending a full tablet report...
I20260923 17:18:04.585234 30256 raft_consensus.cc:348] T fa3a2c070d294627908a6db934818bfd P ca1dd6c15bd348e9a4f86da5fdc5ed9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1dd6c15bd348e9a4f86da5fdc5ed9e" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39461 } } peers { permanent_uuid: "cb25af4c21d449628ab37eaf61c08f56" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 36057 } } peers { permanent_uuid: "0c13aca61b0b4a5ca14b0b1bc82abe7d" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42427 } }
I20260923 17:18:04.585500 30256 raft_consensus.cc:374] T fa3a2c070d294627908a6db934818bfd P ca1dd6c15bd348e9a4f86da5fdc5ed9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:18:04.585549 30256 raft_consensus.cc:729] T fa3a2c070d294627908a6db934818bfd P ca1dd6c15bd348e9a4f86da5fdc5ed9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca1dd6c15bd348e9a4f86da5fdc5ed9e, State: Initialized, Role: FOLLOWER
I20260923 17:18:04.585582 30255 ts_tablet_manager.cc:1428] T fa3a2c070d294627908a6db934818bfd P cb25af4c21d449628ab37eaf61c08f56: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260923 17:18:04.585736 30257 raft_consensus.cc:348] T fa3a2c070d294627908a6db934818bfd P 0c13aca61b0b4a5ca14b0b1bc82abe7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1dd6c15bd348e9a4f86da5fdc5ed9e" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39461 } } peers { permanent_uuid: "cb25af4c21d449628ab37eaf61c08f56" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 36057 } } peers { permanent_uuid: "0c13aca61b0b4a5ca14b0b1bc82abe7d" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42427 } }
I20260923 17:18:04.585981 30257 raft_consensus.cc:374] T fa3a2c070d294627908a6db934818bfd P 0c13aca61b0b4a5ca14b0b1bc82abe7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:18:04.586030 30257 raft_consensus.cc:729] T fa3a2c070d294627908a6db934818bfd P 0c13aca61b0b4a5ca14b0b1bc82abe7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c13aca61b0b4a5ca14b0b1bc82abe7d, State: Initialized, Role: FOLLOWER
I20260923 17:18:04.586066 30256 consensus_queue.cc:260] T fa3a2c070d294627908a6db934818bfd P ca1dd6c15bd348e9a4f86da5fdc5ed9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1dd6c15bd348e9a4f86da5fdc5ed9e" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39461 } } peers { permanent_uuid: "cb25af4c21d449628ab37eaf61c08f56" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 36057 } } peers { permanent_uuid: "0c13aca61b0b4a5ca14b0b1bc82abe7d" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42427 } }
I20260923 17:18:04.586531 30257 consensus_queue.cc:260] T fa3a2c070d294627908a6db934818bfd P 0c13aca61b0b4a5ca14b0b1bc82abe7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1dd6c15bd348e9a4f86da5fdc5ed9e" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39461 } } peers { permanent_uuid: "cb25af4c21d449628ab37eaf61c08f56" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 36057 } } peers { permanent_uuid: "0c13aca61b0b4a5ca14b0b1bc82abe7d" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42427 } }
I20260923 17:18:04.587352 30256 ts_tablet_manager.cc:1428] T fa3a2c070d294627908a6db934818bfd P ca1dd6c15bd348e9a4f86da5fdc5ed9e: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260923 17:18:04.587452 30257 ts_tablet_manager.cc:1428] T fa3a2c070d294627908a6db934818bfd P 0c13aca61b0b4a5ca14b0b1bc82abe7d: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260923 17:18:04.587697 30238 heartbeater.cc:503] Master 127.11.229.190:37175 was elected leader, sending a full tablet report...
I20260923 17:18:04.588637 30107 heartbeater.cc:503] Master 127.11.229.190:37175 was elected leader, sending a full tablet report...
W20260923 17:18:04.624199 29977 tablet.cc:2369] T fa3a2c070d294627908a6db934818bfd P cb25af4c21d449628ab37eaf61c08f56: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 17:18:04.676967 30263 raft_consensus.cc:482] T fa3a2c070d294627908a6db934818bfd P 0c13aca61b0b4a5ca14b0b1bc82abe7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 17:18:04.677165 30263 raft_consensus.cc:504] T fa3a2c070d294627908a6db934818bfd P 0c13aca61b0b4a5ca14b0b1bc82abe7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1dd6c15bd348e9a4f86da5fdc5ed9e" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39461 } } peers { permanent_uuid: "cb25af4c21d449628ab37eaf61c08f56" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 36057 } } peers { permanent_uuid: "0c13aca61b0b4a5ca14b0b1bc82abe7d" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42427 } }
I20260923 17:18:04.678467 30263 leader_election.cc:288] T fa3a2c070d294627908a6db934818bfd P 0c13aca61b0b4a5ca14b0b1bc82abe7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ca1dd6c15bd348e9a4f86da5fdc5ed9e (127.11.229.131:39461), cb25af4c21d449628ab37eaf61c08f56 (127.11.229.129:36057)
I20260923 17:18:04.682853 30109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:04.678596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.131:39461 (local address 127.11.229.130:37607)
0923 17:18:04.678829 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:04.678844 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:04.678943 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:04.679281 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:04.679284 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:04.679303 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:18:04.679425 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:04.679432 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:04.680264 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:04.680269 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:04.681516 (+ 1247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:04.681526 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:04.682395 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:04.682398 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:04.682519 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:04.682550 (+ 31us) client_negotiation.cc:769] Sending connection context
0923 17:18:04.682625 (+ 75us) client_negotiation.cc:240] Negotiation successful
0923 17:18:04.682700 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"mutex_wait_us":1}
I20260923 17:18:04.682886 30251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:04.678776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:37607 (local address 127.11.229.131:39461)
0923 17:18:04.678904 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:04.678909 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:04.678928 (+ 19us) server_negotiation.cc:407] Connection header received
0923 17:18:04.679068 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:04.679071 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:04.679136 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:04.679238 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:18:04.679543 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:04.680151 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:04.681644 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:04.682274 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:04.682392 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:04.682465 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:04.682659 (+ 194us) server_negotiation.cc:299] Negotiation successful
0923 17:18:04.682759 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260923 17:18:04.682974 30253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:04.678783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:51857 (local address 127.11.229.129:36057)
0923 17:18:04.678904 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:04.678910 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:04.679152 (+ 242us) server_negotiation.cc:407] Connection header received
0923 17:18:04.679342 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:04.679346 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:04.679409 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:04.679519 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:18:04.679900 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:04.680516 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:04.681825 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:04.682466 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:04.682573 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:04.682633 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:04.682793 (+ 160us) server_negotiation.cc:299] Negotiation successful
0923 17:18:04.682858 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260923 17:18:04.683502 30264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:04.678636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:36057 (local address 127.11.229.130:51857)
0923 17:18:04.679065 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:04.679075 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:04.679149 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:04.679545 (+ 396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:04.679548 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:04.679564 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:18:04.679687 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:04.679692 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:04.680646 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:04.680649 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:04.681713 (+ 1064us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:04.681720 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:04.682563 (+ 843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:04.682566 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:04.682665 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:04.682683 (+ 18us) client_negotiation.cc:769] Sending connection context
0923 17:18:04.682760 (+ 77us) client_negotiation.cc:240] Negotiation successful
0923 17:18:04.682812 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":118,"threads_started":1}
I20260923 17:18:04.683569 30192 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa3a2c070d294627908a6db934818bfd" candidate_uuid: "0c13aca61b0b4a5ca14b0b1bc82abe7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1dd6c15bd348e9a4f86da5fdc5ed9e" is_pre_election: true
I20260923 17:18:04.683908 30192 raft_consensus.cc:2454] T fa3a2c070d294627908a6db934818bfd P ca1dd6c15bd348e9a4f86da5fdc5ed9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c13aca61b0b4a5ca14b0b1bc82abe7d in term 0.
I20260923 17:18:04.684130 29930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa3a2c070d294627908a6db934818bfd" candidate_uuid: "0c13aca61b0b4a5ca14b0b1bc82abe7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb25af4c21d449628ab37eaf61c08f56" is_pre_election: true
I20260923 17:18:04.684412 29930 raft_consensus.cc:2454] T fa3a2c070d294627908a6db934818bfd P cb25af4c21d449628ab37eaf61c08f56 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c13aca61b0b4a5ca14b0b1bc82abe7d in term 0.
I20260923 17:18:04.684584 29997 leader_election.cc:302] T fa3a2c070d294627908a6db934818bfd P 0c13aca61b0b4a5ca14b0b1bc82abe7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c13aca61b0b4a5ca14b0b1bc82abe7d, ca1dd6c15bd348e9a4f86da5fdc5ed9e; no voters:
I20260923 17:18:04.684880 30263 raft_consensus.cc:2781] T fa3a2c070d294627908a6db934818bfd P 0c13aca61b0b4a5ca14b0b1bc82abe7d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 17:18:04.684989 30263 raft_consensus.cc:482] T fa3a2c070d294627908a6db934818bfd P 0c13aca61b0b4a5ca14b0b1bc82abe7d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 17:18:04.685045 30263 raft_consensus.cc:3037] T fa3a2c070d294627908a6db934818bfd P 0c13aca61b0b4a5ca14b0b1bc82abe7d [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:18:04.686527 30263 raft_consensus.cc:504] T fa3a2c070d294627908a6db934818bfd P 0c13aca61b0b4a5ca14b0b1bc82abe7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1dd6c15bd348e9a4f86da5fdc5ed9e" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39461 } } peers { permanent_uuid: "cb25af4c21d449628ab37eaf61c08f56" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 36057 } } peers { permanent_uuid: "0c13aca61b0b4a5ca14b0b1bc82abe7d" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42427 } }
I20260923 17:18:04.686955 30263 leader_election.cc:288] T fa3a2c070d294627908a6db934818bfd P 0c13aca61b0b4a5ca14b0b1bc82abe7d [CANDIDATE]: Term 1 election: Requested vote from peers ca1dd6c15bd348e9a4f86da5fdc5ed9e (127.11.229.131:39461), cb25af4c21d449628ab37eaf61c08f56 (127.11.229.129:36057)
I20260923 17:18:04.687527 29930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa3a2c070d294627908a6db934818bfd" candidate_uuid: "0c13aca61b0b4a5ca14b0b1bc82abe7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cb25af4c21d449628ab37eaf61c08f56"
I20260923 17:18:04.687476 30192 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fa3a2c070d294627908a6db934818bfd" candidate_uuid: "0c13aca61b0b4a5ca14b0b1bc82abe7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ca1dd6c15bd348e9a4f86da5fdc5ed9e"
I20260923 17:18:04.687754 30192 raft_consensus.cc:3037] T fa3a2c070d294627908a6db934818bfd P ca1dd6c15bd348e9a4f86da5fdc5ed9e [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:18:04.687812 29930 raft_consensus.cc:3037] T fa3a2c070d294627908a6db934818bfd P cb25af4c21d449628ab37eaf61c08f56 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:18:04.688946 30192 raft_consensus.cc:2454] T fa3a2c070d294627908a6db934818bfd P ca1dd6c15bd348e9a4f86da5fdc5ed9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c13aca61b0b4a5ca14b0b1bc82abe7d in term 1.
I20260923 17:18:04.689270 29930 raft_consensus.cc:2454] T fa3a2c070d294627908a6db934818bfd P cb25af4c21d449628ab37eaf61c08f56 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c13aca61b0b4a5ca14b0b1bc82abe7d in term 1.
I20260923 17:18:04.689304 29997 leader_election.cc:302] T fa3a2c070d294627908a6db934818bfd P 0c13aca61b0b4a5ca14b0b1bc82abe7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c13aca61b0b4a5ca14b0b1bc82abe7d, ca1dd6c15bd348e9a4f86da5fdc5ed9e; no voters:
I20260923 17:18:04.689479 30263 raft_consensus.cc:2781] T fa3a2c070d294627908a6db934818bfd P 0c13aca61b0b4a5ca14b0b1bc82abe7d [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:18:04.689741 30263 raft_consensus.cc:686] T fa3a2c070d294627908a6db934818bfd P 0c13aca61b0b4a5ca14b0b1bc82abe7d [term 1 LEADER]: Becoming Leader. State: Replica: 0c13aca61b0b4a5ca14b0b1bc82abe7d, State: Running, Role: LEADER
I20260923 17:18:04.690084 30263 consensus_queue.cc:237] T fa3a2c070d294627908a6db934818bfd P 0c13aca61b0b4a5ca14b0b1bc82abe7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1dd6c15bd348e9a4f86da5fdc5ed9e" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39461 } } peers { permanent_uuid: "cb25af4c21d449628ab37eaf61c08f56" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 36057 } } peers { permanent_uuid: "0c13aca61b0b4a5ca14b0b1bc82abe7d" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42427 } }
I20260923 17:18:04.693149 29787 catalog_manager.cc:5495] T fa3a2c070d294627908a6db934818bfd P 0c13aca61b0b4a5ca14b0b1bc82abe7d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c13aca61b0b4a5ca14b0b1bc82abe7d (127.11.229.130). New cstate: current_term: 1 leader_uuid: "0c13aca61b0b4a5ca14b0b1bc82abe7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca1dd6c15bd348e9a4f86da5fdc5ed9e" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cb25af4c21d449628ab37eaf61c08f56" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 36057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c13aca61b0b4a5ca14b0b1bc82abe7d" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42427 } health_report { overall_health: HEALTHY } } }
I20260923 17:18:04.723834 30254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:04.720339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40004 (local address 127.11.229.130:42427)
0923 17:18:04.720488 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:04.720495 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:04.720511 (+ 16us) server_negotiation.cc:407] Connection header received
0923 17:18:04.720588 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:04.720590 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:04.720643 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:04.720757 (+ 114us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 17:18:04.721000 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:04.721521 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:04.722399 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:04.722615 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:04.722721 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:04.723015 (+ 294us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 17:18:04.723430 (+ 415us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 17:18:04.723560 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:04.723622 (+ 62us) server_negotiation.cc:299] Negotiation successful
0923 17:18:04.723675 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260923 17:18:04.729874 29930 raft_consensus.cc:1261] T fa3a2c070d294627908a6db934818bfd P cb25af4c21d449628ab37eaf61c08f56 [term 1 FOLLOWER]: Refusing update from remote peer 0c13aca61b0b4a5ca14b0b1bc82abe7d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:18:04.729874 30192 raft_consensus.cc:1261] T fa3a2c070d294627908a6db934818bfd P ca1dd6c15bd348e9a4f86da5fdc5ed9e [term 1 FOLLOWER]: Refusing update from remote peer 0c13aca61b0b4a5ca14b0b1bc82abe7d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:18:04.730742 30263 consensus_queue.cc:1035] T fa3a2c070d294627908a6db934818bfd P 0c13aca61b0b4a5ca14b0b1bc82abe7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ca1dd6c15bd348e9a4f86da5fdc5ed9e" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 39461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:18:04.730939 30265 consensus_queue.cc:1035] T fa3a2c070d294627908a6db934818bfd P 0c13aca61b0b4a5ca14b0b1bc82abe7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cb25af4c21d449628ab37eaf61c08f56" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 36057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:18:04.737534 30268 mvcc.cc:205] Tried to move back new op lower bound from 7332593191845281792 to 7332593191693148160. Current Snapshot: MvccSnapshot[applied={T|T < 7332593191845281792}]
I20260923 17:18:04.745337 29788 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56650:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:18:04.745482 29788 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56650:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:18:04.747843 29788 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 19723cc84ac7429d891efb14dd75a199: Sending DeleteTablet for 3 replicas of tablet fa3a2c070d294627908a6db934818bfd
I20260923 17:18:04.748590 30172 tablet_service.cc:1514] Processing DeleteTablet for tablet fa3a2c070d294627908a6db934818bfd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:18:04 UTC) from {username='slave'} at 127.0.0.1:38892
I20260923 17:18:04.748590 29910 tablet_service.cc:1514] Processing DeleteTablet for tablet fa3a2c070d294627908a6db934818bfd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:18:04 UTC) from {username='slave'} at 127.0.0.1:35454
I20260923 17:18:04.748632 30041 tablet_service.cc:1514] Processing DeleteTablet for tablet fa3a2c070d294627908a6db934818bfd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:18:04 UTC) from {username='slave'} at 127.0.0.1:39992
I20260923 17:18:04.749064 30278 tablet_replica.cc:330] T fa3a2c070d294627908a6db934818bfd P ca1dd6c15bd348e9a4f86da5fdc5ed9e: stopping tablet replica
I20260923 17:18:04.749286 30280 tablet_replica.cc:330] T fa3a2c070d294627908a6db934818bfd P 0c13aca61b0b4a5ca14b0b1bc82abe7d: stopping tablet replica
I20260923 17:18:04.749392 30278 raft_consensus.cc:2229] T fa3a2c070d294627908a6db934818bfd P ca1dd6c15bd348e9a4f86da5fdc5ed9e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:18:04.749508 30279 tablet_replica.cc:330] T fa3a2c070d294627908a6db934818bfd P cb25af4c21d449628ab37eaf61c08f56: stopping tablet replica
I20260923 17:18:04.749811 30279 raft_consensus.cc:2229] T fa3a2c070d294627908a6db934818bfd P cb25af4c21d449628ab37eaf61c08f56 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:18:04.749995 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 29848
I20260923 17:18:04.750698 30280 raft_consensus.cc:2229] T fa3a2c070d294627908a6db934818bfd P 0c13aca61b0b4a5ca14b0b1bc82abe7d [term 1 LEADER]: Raft consensus shutting down.
I20260923 17:18:04.751034 30280 raft_consensus.cc:2258] T fa3a2c070d294627908a6db934818bfd P 0c13aca61b0b4a5ca14b0b1bc82abe7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:18:04.749719 30278 raft_consensus.cc:2258] T fa3a2c070d294627908a6db934818bfd P ca1dd6c15bd348e9a4f86da5fdc5ed9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:18:04.752624 30280 ts_tablet_manager.cc:1905] T fa3a2c070d294627908a6db934818bfd P 0c13aca61b0b4a5ca14b0b1bc82abe7d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:18:04.753965 30278 ts_tablet_manager.cc:1905] T fa3a2c070d294627908a6db934818bfd P ca1dd6c15bd348e9a4f86da5fdc5ed9e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:18:04.755373 30280 ts_tablet_manager.cc:1918] T fa3a2c070d294627908a6db934818bfd P 0c13aca61b0b4a5ca14b0b1bc82abe7d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 17:18:04.755486 30280 log.cc:1196] T fa3a2c070d294627908a6db934818bfd P 0c13aca61b0b4a5ca14b0b1bc82abe7d: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-1/wal/wals/fa3a2c070d294627908a6db934818bfd
I20260923 17:18:04.755807 30280 ts_tablet_manager.cc:1939] T fa3a2c070d294627908a6db934818bfd P 0c13aca61b0b4a5ca14b0b1bc82abe7d: Deleting consensus metadata
I20260923 17:18:04.756897 30278 ts_tablet_manager.cc:1918] T fa3a2c070d294627908a6db934818bfd P ca1dd6c15bd348e9a4f86da5fdc5ed9e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 17:18:04.756994 30278 log.cc:1196] T fa3a2c070d294627908a6db934818bfd P ca1dd6c15bd348e9a4f86da5fdc5ed9e: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790183633736342-12182-0/minicluster-data/ts-2/wal/wals/fa3a2c070d294627908a6db934818bfd
I20260923 17:18:04.757047 29772 catalog_manager.cc:4841] TS 0c13aca61b0b4a5ca14b0b1bc82abe7d (127.11.229.130:42427): tablet fa3a2c070d294627908a6db934818bfd (table test-table [id=bccb67edd114415f8daacff5b184dcf4]) successfully deleted
I20260923 17:18:04.757297 30278 ts_tablet_manager.cc:1939] T fa3a2c070d294627908a6db934818bfd P ca1dd6c15bd348e9a4f86da5fdc5ed9e: Deleting consensus metadata
I20260923 17:18:04.758350 29775 catalog_manager.cc:4841] TS ca1dd6c15bd348e9a4f86da5fdc5ed9e (127.11.229.131:39461): tablet fa3a2c070d294627908a6db934818bfd (table test-table [id=bccb67edd114415f8daacff5b184dcf4]) successfully deleted
W20260923 17:18:04.758823 29774 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.229.129:36057 (error 108)
I20260923 17:18:04.759066 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 29979
I20260923 17:18:04.761124 30252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:04.760756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:36057 (local address 127.0.0.1:35470)
0923 17:18:04.760924 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:04.761007 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.129:36057: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260923 17:18:04.761309 29774 catalog_manager.cc:4584] TS cb25af4c21d449628ab37eaf61c08f56 (127.11.229.129:36057): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet fa3a2c070d294627908a6db934818bfd: Network error: Client connection negotiation failed: client connection to 127.11.229.129:36057: connect: Connection refused (error 111)
I20260923 17:18:04.765522 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 30110
I20260923 17:18:04.771579 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 29757
2026-09-23T17:18:04Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1133 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 17:18:04 dist-test-slave-1x1f krb5kdc[30284](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 17:18:04 dist-test-slave-1x1f krb5kdc[30284](info): set up 2 sockets
Sep 23 17:18:04 dist-test-slave-1x1f krb5kdc[30284](info): commencing operation
krb5kdc: starting...
W20260923 17:18:05.834751 12182 mini_kdc.cc:121] Time spent starting KDC: real 1.042s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Sep 23 17:18:05 dist-test-slave-1x1f krb5kdc[30284](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183885, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T17:18:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:18:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.229.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
I20260923 17:18:05.965153 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:42691
--webserver_interface=127.11.229.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:39569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:42691
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:18:06.077589 30297 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:18:06.077901 30297 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:18:06.077981 30297 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:18:06.082141 30297 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:18:06.082221 30297 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:18:06.082280 30297 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:18:06.082335 30297 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:18:06.082367 30297 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:18:06.087723 30297 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:39569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:42691
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:42691
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.229.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30297
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:18:06.088811 30297 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:18:06.089810 30297 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:18:06.098443 30303 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:06.098443 30302 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:06.098717 30297 server_base.cc:1034] running on GCE node
W20260923 17:18:06.098443 30305 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:06.099399 30297 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:18:06.100543 30297 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:18:06.101732 30297 hybrid_clock.cc:648] HybridClock initialized: now 1790183886101704 us; error 44 us; skew 500 ppm
Sep 23 17:18:06 dist-test-slave-1x1f krb5kdc[30284](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183886, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:18:06.104882 30297 init.cc:377] Logged in from keytab as kudu/127.11.229.190@KRBTEST.COM (short username kudu)
I20260923 17:18:06.105950 30297 webserver.cc:460] Webserver started at http://127.11.229.190:34399/ using document root <none> and password file <none>
I20260923 17:18:06.106635 30297 fs_manager.cc:359] Metadata directory not provided
I20260923 17:18:06.106726 30297 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:18:06.106951 30297 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:18:06.109629 30297 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "92d409ed223244b9bf293a07ce96f9ad"
format_stamp: "Formatted at 2026-09-23 17:18:06 on dist-test-slave-1x1f"
server_key: "7bb2c2ccadede8d47042de6fd0f5e496"
server_key_iv: "f721656501be05974f8c624748d97002"
server_key_version: "encryptionkey@0"
I20260923 17:18:06.110195 30297 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "92d409ed223244b9bf293a07ce96f9ad"
format_stamp: "Formatted at 2026-09-23 17:18:06 on dist-test-slave-1x1f"
server_key: "7bb2c2ccadede8d47042de6fd0f5e496"
server_key_iv: "f721656501be05974f8c624748d97002"
server_key_version: "encryptionkey@0"
I20260923 17:18:06.113998 30297 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260923 17:18:06.116617 30312 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:06.117973 30297 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 17:18:06.118142 30297 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "92d409ed223244b9bf293a07ce96f9ad"
format_stamp: "Formatted at 2026-09-23 17:18:06 on dist-test-slave-1x1f"
server_key: "7bb2c2ccadede8d47042de6fd0f5e496"
server_key_iv: "f721656501be05974f8c624748d97002"
server_key_version: "encryptionkey@0"
I20260923 17:18:06.118301 30297 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:18:06.131950 30297 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:18:06.135365 30297 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:18:06.135577 30297 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:18:06.142700 30297 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.190:42691
I20260923 17:18:06.142738 30364 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.190:42691 every 8 connection(s)
I20260923 17:18:06.143656 30297 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:18:06.146526 30365 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:18:06.151957 30365 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92d409ed223244b9bf293a07ce96f9ad: Bootstrap starting.
I20260923 17:18:06.152154 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 30297
I20260923 17:18:06.152300 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:18:06.152614 12182 external_mini_cluster.cc:1428] Setting key 5198e8e687c7c2fe5a68f445fadfcebc
I20260923 17:18:06.154883 30365 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 92d409ed223244b9bf293a07ce96f9ad: Neither blocks nor log segments found. Creating new log.
I20260923 17:18:06.155632 30365 log.cc:824] T 00000000000000000000000000000000 P 92d409ed223244b9bf293a07ce96f9ad: Log is configured to *not* fsync() on all Append() calls
I20260923 17:18:06.157930 30365 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92d409ed223244b9bf293a07ce96f9ad: No bootstrap required, opened a new log
Sep 23 17:18:06 dist-test-slave-1x1f krb5kdc[30284](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183885, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:18:06.162519 30365 raft_consensus.cc:348] T 00000000000000000000000000000000 P 92d409ed223244b9bf293a07ce96f9ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92d409ed223244b9bf293a07ce96f9ad" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 42691 } }
I20260923 17:18:06.162783 30365 raft_consensus.cc:374] T 00000000000000000000000000000000 P 92d409ed223244b9bf293a07ce96f9ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:18:06.162843 30365 raft_consensus.cc:729] T 00000000000000000000000000000000 P 92d409ed223244b9bf293a07ce96f9ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d409ed223244b9bf293a07ce96f9ad, State: Initialized, Role: FOLLOWER
I20260923 17:18:06.163321 30365 consensus_queue.cc:260] T 00000000000000000000000000000000 P 92d409ed223244b9bf293a07ce96f9ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92d409ed223244b9bf293a07ce96f9ad" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 42691 } }
I20260923 17:18:06.163486 30365 raft_consensus.cc:388] T 00000000000000000000000000000000 P 92d409ed223244b9bf293a07ce96f9ad [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:18:06.163573 30365 raft_consensus.cc:482] T 00000000000000000000000000000000 P 92d409ed223244b9bf293a07ce96f9ad [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:18:06.163681 30365 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 92d409ed223244b9bf293a07ce96f9ad [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:18:06.164597 30365 raft_consensus.cc:504] T 00000000000000000000000000000000 P 92d409ed223244b9bf293a07ce96f9ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92d409ed223244b9bf293a07ce96f9ad" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 42691 } }
I20260923 17:18:06.164980 30365 leader_election.cc:302] T 00000000000000000000000000000000 P 92d409ed223244b9bf293a07ce96f9ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 92d409ed223244b9bf293a07ce96f9ad; no voters:
I20260923 17:18:06.165324 30365 leader_election.cc:288] T 00000000000000000000000000000000 P 92d409ed223244b9bf293a07ce96f9ad [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 17:18:06.165417 30370 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 92d409ed223244b9bf293a07ce96f9ad [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:18:06.165648 30370 raft_consensus.cc:686] T 00000000000000000000000000000000 P 92d409ed223244b9bf293a07ce96f9ad [term 1 LEADER]: Becoming Leader. State: Replica: 92d409ed223244b9bf293a07ce96f9ad, State: Running, Role: LEADER
I20260923 17:18:06.165983 30370 consensus_queue.cc:237] T 00000000000000000000000000000000 P 92d409ed223244b9bf293a07ce96f9ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92d409ed223244b9bf293a07ce96f9ad" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 42691 } }
I20260923 17:18:06.166692 30365 sys_catalog.cc:564] T 00000000000000000000000000000000 P 92d409ed223244b9bf293a07ce96f9ad [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:18:06.168244 30368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:06.154263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52848 (local address 127.11.229.190:42691)
0923 17:18:06.154696 (+ 433us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:06.154711 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:06.154746 (+ 35us) server_negotiation.cc:407] Connection header received
0923 17:18:06.155469 (+ 723us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:06.155486 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:06.155858 (+ 372us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:06.156225 (+ 367us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:06.157156 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:06.158178 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:06.159340 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:06.159788 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:06.159903 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:06.162776 (+ 2873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:06.162783 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:06.162801 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:06.162836 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:06.164691 (+ 1855us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:06.165228 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:06.165234 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:06.165254 (+ 20us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:06.165407 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:06.165792 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:06.165795 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:06.165797 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:06.166324 (+ 527us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:06.166487 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:06.167082 (+ 595us) server_negotiation.cc:299] Negotiation successful
0923 17:18:06.167350 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":122,"threads_started":1}
I20260923 17:18:06.169018 30371 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92d409ed223244b9bf293a07ce96f9ad [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "92d409ed223244b9bf293a07ce96f9ad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92d409ed223244b9bf293a07ce96f9ad" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 42691 } } }
I20260923 17:18:06.169144 30371 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92d409ed223244b9bf293a07ce96f9ad [sys.catalog]: This master's current role is: LEADER
I20260923 17:18:06.169410 30372 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92d409ed223244b9bf293a07ce96f9ad [sys.catalog]: SysCatalogTable state changed. Reason: New leader 92d409ed223244b9bf293a07ce96f9ad. Latest consensus state: current_term: 1 leader_uuid: "92d409ed223244b9bf293a07ce96f9ad" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92d409ed223244b9bf293a07ce96f9ad" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 42691 } } }
I20260923 17:18:06.169493 30372 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92d409ed223244b9bf293a07ce96f9ad [sys.catalog]: This master's current role is: LEADER
W20260923 17:18:06.171617 30384 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 92d409ed223244b9bf293a07ce96f9ad: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 17:18:06.171680 30384 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 17:18:06.171754 30385 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:18:06.172427 30385 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:18:06.178692 30385 catalog_manager.cc:1347] Generated new cluster ID: 9180347103ea4329a126b21bb971d43b
I20260923 17:18:06.178789 30385 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:18:06.188886 30385 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:18:06.189863 30385 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:18:06.199622 30385 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 92d409ed223244b9bf293a07ce96f9ad: Generated new TSK 0
I20260923 17:18:06.200368 30385 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.229.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab.
Entry for principal kudu/127.11.229.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab.
I20260923 17:18:06.238781 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.129:0
--local_ip_for_outbound_sockets=127.11.229.129
--webserver_interface=127.11.229.129
--webserver_port=0
--tserver_master_addrs=127.11.229.190:42691
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab
--principal=kudu/127.11.229.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:39569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:18:06.391141 30391 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:18:06.391389 30391 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:18:06.391433 30391 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:18:06.395459 30391 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:18:06.395511 30391 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:18:06.395568 30391 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.129
I20260923 17:18:06.400653 30391 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:39569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab
--principal=kudu/127.11.229.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.229.129
--webserver_port=0
--tserver_master_addrs=127.11.229.190:42691
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30391
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.129
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:18:06.401623 30391 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:18:06.402628 30391 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:18:06.412335 30397 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:06.412350 30399 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:06.412335 30396 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:06.412595 30391 server_base.cc:1034] running on GCE node
I20260923 17:18:06.413043 30391 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:18:06.413658 30391 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:18:06.414835 30391 hybrid_clock.cc:648] HybridClock initialized: now 1790183886414807 us; error 49 us; skew 500 ppm
Sep 23 17:18:06 dist-test-slave-1x1f krb5kdc[30284](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183886, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:18:06.417554 30391 init.cc:377] Logged in from keytab as kudu/127.11.229.129@KRBTEST.COM (short username kudu)
I20260923 17:18:06.418473 30391 webserver.cc:460] Webserver started at http://127.11.229.129:38065/ using document root <none> and password file <none>
I20260923 17:18:06.418983 30391 fs_manager.cc:359] Metadata directory not provided
I20260923 17:18:06.419051 30391 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:18:06.419214 30391 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:18:06.421185 30391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-0/data/instance:
uuid: "eab8834731d84b77962a2329dcdb94d1"
format_stamp: "Formatted at 2026-09-23 17:18:06 on dist-test-slave-1x1f"
server_key: "0abc026379af296700e9ea8f830f89fc"
server_key_iv: "9dcd6d1271f17c6d205fe5b9664e1a7c"
server_key_version: "encryptionkey@0"
I20260923 17:18:06.421685 30391 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance:
uuid: "eab8834731d84b77962a2329dcdb94d1"
format_stamp: "Formatted at 2026-09-23 17:18:06 on dist-test-slave-1x1f"
server_key: "0abc026379af296700e9ea8f830f89fc"
server_key_iv: "9dcd6d1271f17c6d205fe5b9664e1a7c"
server_key_version: "encryptionkey@0"
I20260923 17:18:06.425453 30391 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260923 17:18:06.427923 30406 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:06.429181 30391 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260923 17:18:06.429296 30391 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-0/wal
uuid: "eab8834731d84b77962a2329dcdb94d1"
format_stamp: "Formatted at 2026-09-23 17:18:06 on dist-test-slave-1x1f"
server_key: "0abc026379af296700e9ea8f830f89fc"
server_key_iv: "9dcd6d1271f17c6d205fe5b9664e1a7c"
server_key_version: "encryptionkey@0"
I20260923 17:18:06.429399 30391 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:18:06.455078 30391 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:18:06.458900 30391 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:18:06.459133 30391 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:18:06.459830 30391 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:18:06.460736 30391 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:18:06.460786 30391 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:06.460856 30391 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:18:06.460892 30391 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:06.471264 30391 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.129:36383
I20260923 17:18:06.471324 30519 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.129:36383 every 8 connection(s)
I20260923 17:18:06.472234 30391 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
I20260923 17:18:06.476619 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 30391
I20260923 17:18:06.476770 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance
I20260923 17:18:06.477092 12182 external_mini_cluster.cc:1428] Setting key 209628495385034d2ac3c0a5a925a3d6
Sep 23 17:18:06 dist-test-slave-1x1f krb5kdc[30284](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183886, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.129@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.229.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.130@KRBTEST.COM" created.
I20260923 17:18:06.490319 30368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:06.474296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:56565 (local address 127.11.229.190:42691)
0923 17:18:06.474562 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:06.474567 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:06.475598 (+ 1031us) server_negotiation.cc:407] Connection header received
0923 17:18:06.477594 (+ 1996us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:06.477600 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:06.477676 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:06.477791 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:06.479343 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:06.479885 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:06.481557 (+ 1672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:06.482021 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:06.482148 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:06.485404 (+ 3256us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:06.485410 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:06.485415 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:06.485448 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:06.487297 (+ 1849us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:06.488072 (+ 775us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:06.488079 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:06.488081 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:06.488270 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:06.488899 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:06.488903 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:06.488904 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:06.489127 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:06.489271 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:06.489924 (+ 653us) server_negotiation.cc:299] Negotiation successful
0923 17:18:06.490076 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260923 17:18:06.491191 30522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:06.474603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:42691 (local address 127.11.229.129:56565)
0923 17:18:06.475258 (+ 655us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:06.475343 (+ 85us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:06.477175 (+ 1832us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:06.478009 (+ 834us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:06.478016 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:06.478483 (+ 467us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:18:06.479121 (+ 638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:06.479146 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:06.480020 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:06.480027 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:06.481389 (+ 1362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:06.481400 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:06.482491 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:06.482499 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:06.482671 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:06.483464 (+ 793us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:18:06.483483 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:18:06.485184 (+ 1701us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:18:06.487439 (+ 2255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:06.487444 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:06.487459 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:06.487764 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:06.488548 (+ 784us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:06.488551 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:06.488553 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:06.488729 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:06.489332 (+ 603us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:18:06.489338 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:18:06.489653 (+ 315us) client_negotiation.cc:769] Sending connection context
0923 17:18:06.489827 (+ 174us) client_negotiation.cc:240] Negotiation successful
0923 17:18:06.490276 (+ 449us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":138,"threads_started":1}
I20260923 17:18:06.493238 30520 heartbeater.cc:347] Connected to a master server at 127.11.229.190:42691
I20260923 17:18:06.493518 30520 heartbeater.cc:464] Registering TS with master...
I20260923 17:18:06.494024 30520 heartbeater.cc:511] Master 127.11.229.190:42691 requested a full tablet report, sending...
I20260923 17:18:06.495849 30329 ts_manager.cc:194] Registered new tserver with Master: eab8834731d84b77962a2329dcdb94d1 (127.11.229.129:36383)
I20260923 17:18:06.497527 30329 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.129@KRBTEST.COM'} at 127.11.229.129:56565
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab.
Entry for principal kudu/127.11.229.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab.
I20260923 17:18:06.509785 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.130:0
--local_ip_for_outbound_sockets=127.11.229.130
--webserver_interface=127.11.229.130
--webserver_port=0
--tserver_master_addrs=127.11.229.190:42691
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab
--principal=kudu/127.11.229.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:39569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:18:06.625069 30525 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:18:06.625360 30525 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:18:06.625406 30525 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:18:06.629766 30525 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:18:06.629860 30525 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:18:06.629925 30525 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.130
I20260923 17:18:06.635763 30525 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:39569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab
--principal=kudu/127.11.229.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.229.130
--webserver_port=0
--tserver_master_addrs=127.11.229.190:42691
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30525
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.130
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:18:06.636849 30525 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:18:06.637825 30525 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260923 17:18:06.647835 30525 server_base.cc:1034] running on GCE node
W20260923 17:18:06.647874 30530 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:06.647903 30533 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:06.647940 30531 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:06.648684 30525 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:18:06.649343 30525 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:18:06.650660 30525 hybrid_clock.cc:648] HybridClock initialized: now 1790183886650628 us; error 61 us; skew 500 ppm
Sep 23 17:18:06 dist-test-slave-1x1f krb5kdc[30284](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183886, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:18:06.653733 30525 init.cc:377] Logged in from keytab as kudu/127.11.229.130@KRBTEST.COM (short username kudu)
I20260923 17:18:06.654718 30525 webserver.cc:460] Webserver started at http://127.11.229.130:34065/ using document root <none> and password file <none>
I20260923 17:18:06.655274 30525 fs_manager.cc:359] Metadata directory not provided
I20260923 17:18:06.655336 30525 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:18:06.655553 30525 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:18:06.657642 30525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-1/data/instance:
uuid: "a224dcffe6424296ad818bfdf6858cc2"
format_stamp: "Formatted at 2026-09-23 17:18:06 on dist-test-slave-1x1f"
server_key: "a94d7778e0a695ea70e612d98647b8b1"
server_key_iv: "ac93c0d93205a92cb83dd2b5548204ba"
server_key_version: "encryptionkey@0"
I20260923 17:18:06.658180 30525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance:
uuid: "a224dcffe6424296ad818bfdf6858cc2"
format_stamp: "Formatted at 2026-09-23 17:18:06 on dist-test-slave-1x1f"
server_key: "a94d7778e0a695ea70e612d98647b8b1"
server_key_iv: "ac93c0d93205a92cb83dd2b5548204ba"
server_key_version: "encryptionkey@0"
I20260923 17:18:06.662014 30525 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260923 17:18:06.664644 30540 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:06.666087 30525 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 17:18:06.666232 30525 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-1/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-1/wal
uuid: "a224dcffe6424296ad818bfdf6858cc2"
format_stamp: "Formatted at 2026-09-23 17:18:06 on dist-test-slave-1x1f"
server_key: "a94d7778e0a695ea70e612d98647b8b1"
server_key_iv: "ac93c0d93205a92cb83dd2b5548204ba"
server_key_version: "encryptionkey@0"
I20260923 17:18:06.666375 30525 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:18:06.683917 30525 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:18:06.687348 30525 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:18:06.687552 30525 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:18:06.688155 30525 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:18:06.688982 30525 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:18:06.689050 30525 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:06.689116 30525 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:18:06.689162 30525 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:06.698421 30525 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.130:33605
I20260923 17:18:06.698482 30653 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.130:33605 every 8 connection(s)
I20260923 17:18:06.699410 30525 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
I20260923 17:18:06.706542 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 30525
I20260923 17:18:06.706655 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance
I20260923 17:18:06.706983 12182 external_mini_cluster.cc:1428] Setting key 83675d52ca8cbfc05acc38f3ac6d929b
Sep 23 17:18:06 dist-test-slave-1x1f krb5kdc[30284](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183886, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.130@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:18:06.714980 30368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:06.701285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:50461 (local address 127.11.229.190:42691)
0923 17:18:06.701426 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:06.701429 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:06.702781 (+ 1352us) server_negotiation.cc:407] Connection header received
0923 17:18:06.704489 (+ 1708us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:06.704492 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:06.704544 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:06.704633 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:06.705936 (+ 1303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:06.706577 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:06.708128 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:06.708354 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:06.708463 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:06.711064 (+ 2601us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:06.711067 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:06.711069 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:06.711093 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:06.712557 (+ 1464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:06.713208 (+ 651us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:06.713212 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:06.713213 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:06.713295 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:06.713744 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:06.713746 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:06.713747 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:06.713939 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:06.714015 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:06.714744 (+ 729us) server_negotiation.cc:299] Negotiation successful
0923 17:18:06.714854 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260923 17:18:06.716207 30656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:06.701691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:42691 (local address 127.11.229.130:50461)
0923 17:18:06.702531 (+ 840us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:06.702606 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:06.704245 (+ 1639us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:06.704834 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:06.704842 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:06.705284 (+ 442us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:18:06.705784 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:06.705797 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:06.706751 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:06.706755 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:06.707991 (+ 1236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:06.708001 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:06.708502 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:06.708506 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:06.708680 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:06.709357 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:18:06.709374 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:18:06.710877 (+ 1503us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:18:06.712681 (+ 1804us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:06.712690 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:06.712710 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:06.713096 (+ 386us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:06.713392 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:06.713397 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:06.713400 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:06.713599 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:06.714043 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:18:06.714051 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:18:06.714423 (+ 372us) client_negotiation.cc:769] Sending connection context
0923 17:18:06.714658 (+ 235us) client_negotiation.cc:240] Negotiation successful
0923 17:18:06.715051 (+ 393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":126,"threads_started":1}
WARNING: no policy specified for kudu/127.11.229.131@KRBTEST.COM; defaulting to no policy
I20260923 17:18:06.717666 30654 heartbeater.cc:347] Connected to a master server at 127.11.229.190:42691
I20260923 17:18:06.717943 30654 heartbeater.cc:464] Registering TS with master...
I20260923 17:18:06.718566 30654 heartbeater.cc:511] Master 127.11.229.190:42691 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.131@KRBTEST.COM" created.
I20260923 17:18:06.719791 30329 ts_manager.cc:194] Registered new tserver with Master: a224dcffe6424296ad818bfdf6858cc2 (127.11.229.130:33605)
I20260923 17:18:06.720407 30329 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.130@KRBTEST.COM'} at 127.11.229.130:50461
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab.
Entry for principal kudu/127.11.229.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab.
I20260923 17:18:06.739131 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.131:0
--local_ip_for_outbound_sockets=127.11.229.131
--webserver_interface=127.11.229.131
--webserver_port=0
--tserver_master_addrs=127.11.229.190:42691
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab
--principal=kudu/127.11.229.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:39569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:18:06.858807 30659 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:18:06.859073 30659 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:18:06.859127 30659 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:18:06.863142 30659 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:18:06.863202 30659 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:18:06.863261 30659 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.131
I20260923 17:18:06.868794 30659 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:39569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab
--principal=kudu/127.11.229.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.229.131
--webserver_port=0
--tserver_master_addrs=127.11.229.190:42691
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30659
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.131
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:18:06.869860 30659 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:18:06.870887 30659 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:18:06.881181 30667 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:06.881363 30659 server_base.cc:1034] running on GCE node
W20260923 17:18:06.881181 30664 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:06.881578 30665 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:06.882037 30659 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:18:06.882721 30659 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:18:06.883909 30659 hybrid_clock.cc:648] HybridClock initialized: now 1790183886883872 us; error 50 us; skew 500 ppm
Sep 23 17:18:06 dist-test-slave-1x1f krb5kdc[30284](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183886, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:18:06.886979 30659 init.cc:377] Logged in from keytab as kudu/127.11.229.131@KRBTEST.COM (short username kudu)
I20260923 17:18:06.887974 30659 webserver.cc:460] Webserver started at http://127.11.229.131:42671/ using document root <none> and password file <none>
I20260923 17:18:06.888618 30659 fs_manager.cc:359] Metadata directory not provided
I20260923 17:18:06.888712 30659 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:18:06.888885 30659 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:18:06.890995 30659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-2/data/instance:
uuid: "bfe0b36938514104bdaf1a7791061400"
format_stamp: "Formatted at 2026-09-23 17:18:06 on dist-test-slave-1x1f"
server_key: "9be88753ca437644c9e71f0611ae3397"
server_key_iv: "214445779643a150da43476fb3f374fd"
server_key_version: "encryptionkey@0"
I20260923 17:18:06.891497 30659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance:
uuid: "bfe0b36938514104bdaf1a7791061400"
format_stamp: "Formatted at 2026-09-23 17:18:06 on dist-test-slave-1x1f"
server_key: "9be88753ca437644c9e71f0611ae3397"
server_key_iv: "214445779643a150da43476fb3f374fd"
server_key_version: "encryptionkey@0"
I20260923 17:18:06.895328 30659 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260923 17:18:06.897924 30674 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:06.899261 30659 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 17:18:06.899363 30659 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-2/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-2/wal
uuid: "bfe0b36938514104bdaf1a7791061400"
format_stamp: "Formatted at 2026-09-23 17:18:06 on dist-test-slave-1x1f"
server_key: "9be88753ca437644c9e71f0611ae3397"
server_key_iv: "214445779643a150da43476fb3f374fd"
server_key_version: "encryptionkey@0"
I20260923 17:18:06.899452 30659 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:18:06.917855 30659 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:18:06.921311 30659 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:18:06.921481 30659 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:18:06.922076 30659 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:18:06.922988 30659 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:18:06.923051 30659 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:06.923094 30659 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:18:06.923110 30659 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:06.932247 30659 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.131:33637
I20260923 17:18:06.932296 30787 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.131:33637 every 8 connection(s)
I20260923 17:18:06.933303 30659 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
I20260923 17:18:06.936582 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 30659
I20260923 17:18:06.936728 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance
I20260923 17:18:06.937099 12182 external_mini_cluster.cc:1428] Setting key b1c2ad79e0695c6ee3cd352c3b8419bd
Sep 23 17:18:06 dist-test-slave-1x1f krb5kdc[30284](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183886, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.131@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:18:06.949949 30368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:06.935517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:58153 (local address 127.11.229.190:42691)
0923 17:18:06.935667 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:06.935672 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:06.938067 (+ 2395us) server_negotiation.cc:407] Connection header received
0923 17:18:06.939495 (+ 1428us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:06.939499 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:06.939557 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:06.939630 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:06.940731 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:06.941294 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:06.942506 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:06.942759 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:06.942847 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:06.946014 (+ 3167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:06.946018 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:06.946020 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:06.946046 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:06.947747 (+ 1701us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:06.948320 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:06.948324 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:06.948325 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:06.948408 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:06.948730 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:06.948732 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:06.948733 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:06.948913 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:06.948991 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:06.949628 (+ 637us) server_negotiation.cc:299] Negotiation successful
0923 17:18:06.949759 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260923 17:18:06.950958 30790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:06.936049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:42691 (local address 127.11.229.131:58153)
0923 17:18:06.937768 (+ 1719us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:06.937828 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:06.939311 (+ 1483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:06.939771 (+ 460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:06.939777 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:06.940122 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:18:06.940610 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:06.940623 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:06.941414 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:06.941417 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:06.942395 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:06.942406 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:06.942897 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:06.942900 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:06.943080 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:06.943827 (+ 747us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:18:06.943870 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:18:06.945842 (+ 1972us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:18:06.947870 (+ 2028us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:06.947876 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:06.947890 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:06.948164 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:06.948508 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:06.948510 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:06.948511 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:06.948649 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:06.949043 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:18:06.949049 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:18:06.949324 (+ 275us) client_negotiation.cc:769] Sending connection context
0923 17:18:06.949499 (+ 175us) client_negotiation.cc:240] Negotiation successful
0923 17:18:06.949782 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1476,"thread_start_us":171,"threads_started":1}
I20260923 17:18:06.952025 30788 heartbeater.cc:347] Connected to a master server at 127.11.229.190:42691
I20260923 17:18:06.952281 30788 heartbeater.cc:464] Registering TS with master...
I20260923 17:18:06.952805 30788 heartbeater.cc:511] Master 127.11.229.190:42691 requested a full tablet report, sending...
I20260923 17:18:06.953841 30329 ts_manager.cc:194] Registered new tserver with Master: bfe0b36938514104bdaf1a7791061400 (127.11.229.131:33637)
I20260923 17:18:06.954445 30329 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.131@KRBTEST.COM'} at 127.11.229.131:58153
I20260923 17:18:06.963605 12182 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 17:18:06.973985 30368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:06.965617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52852 (local address 127.11.229.190:42691)
0923 17:18:06.965756 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:06.965759 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:06.965918 (+ 159us) server_negotiation.cc:407] Connection header received
0923 17:18:06.966022 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:06.966025 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:06.966065 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:06.966134 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:06.966960 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:06.967757 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:06.968659 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:06.968898 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:06.968985 (+ 87us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:06.970830 (+ 1845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:06.970833 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:06.970835 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:06.970858 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:06.972334 (+ 1476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:06.972876 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:06.972879 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:06.972880 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:06.972957 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:06.973234 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:06.973237 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:06.973238 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:06.973436 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:06.973549 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:06.973778 (+ 229us) server_negotiation.cc:299] Negotiation successful
0923 17:18:06.973859 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260923 17:18:06.977083 30329 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52852:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 17:18:06.980723 30329 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 17:18:06.995723 30799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:06.989635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:36383 (local address 127.0.0.1:39604)
0923 17:18:06.989977 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:06.990023 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:06.990369 (+ 346us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:06.991305 (+ 936us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:06.991310 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:06.991333 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:18:06.991475 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:06.991485 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:06.992737 (+ 1252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:06.992740 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:06.993983 (+ 1243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:06.993993 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:06.995160 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:06.995163 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:06.995271 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:06.995307 (+ 36us) client_negotiation.cc:769] Sending connection context
0923 17:18:06.995437 (+ 130us) client_negotiation.cc:240] Negotiation successful
0923 17:18:06.995568 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":106,"threads_started":1}
I20260923 17:18:06.995736 30802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:06.990459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39604 (local address 127.11.229.129:36383)
0923 17:18:06.990783 (+ 324us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:06.990799 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:06.990823 (+ 24us) server_negotiation.cc:407] Connection header received
0923 17:18:06.990899 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:06.990904 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:06.991136 (+ 232us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:06.991296 (+ 160us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:18:06.991607 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:06.992618 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:06.994115 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:06.995033 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:06.995165 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:06.995302 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:06.995467 (+ 165us) server_negotiation.cc:299] Negotiation successful
0923 17:18:06.995576 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":227,"thread_start_us":125,"threads_started":1}
I20260923 17:18:06.996454 30800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:06.989929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.131:33637 (local address 127.0.0.1:36956)
0923 17:18:06.990846 (+ 917us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:06.990857 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:06.990925 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:06.992114 (+ 1189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:06.992117 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:06.992134 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:18:06.992223 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:06.992229 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:06.993497 (+ 1268us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:06.993502 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:06.994889 (+ 1387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:06.994899 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:06.996050 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:06.996053 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:06.996152 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:06.996175 (+ 23us) client_negotiation.cc:769] Sending connection context
0923 17:18:06.996252 (+ 77us) client_negotiation.cc:240] Negotiation successful
0923 17:18:06.996324 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":860,"thread_start_us":68,"threads_started":1}
I20260923 17:18:06.996492 30803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:06.990474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36956 (local address 127.11.229.131:33637)
0923 17:18:06.991700 (+ 1226us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:06.991711 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:06.991732 (+ 21us) server_negotiation.cc:407] Connection header received
0923 17:18:06.991807 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:06.991814 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:06.991984 (+ 170us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:06.992132 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:18:06.992333 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:06.993380 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:06.995020 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:06.995872 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:06.996042 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:06.996151 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:06.996274 (+ 123us) server_negotiation.cc:299] Negotiation successful
0923 17:18:06.996357 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1127,"thread_start_us":177,"threads_started":1}
I20260923 17:18:06.996492 30804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:06.990885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53224 (local address 127.11.229.130:33605)
0923 17:18:06.991144 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:06.991152 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:06.991168 (+ 16us) server_negotiation.cc:407] Connection header received
0923 17:18:06.991253 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:06.991261 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:06.991429 (+ 168us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:06.991573 (+ 144us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:18:06.991927 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:06.993106 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:06.994600 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:06.995438 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:06.995556 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:06.995670 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:06.996253 (+ 583us) server_negotiation.cc:299] Negotiation successful
0923 17:18:06.996358 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":95,"threads_started":1}
I20260923 17:18:06.996157 30801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:06.989685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.130:33605 (local address 127.0.0.1:53224)
0923 17:18:06.990637 (+ 952us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:06.990651 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:06.990739 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:06.991732 (+ 993us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:06.991735 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:06.991752 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:18:06.991829 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:06.991834 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:06.993259 (+ 1425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:06.993263 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:06.994441 (+ 1178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:06.994450 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:06.995736 (+ 1286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:06.995740 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:06.995828 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:06.995854 (+ 26us) client_negotiation.cc:769] Sending connection context
0923 17:18:06.995934 (+ 80us) client_negotiation.cc:240] Negotiation successful
0923 17:18:06.996020 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":893,"thread_start_us":119,"threads_started":1}
I20260923 17:18:06.999622 30454 tablet_service.cc:1467] Processing CreateTablet for tablet ec5e36fc7e2c4c9497c7628378355e91 (DEFAULT_TABLE table=test-table [id=b8b264a037fb48ceac247067d6a1c43b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:18:07.000175 30588 tablet_service.cc:1467] Processing CreateTablet for tablet ec5e36fc7e2c4c9497c7628378355e91 (DEFAULT_TABLE table=test-table [id=b8b264a037fb48ceac247067d6a1c43b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:18:07.000841 30454 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec5e36fc7e2c4c9497c7628378355e91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:18:07.001149 30588 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec5e36fc7e2c4c9497c7628378355e91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:18:07.005326 30722 tablet_service.cc:1467] Processing CreateTablet for tablet ec5e36fc7e2c4c9497c7628378355e91 (DEFAULT_TABLE table=test-table [id=b8b264a037fb48ceac247067d6a1c43b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:18:07.006424 30722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ec5e36fc7e2c4c9497c7628378355e91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:18:07.008533 30805 tablet_bootstrap.cc:492] T ec5e36fc7e2c4c9497c7628378355e91 P eab8834731d84b77962a2329dcdb94d1: Bootstrap starting.
I20260923 17:18:07.010885 30805 tablet_bootstrap.cc:654] T ec5e36fc7e2c4c9497c7628378355e91 P eab8834731d84b77962a2329dcdb94d1: Neither blocks nor log segments found. Creating new log.
I20260923 17:18:07.010886 30806 tablet_bootstrap.cc:492] T ec5e36fc7e2c4c9497c7628378355e91 P a224dcffe6424296ad818bfdf6858cc2: Bootstrap starting.
I20260923 17:18:07.011746 30805 log.cc:824] T ec5e36fc7e2c4c9497c7628378355e91 P eab8834731d84b77962a2329dcdb94d1: Log is configured to *not* fsync() on all Append() calls
I20260923 17:18:07.013038 30806 tablet_bootstrap.cc:654] T ec5e36fc7e2c4c9497c7628378355e91 P a224dcffe6424296ad818bfdf6858cc2: Neither blocks nor log segments found. Creating new log.
I20260923 17:18:07.013195 30808 tablet_bootstrap.cc:492] T ec5e36fc7e2c4c9497c7628378355e91 P bfe0b36938514104bdaf1a7791061400: Bootstrap starting.
I20260923 17:18:07.014138 30805 tablet_bootstrap.cc:492] T ec5e36fc7e2c4c9497c7628378355e91 P eab8834731d84b77962a2329dcdb94d1: No bootstrap required, opened a new log
I20260923 17:18:07.014189 30806 log.cc:824] T ec5e36fc7e2c4c9497c7628378355e91 P a224dcffe6424296ad818bfdf6858cc2: Log is configured to *not* fsync() on all Append() calls
I20260923 17:18:07.014360 30805 ts_tablet_manager.cc:1397] T ec5e36fc7e2c4c9497c7628378355e91 P eab8834731d84b77962a2329dcdb94d1: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260923 17:18:07.015470 30808 tablet_bootstrap.cc:654] T ec5e36fc7e2c4c9497c7628378355e91 P bfe0b36938514104bdaf1a7791061400: Neither blocks nor log segments found. Creating new log.
I20260923 17:18:07.015866 30806 tablet_bootstrap.cc:492] T ec5e36fc7e2c4c9497c7628378355e91 P a224dcffe6424296ad818bfdf6858cc2: No bootstrap required, opened a new log
I20260923 17:18:07.016059 30806 ts_tablet_manager.cc:1397] T ec5e36fc7e2c4c9497c7628378355e91 P a224dcffe6424296ad818bfdf6858cc2: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260923 17:18:07.016754 30808 log.cc:824] T ec5e36fc7e2c4c9497c7628378355e91 P bfe0b36938514104bdaf1a7791061400: Log is configured to *not* fsync() on all Append() calls
I20260923 17:18:07.018682 30808 tablet_bootstrap.cc:492] T ec5e36fc7e2c4c9497c7628378355e91 P bfe0b36938514104bdaf1a7791061400: No bootstrap required, opened a new log
I20260923 17:18:07.019073 30808 ts_tablet_manager.cc:1397] T ec5e36fc7e2c4c9497c7628378355e91 P bfe0b36938514104bdaf1a7791061400: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.004s
I20260923 17:18:07.018858 30805 raft_consensus.cc:348] T ec5e36fc7e2c4c9497c7628378355e91 P eab8834731d84b77962a2329dcdb94d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eab8834731d84b77962a2329dcdb94d1" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 36383 } } peers { permanent_uuid: "a224dcffe6424296ad818bfdf6858cc2" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 33605 } } peers { permanent_uuid: "bfe0b36938514104bdaf1a7791061400" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 33637 } }
I20260923 17:18:07.019147 30805 raft_consensus.cc:374] T ec5e36fc7e2c4c9497c7628378355e91 P eab8834731d84b77962a2329dcdb94d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:18:07.019194 30805 raft_consensus.cc:729] T ec5e36fc7e2c4c9497c7628378355e91 P eab8834731d84b77962a2329dcdb94d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eab8834731d84b77962a2329dcdb94d1, State: Initialized, Role: FOLLOWER
I20260923 17:18:07.019490 30806 raft_consensus.cc:348] T ec5e36fc7e2c4c9497c7628378355e91 P a224dcffe6424296ad818bfdf6858cc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eab8834731d84b77962a2329dcdb94d1" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 36383 } } peers { permanent_uuid: "a224dcffe6424296ad818bfdf6858cc2" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 33605 } } peers { permanent_uuid: "bfe0b36938514104bdaf1a7791061400" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 33637 } }
I20260923 17:18:07.019650 30805 consensus_queue.cc:260] T ec5e36fc7e2c4c9497c7628378355e91 P eab8834731d84b77962a2329dcdb94d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eab8834731d84b77962a2329dcdb94d1" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 36383 } } peers { permanent_uuid: "a224dcffe6424296ad818bfdf6858cc2" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 33605 } } peers { permanent_uuid: "bfe0b36938514104bdaf1a7791061400" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 33637 } }
I20260923 17:18:07.019726 30806 raft_consensus.cc:374] T ec5e36fc7e2c4c9497c7628378355e91 P a224dcffe6424296ad818bfdf6858cc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:18:07.019776 30806 raft_consensus.cc:729] T ec5e36fc7e2c4c9497c7628378355e91 P a224dcffe6424296ad818bfdf6858cc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a224dcffe6424296ad818bfdf6858cc2, State: Initialized, Role: FOLLOWER
I20260923 17:18:07.020221 30806 consensus_queue.cc:260] T ec5e36fc7e2c4c9497c7628378355e91 P a224dcffe6424296ad818bfdf6858cc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eab8834731d84b77962a2329dcdb94d1" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 36383 } } peers { permanent_uuid: "a224dcffe6424296ad818bfdf6858cc2" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 33605 } } peers { permanent_uuid: "bfe0b36938514104bdaf1a7791061400" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 33637 } }
I20260923 17:18:07.020627 30805 ts_tablet_manager.cc:1428] T ec5e36fc7e2c4c9497c7628378355e91 P eab8834731d84b77962a2329dcdb94d1: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260923 17:18:07.020955 30654 heartbeater.cc:503] Master 127.11.229.190:42691 was elected leader, sending a full tablet report...
I20260923 17:18:07.021166 30806 ts_tablet_manager.cc:1428] T ec5e36fc7e2c4c9497c7628378355e91 P a224dcffe6424296ad818bfdf6858cc2: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260923 17:18:07.022042 30520 heartbeater.cc:503] Master 127.11.229.190:42691 was elected leader, sending a full tablet report...
I20260923 17:18:07.022879 30808 raft_consensus.cc:348] T ec5e36fc7e2c4c9497c7628378355e91 P bfe0b36938514104bdaf1a7791061400 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eab8834731d84b77962a2329dcdb94d1" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 36383 } } peers { permanent_uuid: "a224dcffe6424296ad818bfdf6858cc2" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 33605 } } peers { permanent_uuid: "bfe0b36938514104bdaf1a7791061400" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 33637 } }
I20260923 17:18:07.023162 30808 raft_consensus.cc:374] T ec5e36fc7e2c4c9497c7628378355e91 P bfe0b36938514104bdaf1a7791061400 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:18:07.023229 30808 raft_consensus.cc:729] T ec5e36fc7e2c4c9497c7628378355e91 P bfe0b36938514104bdaf1a7791061400 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bfe0b36938514104bdaf1a7791061400, State: Initialized, Role: FOLLOWER
I20260923 17:18:07.023666 30808 consensus_queue.cc:260] T ec5e36fc7e2c4c9497c7628378355e91 P bfe0b36938514104bdaf1a7791061400 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eab8834731d84b77962a2329dcdb94d1" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 36383 } } peers { permanent_uuid: "a224dcffe6424296ad818bfdf6858cc2" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 33605 } } peers { permanent_uuid: "bfe0b36938514104bdaf1a7791061400" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 33637 } }
I20260923 17:18:07.024330 30788 heartbeater.cc:503] Master 127.11.229.190:42691 was elected leader, sending a full tablet report...
I20260923 17:18:07.024626 30808 ts_tablet_manager.cc:1428] T ec5e36fc7e2c4c9497c7628378355e91 P bfe0b36938514104bdaf1a7791061400: Time spent starting tablet: real 0.005s user 0.002s sys 0.003s
I20260923 17:18:07.087244 30811 raft_consensus.cc:482] T ec5e36fc7e2c4c9497c7628378355e91 P eab8834731d84b77962a2329dcdb94d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 17:18:07.087504 30811 raft_consensus.cc:504] T ec5e36fc7e2c4c9497c7628378355e91 P eab8834731d84b77962a2329dcdb94d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eab8834731d84b77962a2329dcdb94d1" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 36383 } } peers { permanent_uuid: "a224dcffe6424296ad818bfdf6858cc2" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 33605 } } peers { permanent_uuid: "bfe0b36938514104bdaf1a7791061400" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 33637 } }
I20260923 17:18:07.088856 30811 leader_election.cc:288] T ec5e36fc7e2c4c9497c7628378355e91 P eab8834731d84b77962a2329dcdb94d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a224dcffe6424296ad818bfdf6858cc2 (127.11.229.130:33605), bfe0b36938514104bdaf1a7791061400 (127.11.229.131:33637)
I20260923 17:18:07.092885 30803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:07.089190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:55859 (local address 127.11.229.131:33637)
0923 17:18:07.089402 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:07.089407 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:07.089548 (+ 141us) server_negotiation.cc:407] Connection header received
0923 17:18:07.089670 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:07.089673 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:07.089733 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:07.089810 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:18:07.090118 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:07.090695 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:07.091943 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:07.092335 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:07.092458 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:07.092512 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:07.092682 (+ 170us) server_negotiation.cc:299] Negotiation successful
0923 17:18:07.092758 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129}
I20260923 17:18:07.092917 30815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:07.089083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.131:33637 (local address 127.11.229.129:55859)
0923 17:18:07.089462 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:07.089473 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:07.089583 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:07.089835 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:07.089838 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:07.089855 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:18:07.090007 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:07.090015 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:07.090815 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:07.090818 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:07.091797 (+ 979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:07.091812 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:07.092457 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:07.092461 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:07.092553 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:07.092581 (+ 28us) client_negotiation.cc:769] Sending connection context
0923 17:18:07.092647 (+ 66us) client_negotiation.cc:240] Negotiation successful
0923 17:18:07.092735 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":323,"mutex_wait_us":26,"thread_start_us":144,"threads_started":1}
I20260923 17:18:07.092952 30804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:07.089175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:51581 (local address 127.11.229.130:33605)
0923 17:18:07.089308 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:07.089313 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:07.089705 (+ 392us) server_negotiation.cc:407] Connection header received
0923 17:18:07.089836 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:07.089839 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:07.089890 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:07.089972 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:18:07.090316 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:07.090829 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:07.091895 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:07.092347 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:07.092486 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:07.092539 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:07.092743 (+ 204us) server_negotiation.cc:299] Negotiation successful
0923 17:18:07.092819 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260923 17:18:07.092928 30814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:07.089083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.130:33605 (local address 127.11.229.129:51581)
0923 17:18:07.089594 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:07.089607 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:07.089713 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:07.089995 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:07.089997 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:07.090010 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:18:07.090136 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:07.090143 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:07.090952 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:07.090955 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:07.091787 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:07.091796 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:07.092495 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:07.092498 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:07.092601 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:07.092625 (+ 24us) client_negotiation.cc:769] Sending connection context
0923 17:18:07.092724 (+ 99us) client_negotiation.cc:240] Negotiation successful
0923 17:18:07.092786 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":422,"mutex_wait_us":64,"thread_start_us":112,"threads_started":1}
I20260923 17:18:07.093569 30742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec5e36fc7e2c4c9497c7628378355e91" candidate_uuid: "eab8834731d84b77962a2329dcdb94d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfe0b36938514104bdaf1a7791061400" is_pre_election: true
I20260923 17:18:07.093568 30608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec5e36fc7e2c4c9497c7628378355e91" candidate_uuid: "eab8834731d84b77962a2329dcdb94d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a224dcffe6424296ad818bfdf6858cc2" is_pre_election: true
I20260923 17:18:07.093886 30742 raft_consensus.cc:2454] T ec5e36fc7e2c4c9497c7628378355e91 P bfe0b36938514104bdaf1a7791061400 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eab8834731d84b77962a2329dcdb94d1 in term 0.
I20260923 17:18:07.093886 30608 raft_consensus.cc:2454] T ec5e36fc7e2c4c9497c7628378355e91 P a224dcffe6424296ad818bfdf6858cc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eab8834731d84b77962a2329dcdb94d1 in term 0.
I20260923 17:18:07.094422 30410 leader_election.cc:302] T ec5e36fc7e2c4c9497c7628378355e91 P eab8834731d84b77962a2329dcdb94d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a224dcffe6424296ad818bfdf6858cc2, eab8834731d84b77962a2329dcdb94d1; no voters:
I20260923 17:18:07.094686 30811 raft_consensus.cc:2781] T ec5e36fc7e2c4c9497c7628378355e91 P eab8834731d84b77962a2329dcdb94d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 17:18:07.094769 30811 raft_consensus.cc:482] T ec5e36fc7e2c4c9497c7628378355e91 P eab8834731d84b77962a2329dcdb94d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 17:18:07.094813 30811 raft_consensus.cc:3037] T ec5e36fc7e2c4c9497c7628378355e91 P eab8834731d84b77962a2329dcdb94d1 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:18:07.095832 30811 raft_consensus.cc:504] T ec5e36fc7e2c4c9497c7628378355e91 P eab8834731d84b77962a2329dcdb94d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eab8834731d84b77962a2329dcdb94d1" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 36383 } } peers { permanent_uuid: "a224dcffe6424296ad818bfdf6858cc2" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 33605 } } peers { permanent_uuid: "bfe0b36938514104bdaf1a7791061400" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 33637 } }
I20260923 17:18:07.096226 30811 leader_election.cc:288] T ec5e36fc7e2c4c9497c7628378355e91 P eab8834731d84b77962a2329dcdb94d1 [CANDIDATE]: Term 1 election: Requested vote from peers a224dcffe6424296ad818bfdf6858cc2 (127.11.229.130:33605), bfe0b36938514104bdaf1a7791061400 (127.11.229.131:33637)
I20260923 17:18:07.096486 30608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec5e36fc7e2c4c9497c7628378355e91" candidate_uuid: "eab8834731d84b77962a2329dcdb94d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a224dcffe6424296ad818bfdf6858cc2"
I20260923 17:18:07.096571 30742 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec5e36fc7e2c4c9497c7628378355e91" candidate_uuid: "eab8834731d84b77962a2329dcdb94d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bfe0b36938514104bdaf1a7791061400"
I20260923 17:18:07.096642 30608 raft_consensus.cc:3037] T ec5e36fc7e2c4c9497c7628378355e91 P a224dcffe6424296ad818bfdf6858cc2 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:18:07.096709 30742 raft_consensus.cc:3037] T ec5e36fc7e2c4c9497c7628378355e91 P bfe0b36938514104bdaf1a7791061400 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:18:07.097723 30742 raft_consensus.cc:2454] T ec5e36fc7e2c4c9497c7628378355e91 P bfe0b36938514104bdaf1a7791061400 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eab8834731d84b77962a2329dcdb94d1 in term 1.
I20260923 17:18:07.097738 30608 raft_consensus.cc:2454] T ec5e36fc7e2c4c9497c7628378355e91 P a224dcffe6424296ad818bfdf6858cc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eab8834731d84b77962a2329dcdb94d1 in term 1.
I20260923 17:18:07.098022 30409 leader_election.cc:302] T ec5e36fc7e2c4c9497c7628378355e91 P eab8834731d84b77962a2329dcdb94d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bfe0b36938514104bdaf1a7791061400, eab8834731d84b77962a2329dcdb94d1; no voters:
I20260923 17:18:07.098206 30811 raft_consensus.cc:2781] T ec5e36fc7e2c4c9497c7628378355e91 P eab8834731d84b77962a2329dcdb94d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:18:07.098472 30811 raft_consensus.cc:686] T ec5e36fc7e2c4c9497c7628378355e91 P eab8834731d84b77962a2329dcdb94d1 [term 1 LEADER]: Becoming Leader. State: Replica: eab8834731d84b77962a2329dcdb94d1, State: Running, Role: LEADER
I20260923 17:18:07.098817 30811 consensus_queue.cc:237] T ec5e36fc7e2c4c9497c7628378355e91 P eab8834731d84b77962a2329dcdb94d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eab8834731d84b77962a2329dcdb94d1" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 36383 } } peers { permanent_uuid: "a224dcffe6424296ad818bfdf6858cc2" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 33605 } } peers { permanent_uuid: "bfe0b36938514104bdaf1a7791061400" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 33637 } }
I20260923 17:18:07.101948 30327 catalog_manager.cc:5495] T ec5e36fc7e2c4c9497c7628378355e91 P eab8834731d84b77962a2329dcdb94d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to eab8834731d84b77962a2329dcdb94d1 (127.11.229.129). New cstate: current_term: 1 leader_uuid: "eab8834731d84b77962a2329dcdb94d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eab8834731d84b77962a2329dcdb94d1" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a224dcffe6424296ad818bfdf6858cc2" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 33605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bfe0b36938514104bdaf1a7791061400" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 33637 } health_report { overall_health: UNKNOWN } } }
I20260923 17:18:07.121225 30802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:07.117450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39612 (local address 127.11.229.129:36383)
0923 17:18:07.117575 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:07.117579 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:07.117592 (+ 13us) server_negotiation.cc:407] Connection header received
0923 17:18:07.117722 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:07.117724 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:07.117777 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:07.117863 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 17:18:07.118174 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:07.118784 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:07.119647 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:07.119861 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:07.119944 (+ 83us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:07.120199 (+ 255us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 17:18:07.120756 (+ 557us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 17:18:07.120931 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:07.121011 (+ 80us) server_negotiation.cc:299] Negotiation successful
0923 17:18:07.121048 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260923 17:18:07.127140 30742 raft_consensus.cc:1261] T ec5e36fc7e2c4c9497c7628378355e91 P bfe0b36938514104bdaf1a7791061400 [term 1 FOLLOWER]: Refusing update from remote peer eab8834731d84b77962a2329dcdb94d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:18:07.127140 30608 raft_consensus.cc:1261] T ec5e36fc7e2c4c9497c7628378355e91 P a224dcffe6424296ad818bfdf6858cc2 [term 1 FOLLOWER]: Refusing update from remote peer eab8834731d84b77962a2329dcdb94d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:18:07.127842 30811 consensus_queue.cc:1035] T ec5e36fc7e2c4c9497c7628378355e91 P eab8834731d84b77962a2329dcdb94d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bfe0b36938514104bdaf1a7791061400" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 33637 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:18:07.128046 30816 consensus_queue.cc:1035] T ec5e36fc7e2c4c9497c7628378355e91 P eab8834731d84b77962a2329dcdb94d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a224dcffe6424296ad818bfdf6858cc2" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 33605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:18:07.136068 30820 mvcc.cc:205] Tried to move back new op lower bound from 7332593201665605632 to 7332593201559494656. Current Snapshot: MvccSnapshot[applied={T|T < 7332593201665605632}]
I20260923 17:18:07.147105 30328 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52852:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:18:07.147311 30328 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52852:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:18:07.150079 30328 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 92d409ed223244b9bf293a07ce96f9ad: Sending DeleteTablet for 3 replicas of tablet ec5e36fc7e2c4c9497c7628378355e91
I20260923 17:18:07.150964 30454 tablet_service.cc:1514] Processing DeleteTablet for tablet ec5e36fc7e2c4c9497c7628378355e91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:18:07 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:39604
I20260923 17:18:07.150966 30588 tablet_service.cc:1514] Processing DeleteTablet for tablet ec5e36fc7e2c4c9497c7628378355e91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:18:07 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:53224
I20260923 17:18:07.151324 30722 tablet_service.cc:1514] Processing DeleteTablet for tablet ec5e36fc7e2c4c9497c7628378355e91 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:18:07 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:36956
I20260923 17:18:07.151553 30829 tablet_replica.cc:330] T ec5e36fc7e2c4c9497c7628378355e91 P a224dcffe6424296ad818bfdf6858cc2: stopping tablet replica
I20260923 17:18:07.151922 30829 raft_consensus.cc:2229] T ec5e36fc7e2c4c9497c7628378355e91 P a224dcffe6424296ad818bfdf6858cc2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:18:07.152284 30829 raft_consensus.cc:2258] T ec5e36fc7e2c4c9497c7628378355e91 P a224dcffe6424296ad818bfdf6858cc2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:18:07.152686 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 30391
I20260923 17:18:07.154711 30829 ts_tablet_manager.cc:1905] T ec5e36fc7e2c4c9497c7628378355e91 P a224dcffe6424296ad818bfdf6858cc2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:18:07.158123 30829 ts_tablet_manager.cc:1918] T ec5e36fc7e2c4c9497c7628378355e91 P a224dcffe6424296ad818bfdf6858cc2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 17:18:07.158272 30829 log.cc:1196] T ec5e36fc7e2c4c9497c7628378355e91 P a224dcffe6424296ad818bfdf6858cc2: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-1/wal/wals/ec5e36fc7e2c4c9497c7628378355e91
I20260923 17:18:07.158617 30829 ts_tablet_manager.cc:1939] T ec5e36fc7e2c4c9497c7628378355e91 P a224dcffe6424296ad818bfdf6858cc2: Deleting consensus metadata
I20260923 17:18:07.158599 30831 tablet_replica.cc:330] T ec5e36fc7e2c4c9497c7628378355e91 P bfe0b36938514104bdaf1a7791061400: stopping tablet replica
I20260923 17:18:07.159045 30831 raft_consensus.cc:2229] T ec5e36fc7e2c4c9497c7628378355e91 P bfe0b36938514104bdaf1a7791061400 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:18:07.159428 30831 raft_consensus.cc:2258] T ec5e36fc7e2c4c9497c7628378355e91 P bfe0b36938514104bdaf1a7791061400 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:18:07.160084 30316 catalog_manager.cc:4841] TS a224dcffe6424296ad818bfdf6858cc2 (127.11.229.130:33605): tablet ec5e36fc7e2c4c9497c7628378355e91 (table test-table [id=b8b264a037fb48ceac247067d6a1c43b]) successfully deleted
I20260923 17:18:07.160816 30831 ts_tablet_manager.cc:1905] T ec5e36fc7e2c4c9497c7628378355e91 P bfe0b36938514104bdaf1a7791061400: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260923 17:18:07.161742 30314 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.229.129:36383 (error 108)
I20260923 17:18:07.162617 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 30525
I20260923 17:18:07.162834 30799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:07.162498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:36383 (local address 127.0.0.1:39624)
0923 17:18:07.162654 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:07.162736 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.129:36383: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260923 17:18:07.164232 30831 ts_tablet_manager.cc:1918] T ec5e36fc7e2c4c9497c7628378355e91 P bfe0b36938514104bdaf1a7791061400: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 17:18:07.164359 30831 log.cc:1196] T ec5e36fc7e2c4c9497c7628378355e91 P bfe0b36938514104bdaf1a7791061400: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790183633736342-12182-0/minicluster-data/ts-2/wal/wals/ec5e36fc7e2c4c9497c7628378355e91
I20260923 17:18:07.164664 30831 ts_tablet_manager.cc:1939] T ec5e36fc7e2c4c9497c7628378355e91 P bfe0b36938514104bdaf1a7791061400: Deleting consensus metadata
I20260923 17:18:07.165762 30315 catalog_manager.cc:4841] TS bfe0b36938514104bdaf1a7791061400 (127.11.229.131:33637): tablet ec5e36fc7e2c4c9497c7628378355e91 (table test-table [id=b8b264a037fb48ceac247067d6a1c43b]) successfully deleted
W20260923 17:18:07.166848 30314 catalog_manager.cc:4584] TS eab8834731d84b77962a2329dcdb94d1 (127.11.229.129:36383): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ec5e36fc7e2c4c9497c7628378355e91: Network error: Client connection negotiation failed: client connection to 127.11.229.129:36383: connect: Connection refused (error 111)
I20260923 17:18:07.169368 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 30659
I20260923 17:18:07.175340 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 30297
2026-09-23T17:18:07Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2404 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-09-23T17:18:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:18:07Z Disabled control of system clock
I20260923 17:18:07.205871 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:39381
--webserver_interface=127.11.229.190
--webserver_port=0
--builtin_ntp_servers=127.11.229.148:41199
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:39381
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260923 17:18:07.315716 30836 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:18:07.315986 30836 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:18:07.316022 30836 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:18:07.319983 30836 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:18:07.320050 30836 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:18:07.320065 30836 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:18:07.320082 30836 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:18:07.320097 30836 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:18:07.324894 30836 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:41199
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:39381
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:39381
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.229.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30836
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:18:07.325932 30836 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:18:07.327322 30836 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:18:07.335789 30841 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:07.335836 30836 server_base.cc:1034] running on GCE node
W20260923 17:18:07.335774 30844 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:07.335794 30842 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:07.336623 30836 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:18:07.337811 30836 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:18:07.339021 30836 hybrid_clock.cc:648] HybridClock initialized: now 1790183887338995 us; error 40 us; skew 500 ppm
I20260923 17:18:07.344563 30836 webserver.cc:460] Webserver started at http://127.11.229.190:41819/ using document root <none> and password file <none>
I20260923 17:18:07.345240 30836 fs_manager.cc:359] Metadata directory not provided
I20260923 17:18:07.345345 30836 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:18:07.345589 30836 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:18:07.347885 30836 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "66868af7efaa445bbe8e9d6ba3bac3fb"
format_stamp: "Formatted at 2026-09-23 17:18:07 on dist-test-slave-1x1f"
server_key: "ae3ad65d5b2b80792efdb28d9adbdfe0"
server_key_iv: "ca04a466188175f386033c1433130131"
server_key_version: "encryptionkey@0"
I20260923 17:18:07.348491 30836 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "66868af7efaa445bbe8e9d6ba3bac3fb"
format_stamp: "Formatted at 2026-09-23 17:18:07 on dist-test-slave-1x1f"
server_key: "ae3ad65d5b2b80792efdb28d9adbdfe0"
server_key_iv: "ca04a466188175f386033c1433130131"
server_key_version: "encryptionkey@0"
I20260923 17:18:07.352562 30836 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260923 17:18:07.355183 30850 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:07.356416 30836 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 17:18:07.356575 30836 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "66868af7efaa445bbe8e9d6ba3bac3fb"
format_stamp: "Formatted at 2026-09-23 17:18:07 on dist-test-slave-1x1f"
server_key: "ae3ad65d5b2b80792efdb28d9adbdfe0"
server_key_iv: "ca04a466188175f386033c1433130131"
server_key_version: "encryptionkey@0"
I20260923 17:18:07.356691 30836 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:18:07.367098 30836 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:18:07.367799 30836 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:18:07.368000 30836 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:18:07.375679 30836 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.190:39381
I20260923 17:18:07.375684 30902 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.190:39381 every 8 connection(s)
I20260923 17:18:07.376741 30836 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:18:07.380017 30903 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:18:07.381649 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 30836
I20260923 17:18:07.381783 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:18:07.382087 12182 external_mini_cluster.cc:1428] Setting key 8410fc777101aa5304d798a7b0f1f5ca
I20260923 17:18:07.387028 30903 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66868af7efaa445bbe8e9d6ba3bac3fb: Bootstrap starting.
I20260923 17:18:07.389222 30903 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 66868af7efaa445bbe8e9d6ba3bac3fb: Neither blocks nor log segments found. Creating new log.
I20260923 17:18:07.390017 30903 log.cc:824] T 00000000000000000000000000000000 P 66868af7efaa445bbe8e9d6ba3bac3fb: Log is configured to *not* fsync() on all Append() calls
I20260923 17:18:07.391696 30906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:07.383681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35186 (local address 127.11.229.190:39381)
0923 17:18:07.384432 (+ 751us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:07.384448 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:07.384481 (+ 33us) server_negotiation.cc:407] Connection header received
0923 17:18:07.385145 (+ 664us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:07.385162 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:07.385537 (+ 375us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:07.385903 (+ 366us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:07.386372 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:07.387365 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:07.388237 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:07.388699 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:07.388863 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:07.389843 (+ 980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:07.389854 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:07.389868 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:18:07.390372 (+ 504us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:07.390431 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:18:07.390451 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:07.390555 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:07.390736 (+ 181us) server_negotiation.cc:299] Negotiation successful
0923 17:18:07.391021 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":407,"thread_start_us":133,"threads_started":1}
I20260923 17:18:07.391930 30903 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66868af7efaa445bbe8e9d6ba3bac3fb: No bootstrap required, opened a new log
I20260923 17:18:07.395655 30903 raft_consensus.cc:348] T 00000000000000000000000000000000 P 66868af7efaa445bbe8e9d6ba3bac3fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66868af7efaa445bbe8e9d6ba3bac3fb" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 39381 } }
I20260923 17:18:07.395864 30903 raft_consensus.cc:374] T 00000000000000000000000000000000 P 66868af7efaa445bbe8e9d6ba3bac3fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:18:07.395898 30903 raft_consensus.cc:729] T 00000000000000000000000000000000 P 66868af7efaa445bbe8e9d6ba3bac3fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66868af7efaa445bbe8e9d6ba3bac3fb, State: Initialized, Role: FOLLOWER
I20260923 17:18:07.396245 30903 consensus_queue.cc:260] T 00000000000000000000000000000000 P 66868af7efaa445bbe8e9d6ba3bac3fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66868af7efaa445bbe8e9d6ba3bac3fb" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 39381 } }
I20260923 17:18:07.396350 30903 raft_consensus.cc:388] T 00000000000000000000000000000000 P 66868af7efaa445bbe8e9d6ba3bac3fb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:18:07.396387 30903 raft_consensus.cc:482] T 00000000000000000000000000000000 P 66868af7efaa445bbe8e9d6ba3bac3fb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:18:07.396454 30903 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 66868af7efaa445bbe8e9d6ba3bac3fb [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:18:07.397310 30903 raft_consensus.cc:504] T 00000000000000000000000000000000 P 66868af7efaa445bbe8e9d6ba3bac3fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66868af7efaa445bbe8e9d6ba3bac3fb" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 39381 } }
I20260923 17:18:07.397589 30903 leader_election.cc:302] T 00000000000000000000000000000000 P 66868af7efaa445bbe8e9d6ba3bac3fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66868af7efaa445bbe8e9d6ba3bac3fb; no voters:
I20260923 17:18:07.397845 30903 leader_election.cc:288] T 00000000000000000000000000000000 P 66868af7efaa445bbe8e9d6ba3bac3fb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 17:18:07.398000 30908 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 66868af7efaa445bbe8e9d6ba3bac3fb [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:18:07.398263 30908 raft_consensus.cc:686] T 00000000000000000000000000000000 P 66868af7efaa445bbe8e9d6ba3bac3fb [term 1 LEADER]: Becoming Leader. State: Replica: 66868af7efaa445bbe8e9d6ba3bac3fb, State: Running, Role: LEADER
I20260923 17:18:07.398574 30908 consensus_queue.cc:237] T 00000000000000000000000000000000 P 66868af7efaa445bbe8e9d6ba3bac3fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66868af7efaa445bbe8e9d6ba3bac3fb" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 39381 } }
I20260923 17:18:07.399066 30903 sys_catalog.cc:564] T 00000000000000000000000000000000 P 66868af7efaa445bbe8e9d6ba3bac3fb [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:18:07.400224 30910 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66868af7efaa445bbe8e9d6ba3bac3fb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 66868af7efaa445bbe8e9d6ba3bac3fb. Latest consensus state: current_term: 1 leader_uuid: "66868af7efaa445bbe8e9d6ba3bac3fb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66868af7efaa445bbe8e9d6ba3bac3fb" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 39381 } } }
I20260923 17:18:07.400345 30910 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66868af7efaa445bbe8e9d6ba3bac3fb [sys.catalog]: This master's current role is: LEADER
I20260923 17:18:07.400746 30917 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:18:07.400740 30909 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66868af7efaa445bbe8e9d6ba3bac3fb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "66868af7efaa445bbe8e9d6ba3bac3fb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66868af7efaa445bbe8e9d6ba3bac3fb" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 39381 } } }
I20260923 17:18:07.401490 30909 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66868af7efaa445bbe8e9d6ba3bac3fb [sys.catalog]: This master's current role is: LEADER
I20260923 17:18:07.403519 30917 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:18:07.408957 30917 catalog_manager.cc:1347] Generated new cluster ID: 30d883ce2fcd48b680e06234ac4519cb
I20260923 17:18:07.409029 30917 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:18:07.421505 30917 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:18:07.422778 30917 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:18:07.436019 30917 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 66868af7efaa445bbe8e9d6ba3bac3fb: Generated new TSK 0
I20260923 17:18:07.436803 30917 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 17:18:07.439800 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.129:0
--local_ip_for_outbound_sockets=127.11.229.129
--webserver_interface=127.11.229.129
--webserver_port=0
--tserver_master_addrs=127.11.229.190:39381
--builtin_ntp_servers=127.11.229.148:41199
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260923 17:18:07.573232 30927 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:18:07.573503 30927 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:18:07.573544 30927 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:18:07.577766 30927 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:18:07.577821 30927 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:18:07.577904 30927 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.129
I20260923 17:18:07.582813 30927 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:41199
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.229.129
--webserver_port=0
--tserver_master_addrs=127.11.229.190:39381
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30927
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.129
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:18:07.583822 30927 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:18:07.585141 30927 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:18:07.595063 30932 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:07.595103 30933 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:07.595103 30935 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:07.595148 30927 server_base.cc:1034] running on GCE node
I20260923 17:18:07.595749 30927 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:18:07.596403 30927 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:18:07.597599 30927 hybrid_clock.cc:648] HybridClock initialized: now 1790183887597566 us; error 33 us; skew 500 ppm
I20260923 17:18:07.599424 30927 webserver.cc:460] Webserver started at http://127.11.229.129:39209/ using document root <none> and password file <none>
I20260923 17:18:07.600069 30927 fs_manager.cc:359] Metadata directory not provided
I20260923 17:18:07.600194 30927 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:18:07.600440 30927 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:18:07.602582 30927 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-0/data/instance:
uuid: "69434171c0244baba23fdeac2eae0551"
format_stamp: "Formatted at 2026-09-23 17:18:07 on dist-test-slave-1x1f"
server_key: "df899305d2df71312aeb2bbb7025ab39"
server_key_iv: "68702359799bc7d73d51a390db9c0fd3"
server_key_version: "encryptionkey@0"
I20260923 17:18:07.603124 30927 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance:
uuid: "69434171c0244baba23fdeac2eae0551"
format_stamp: "Formatted at 2026-09-23 17:18:07 on dist-test-slave-1x1f"
server_key: "df899305d2df71312aeb2bbb7025ab39"
server_key_iv: "68702359799bc7d73d51a390db9c0fd3"
server_key_version: "encryptionkey@0"
I20260923 17:18:07.606653 30927 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260923 17:18:07.609009 30941 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:07.610209 30927 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 17:18:07.610378 30927 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-0/wal
uuid: "69434171c0244baba23fdeac2eae0551"
format_stamp: "Formatted at 2026-09-23 17:18:07 on dist-test-slave-1x1f"
server_key: "df899305d2df71312aeb2bbb7025ab39"
server_key_iv: "68702359799bc7d73d51a390db9c0fd3"
server_key_version: "encryptionkey@0"
I20260923 17:18:07.610483 30927 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:18:07.639685 30927 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:18:07.640393 30927 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:18:07.640590 30927 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:18:07.641188 30927 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:18:07.642135 30927 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:18:07.642206 30927 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:07.642288 30927 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:18:07.642330 30927 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:07.651234 30927 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.129:43171
I20260923 17:18:07.651290 31054 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.129:43171 every 8 connection(s)
I20260923 17:18:07.652218 30927 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
I20260923 17:18:07.656921 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 30927
I20260923 17:18:07.657024 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance
I20260923 17:18:07.657371 12182 external_mini_cluster.cc:1428] Setting key f5a3b92ff8f55b1b00c101915a0f8113
I20260923 17:18:07.659592 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.130:0
--local_ip_for_outbound_sockets=127.11.229.130
--webserver_interface=127.11.229.130
--webserver_port=0
--tserver_master_addrs=127.11.229.190:39381
--builtin_ntp_servers=127.11.229.148:41199
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260923 17:18:07.662987 30906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:07.654351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:33933 (local address 127.11.229.190:39381)
0923 17:18:07.654513 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:07.654517 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:07.655642 (+ 1125us) server_negotiation.cc:407] Connection header received
0923 17:18:07.657198 (+ 1556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:07.657203 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:07.657272 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:07.657362 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:07.658518 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:07.659352 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:07.660777 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:07.661054 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:07.661179 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:07.662423 (+ 1244us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:07.662427 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:07.662430 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:18:07.662445 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:07.662472 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:18:07.662481 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:07.662560 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:07.662753 (+ 193us) server_negotiation.cc:299] Negotiation successful
0923 17:18:07.662832 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260923 17:18:07.663890 31057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:07.654757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:39381 (local address 127.11.229.129:33933)
0923 17:18:07.655479 (+ 722us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:07.655536 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:07.656910 (+ 1374us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:07.657537 (+ 627us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:07.657544 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:07.657632 (+ 88us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:18:07.658368 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:07.658388 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:07.659503 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:07.659509 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:07.660576 (+ 1067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:07.660607 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:07.661227 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:07.661231 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:07.661407 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:07.662079 (+ 672us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 17:18:07.662081 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:18:07.662132 (+ 51us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 17:18:07.662210 (+ 78us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:18:07.662576 (+ 366us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:18:07.662589 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:18:07.662595 (+ 6us) client_negotiation.cc:769] Sending connection context
0923 17:18:07.662729 (+ 134us) client_negotiation.cc:240] Negotiation successful
0923 17:18:07.663035 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":118,"threads_started":1}
I20260923 17:18:07.665335 31055 heartbeater.cc:347] Connected to a master server at 127.11.229.190:39381
I20260923 17:18:07.665620 31055 heartbeater.cc:464] Registering TS with master...
I20260923 17:18:07.666388 31055 heartbeater.cc:511] Master 127.11.229.190:39381 requested a full tablet report, sending...
I20260923 17:18:07.668329 30867 ts_manager.cc:194] Registered new tserver with Master: 69434171c0244baba23fdeac2eae0551 (127.11.229.129:43171)
I20260923 17:18:07.670095 30867 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.229.129:33933
W20260923 17:18:07.774982 31058 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:18:07.775264 31058 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:18:07.775303 31058 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:18:07.779256 31058 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:18:07.779305 31058 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:18:07.779358 31058 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.130
I20260923 17:18:07.784018 31058 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:41199
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.229.130
--webserver_port=0
--tserver_master_addrs=127.11.229.190:39381
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31058
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.130
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:18:07.784991 31058 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:18:07.786375 31058 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:18:07.796025 31066 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:07.796046 31064 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:07.796046 31063 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:07.796252 31058 server_base.cc:1034] running on GCE node
I20260923 17:18:07.796715 31058 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:18:07.797365 31058 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:18:07.798549 31058 hybrid_clock.cc:648] HybridClock initialized: now 1790183887798525 us; error 41 us; skew 500 ppm
I20260923 17:18:07.807269 31058 webserver.cc:460] Webserver started at http://127.11.229.130:45045/ using document root <none> and password file <none>
I20260923 17:18:07.807928 31058 fs_manager.cc:359] Metadata directory not provided
I20260923 17:18:07.808025 31058 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:18:07.808264 31058 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:18:07.810490 31058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-1/data/instance:
uuid: "be8aebb4f23f4acca885b5b5cb450448"
format_stamp: "Formatted at 2026-09-23 17:18:07 on dist-test-slave-1x1f"
server_key: "25294b48d63b5e93a5e80bced7d6f37f"
server_key_iv: "c5579c11ef50dc285e20f4df0e5e0e14"
server_key_version: "encryptionkey@0"
I20260923 17:18:07.811094 31058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance:
uuid: "be8aebb4f23f4acca885b5b5cb450448"
format_stamp: "Formatted at 2026-09-23 17:18:07 on dist-test-slave-1x1f"
server_key: "25294b48d63b5e93a5e80bced7d6f37f"
server_key_iv: "c5579c11ef50dc285e20f4df0e5e0e14"
server_key_version: "encryptionkey@0"
I20260923 17:18:07.815172 31058 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260923 17:18:07.817924 31072 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:07.819365 31058 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260923 17:18:07.819506 31058 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-1/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-1/wal
uuid: "be8aebb4f23f4acca885b5b5cb450448"
format_stamp: "Formatted at 2026-09-23 17:18:07 on dist-test-slave-1x1f"
server_key: "25294b48d63b5e93a5e80bced7d6f37f"
server_key_iv: "c5579c11ef50dc285e20f4df0e5e0e14"
server_key_version: "encryptionkey@0"
I20260923 17:18:07.819653 31058 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:18:07.836169 31058 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:18:07.836928 31058 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:18:07.837141 31058 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:18:07.837751 31058 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:18:07.838763 31058 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:18:07.838837 31058 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:07.838910 31058 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:18:07.838961 31058 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:07.848991 31058 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.130:42045
I20260923 17:18:07.849020 31185 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.130:42045 every 8 connection(s)
I20260923 17:18:07.849946 31058 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
I20260923 17:18:07.856402 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 31058
I20260923 17:18:07.856530 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance
I20260923 17:18:07.856865 12182 external_mini_cluster.cc:1428] Setting key 0f036162fc1174b98fc221e4fdfcd955
I20260923 17:18:07.858830 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.131:0
--local_ip_for_outbound_sockets=127.11.229.131
--webserver_interface=127.11.229.131
--webserver_port=0
--tserver_master_addrs=127.11.229.190:39381
--builtin_ntp_servers=127.11.229.148:41199
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260923 17:18:07.859892 30906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:07.851827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:49885 (local address 127.11.229.190:39381)
0923 17:18:07.851986 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:07.851991 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:07.853148 (+ 1157us) server_negotiation.cc:407] Connection header received
0923 17:18:07.854666 (+ 1518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:07.854669 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:07.854718 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:07.854796 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:07.855607 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:07.856207 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:07.857689 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:07.857919 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:07.858029 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:07.859243 (+ 1214us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:07.859251 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:07.859257 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:18:07.859279 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:07.859313 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:18:07.859328 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:07.859422 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:07.859560 (+ 138us) server_negotiation.cc:299] Negotiation successful
0923 17:18:07.859661 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260923 17:18:07.860664 31188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:07.852359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:39381 (local address 127.11.229.130:49885)
0923 17:18:07.852993 (+ 634us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:07.853031 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:07.854459 (+ 1428us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:07.854928 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:07.854935 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:07.855013 (+ 78us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:18:07.855473 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:07.855484 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:07.856336 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:07.856340 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:07.857539 (+ 1199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:07.857570 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:07.858069 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:07.858089 (+ 20us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:07.858339 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:07.858963 (+ 624us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 17:18:07.858966 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:18:07.859028 (+ 62us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 17:18:07.859091 (+ 63us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:18:07.859421 (+ 330us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:18:07.859428 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:18:07.859432 (+ 4us) client_negotiation.cc:769] Sending connection context
0923 17:18:07.859530 (+ 98us) client_negotiation.cc:240] Negotiation successful
0923 17:18:07.859742 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":132,"threads_started":1}
I20260923 17:18:07.861761 31186 heartbeater.cc:347] Connected to a master server at 127.11.229.190:39381
I20260923 17:18:07.861972 31186 heartbeater.cc:464] Registering TS with master...
I20260923 17:18:07.862514 31186 heartbeater.cc:511] Master 127.11.229.190:39381 requested a full tablet report, sending...
I20260923 17:18:07.863471 30867 ts_manager.cc:194] Registered new tserver with Master: be8aebb4f23f4acca885b5b5cb450448 (127.11.229.130:42045)
I20260923 17:18:07.864025 30867 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.229.130:49885
W20260923 17:18:07.971988 31189 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:18:07.972241 31189 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:18:07.972280 31189 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:18:07.976312 31189 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:18:07.976359 31189 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:18:07.976441 31189 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.131
I20260923 17:18:07.981096 31189 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:41199
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.229.131
--webserver_port=0
--tserver_master_addrs=127.11.229.190:39381
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31189
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.131
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:18:07.982156 31189 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:18:07.983533 31189 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:18:07.993137 31194 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:07.993202 31195 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:07.993260 31197 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:07.993486 31189 server_base.cc:1034] running on GCE node
I20260923 17:18:07.993913 31189 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:18:07.994594 31189 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:18:07.995774 31189 hybrid_clock.cc:648] HybridClock initialized: now 1790183887995760 us; error 26 us; skew 500 ppm
I20260923 17:18:07.997560 31189 webserver.cc:460] Webserver started at http://127.11.229.131:41591/ using document root <none> and password file <none>
I20260923 17:18:07.998116 31189 fs_manager.cc:359] Metadata directory not provided
I20260923 17:18:07.998175 31189 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:18:07.998401 31189 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:18:08.000488 31189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-2/data/instance:
uuid: "b25f964f1dcb4206a724023ed0ec5360"
format_stamp: "Formatted at 2026-09-23 17:18:07 on dist-test-slave-1x1f"
server_key: "3cc6f12d7ff845e6e32a1d16a113e5d7"
server_key_iv: "cbac70df649fdf0cd8c05a0a4f575171"
server_key_version: "encryptionkey@0"
I20260923 17:18:08.001046 31189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance:
uuid: "b25f964f1dcb4206a724023ed0ec5360"
format_stamp: "Formatted at 2026-09-23 17:18:07 on dist-test-slave-1x1f"
server_key: "3cc6f12d7ff845e6e32a1d16a113e5d7"
server_key_iv: "cbac70df649fdf0cd8c05a0a4f575171"
server_key_version: "encryptionkey@0"
I20260923 17:18:08.004752 31189 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260923 17:18:08.007309 31203 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:08.008574 31189 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 17:18:08.008701 31189 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-2/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-2/wal
uuid: "b25f964f1dcb4206a724023ed0ec5360"
format_stamp: "Formatted at 2026-09-23 17:18:07 on dist-test-slave-1x1f"
server_key: "3cc6f12d7ff845e6e32a1d16a113e5d7"
server_key_iv: "cbac70df649fdf0cd8c05a0a4f575171"
server_key_version: "encryptionkey@0"
I20260923 17:18:08.008808 31189 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:18:08.030565 31189 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:18:08.031271 31189 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:18:08.031462 31189 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:18:08.032045 31189 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:18:08.032958 31189 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:18:08.033004 31189 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:08.033044 31189 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:18:08.033092 31189 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:08.042171 31189 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.131:34145
I20260923 17:18:08.042194 31316 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.131:34145 every 8 connection(s)
I20260923 17:18:08.043073 31189 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
I20260923 17:18:08.045658 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 31189
I20260923 17:18:08.045804 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance
I20260923 17:18:08.046111 12182 external_mini_cluster.cc:1428] Setting key 16ecdb0755d26fccc900373c8b39cffd
I20260923 17:18:08.053331 30906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:08.044961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:60837 (local address 127.11.229.190:39381)
0923 17:18:08.045103 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:08.045108 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:08.046369 (+ 1261us) server_negotiation.cc:407] Connection header received
0923 17:18:08.048346 (+ 1977us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:08.048353 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:08.048413 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:08.048489 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:08.049482 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:08.050055 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:08.051333 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:08.051554 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:08.051643 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:08.052811 (+ 1168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:08.052814 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:08.052816 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:18:08.052829 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:08.052848 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:18:08.052856 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:08.052917 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:08.053108 (+ 191us) server_negotiation.cc:299] Negotiation successful
0923 17:18:08.053166 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260923 17:18:08.054114 31319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:08.045390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:39381 (local address 127.11.229.131:60837)
0923 17:18:08.046161 (+ 771us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:08.046219 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:08.048058 (+ 1839us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:08.048702 (+ 644us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:08.048710 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:08.048801 (+ 91us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:18:08.049328 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:08.049344 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:08.050204 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:08.050208 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:08.051212 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:08.051224 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:08.051698 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:08.051701 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:08.051845 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:08.052555 (+ 710us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 17:18:08.052556 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:18:08.052596 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 17:18:08.052669 (+ 73us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:18:08.052938 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:18:08.052945 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:18:08.052949 (+ 4us) client_negotiation.cc:769] Sending connection context
0923 17:18:08.053062 (+ 113us) client_negotiation.cc:240] Negotiation successful
0923 17:18:08.053294 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"thread_start_us":147,"threads_started":1}
I20260923 17:18:08.055289 31317 heartbeater.cc:347] Connected to a master server at 127.11.229.190:39381
I20260923 17:18:08.055527 31317 heartbeater.cc:464] Registering TS with master...
I20260923 17:18:08.056046 31317 heartbeater.cc:511] Master 127.11.229.190:39381 requested a full tablet report, sending...
I20260923 17:18:08.057341 30867 ts_manager.cc:194] Registered new tserver with Master: b25f964f1dcb4206a724023ed0ec5360 (127.11.229.131:34145)
I20260923 17:18:08.057924 30867 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.229.131:60837
I20260923 17:18:08.060395 12182 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 17:18:08.066538 30906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:08.062604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35200 (local address 127.11.229.190:39381)
0923 17:18:08.062792 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:08.062796 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:08.062948 (+ 152us) server_negotiation.cc:407] Connection header received
0923 17:18:08.063101 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:08.063105 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:08.063150 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:08.063243 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:08.063510 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:08.064013 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:08.064861 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:08.065075 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:08.065176 (+ 101us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:08.066031 (+ 855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:08.066034 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:08.066037 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:18:08.066054 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:08.066071 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:18:08.066078 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:08.066214 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:08.066355 (+ 141us) server_negotiation.cc:299] Negotiation successful
0923 17:18:08.066394 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260923 17:18:08.069168 30867 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35200:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 17:18:08.072190 30867 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 17:18:08.086920 31328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:08.080789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.130:42045 (local address 127.0.0.1:51180)
0923 17:18:08.081142 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:08.081191 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:08.081318 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:08.082133 (+ 815us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:08.082139 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:08.082162 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:18:08.082337 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:08.082344 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:08.083763 (+ 1419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:08.083767 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:08.085374 (+ 1607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:08.085385 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:08.086473 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:08.086476 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:08.086572 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:08.086598 (+ 26us) client_negotiation.cc:769] Sending connection context
0923 17:18:08.086666 (+ 68us) client_negotiation.cc:240] Negotiation successful
0923 17:18:08.086739 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"mutex_wait_us":92,"thread_start_us":102,"threads_started":1}
I20260923 17:18:08.087101 31333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:08.082045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49302 (local address 127.11.229.131:34145)
0923 17:18:08.082522 (+ 477us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:08.082535 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:08.082558 (+ 23us) server_negotiation.cc:407] Connection header received
0923 17:18:08.082651 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:08.082658 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:08.082803 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:08.082953 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:18:08.083185 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:08.084153 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:08.085479 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:08.086072 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:08.086201 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:08.086393 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:08.086818 (+ 425us) server_negotiation.cc:299] Negotiation successful
0923 17:18:08.086912 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":370,"thread_start_us":176,"threads_started":1}
I20260923 17:18:08.087373 31329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:08.080799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.131:34145 (local address 127.0.0.1:49302)
0923 17:18:08.081533 (+ 734us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:08.081549 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:08.081643 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:08.082933 (+ 1290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:08.082936 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:08.082953 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:18:08.083056 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:08.083067 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:08.084278 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:08.084283 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:08.085362 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:08.085371 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:08.086205 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:08.086209 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:08.086373 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:08.086438 (+ 65us) client_negotiation.cc:769] Sending connection context
0923 17:18:08.086548 (+ 110us) client_negotiation.cc:240] Negotiation successful
0923 17:18:08.086682 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":666,"mutex_wait_us":69,"thread_start_us":92,"threads_started":1}
I20260923 17:18:08.087725 31330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:08.080910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51180 (local address 127.11.229.130:42045)
0923 17:18:08.081623 (+ 713us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:08.081635 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:08.081661 (+ 26us) server_negotiation.cc:407] Connection header received
0923 17:18:08.081737 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:08.081744 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:08.081966 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:08.082152 (+ 186us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:18:08.082468 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:08.083640 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:08.085522 (+ 1882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:08.086365 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:08.086489 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:08.086686 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:08.086743 (+ 57us) server_negotiation.cc:299] Negotiation successful
0923 17:18:08.086844 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":604,"thread_start_us":119,"threads_started":1}
I20260923 17:18:08.087775 31332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:08.081993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44464 (local address 127.11.229.129:43171)
0923 17:18:08.082482 (+ 489us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:08.082494 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:08.082524 (+ 30us) server_negotiation.cc:407] Connection header received
0923 17:18:08.082695 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:08.082700 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:08.082873 (+ 173us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:08.083007 (+ 134us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:18:08.083351 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:08.084485 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:08.085972 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:08.086755 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:08.086862 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:08.087009 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:08.087495 (+ 486us) server_negotiation.cc:299] Negotiation successful
0923 17:18:08.087612 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":130,"threads_started":1}
I20260923 17:18:08.088079 31331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:08.081563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:43171 (local address 127.0.0.1:44464)
0923 17:18:08.082440 (+ 877us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:08.082464 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:08.082559 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:08.083100 (+ 541us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:08.083106 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:08.083126 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:18:08.083236 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:08.083241 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:08.084625 (+ 1384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:08.084628 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:08.085847 (+ 1219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:08.085856 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:08.087087 (+ 1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:08.087091 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:08.087181 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:08.087202 (+ 21us) client_negotiation.cc:769] Sending connection context
0923 17:18:08.087270 (+ 68us) client_negotiation.cc:240] Negotiation successful
0923 17:18:08.087945 (+ 675us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":802,"mutex_wait_us":1,"thread_start_us":114,"threads_started":1}
I20260923 17:18:08.090723 30989 tablet_service.cc:1467] Processing CreateTablet for tablet 2a4568f4fd74459aa973399b2447f643 (DEFAULT_TABLE table=test-table [id=fe6d5bb983bf43b19b7e73dcf283c0b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:18:08.090740 31251 tablet_service.cc:1467] Processing CreateTablet for tablet 2a4568f4fd74459aa973399b2447f643 (DEFAULT_TABLE table=test-table [id=fe6d5bb983bf43b19b7e73dcf283c0b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:18:08.090741 31120 tablet_service.cc:1467] Processing CreateTablet for tablet 2a4568f4fd74459aa973399b2447f643 (DEFAULT_TABLE table=test-table [id=fe6d5bb983bf43b19b7e73dcf283c0b8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:18:08.091830 31120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a4568f4fd74459aa973399b2447f643. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:18:08.091830 31251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a4568f4fd74459aa973399b2447f643. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:18:08.091832 30989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a4568f4fd74459aa973399b2447f643. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:18:08.098690 31334 tablet_bootstrap.cc:492] T 2a4568f4fd74459aa973399b2447f643 P 69434171c0244baba23fdeac2eae0551: Bootstrap starting.
I20260923 17:18:08.099793 31335 tablet_bootstrap.cc:492] T 2a4568f4fd74459aa973399b2447f643 P b25f964f1dcb4206a724023ed0ec5360: Bootstrap starting.
I20260923 17:18:08.101315 31334 tablet_bootstrap.cc:654] T 2a4568f4fd74459aa973399b2447f643 P 69434171c0244baba23fdeac2eae0551: Neither blocks nor log segments found. Creating new log.
I20260923 17:18:08.102084 31335 tablet_bootstrap.cc:654] T 2a4568f4fd74459aa973399b2447f643 P b25f964f1dcb4206a724023ed0ec5360: Neither blocks nor log segments found. Creating new log.
I20260923 17:18:08.102267 31334 log.cc:824] T 2a4568f4fd74459aa973399b2447f643 P 69434171c0244baba23fdeac2eae0551: Log is configured to *not* fsync() on all Append() calls
I20260923 17:18:08.102797 31336 tablet_bootstrap.cc:492] T 2a4568f4fd74459aa973399b2447f643 P be8aebb4f23f4acca885b5b5cb450448: Bootstrap starting.
I20260923 17:18:08.104471 31334 tablet_bootstrap.cc:492] T 2a4568f4fd74459aa973399b2447f643 P 69434171c0244baba23fdeac2eae0551: No bootstrap required, opened a new log
I20260923 17:18:08.104676 31334 ts_tablet_manager.cc:1397] T 2a4568f4fd74459aa973399b2447f643 P 69434171c0244baba23fdeac2eae0551: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260923 17:18:08.104888 31336 tablet_bootstrap.cc:654] T 2a4568f4fd74459aa973399b2447f643 P be8aebb4f23f4acca885b5b5cb450448: Neither blocks nor log segments found. Creating new log.
I20260923 17:18:08.105787 31336 log.cc:824] T 2a4568f4fd74459aa973399b2447f643 P be8aebb4f23f4acca885b5b5cb450448: Log is configured to *not* fsync() on all Append() calls
I20260923 17:18:08.106933 31335 log.cc:824] T 2a4568f4fd74459aa973399b2447f643 P b25f964f1dcb4206a724023ed0ec5360: Log is configured to *not* fsync() on all Append() calls
I20260923 17:18:08.108161 31336 tablet_bootstrap.cc:492] T 2a4568f4fd74459aa973399b2447f643 P be8aebb4f23f4acca885b5b5cb450448: No bootstrap required, opened a new log
I20260923 17:18:08.108358 31336 ts_tablet_manager.cc:1397] T 2a4568f4fd74459aa973399b2447f643 P be8aebb4f23f4acca885b5b5cb450448: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260923 17:18:08.108889 31335 tablet_bootstrap.cc:492] T 2a4568f4fd74459aa973399b2447f643 P b25f964f1dcb4206a724023ed0ec5360: No bootstrap required, opened a new log
I20260923 17:18:08.109064 31335 ts_tablet_manager.cc:1397] T 2a4568f4fd74459aa973399b2447f643 P b25f964f1dcb4206a724023ed0ec5360: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s
I20260923 17:18:08.109227 31334 raft_consensus.cc:348] T 2a4568f4fd74459aa973399b2447f643 P 69434171c0244baba23fdeac2eae0551 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8aebb4f23f4acca885b5b5cb450448" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42045 } } peers { permanent_uuid: "b25f964f1dcb4206a724023ed0ec5360" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 34145 } } peers { permanent_uuid: "69434171c0244baba23fdeac2eae0551" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 43171 } }
I20260923 17:18:08.109539 31334 raft_consensus.cc:374] T 2a4568f4fd74459aa973399b2447f643 P 69434171c0244baba23fdeac2eae0551 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:18:08.109594 31334 raft_consensus.cc:729] T 2a4568f4fd74459aa973399b2447f643 P 69434171c0244baba23fdeac2eae0551 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69434171c0244baba23fdeac2eae0551, State: Initialized, Role: FOLLOWER
I20260923 17:18:08.110057 31334 consensus_queue.cc:260] T 2a4568f4fd74459aa973399b2447f643 P 69434171c0244baba23fdeac2eae0551 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8aebb4f23f4acca885b5b5cb450448" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42045 } } peers { permanent_uuid: "b25f964f1dcb4206a724023ed0ec5360" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 34145 } } peers { permanent_uuid: "69434171c0244baba23fdeac2eae0551" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 43171 } }
I20260923 17:18:08.111047 31334 ts_tablet_manager.cc:1428] T 2a4568f4fd74459aa973399b2447f643 P 69434171c0244baba23fdeac2eae0551: Time spent starting tablet: real 0.006s user 0.003s sys 0.004s
I20260923 17:18:08.111431 31055 heartbeater.cc:503] Master 127.11.229.190:39381 was elected leader, sending a full tablet report...
I20260923 17:18:08.111763 31336 raft_consensus.cc:348] T 2a4568f4fd74459aa973399b2447f643 P be8aebb4f23f4acca885b5b5cb450448 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8aebb4f23f4acca885b5b5cb450448" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42045 } } peers { permanent_uuid: "b25f964f1dcb4206a724023ed0ec5360" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 34145 } } peers { permanent_uuid: "69434171c0244baba23fdeac2eae0551" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 43171 } }
I20260923 17:18:08.111982 31336 raft_consensus.cc:374] T 2a4568f4fd74459aa973399b2447f643 P be8aebb4f23f4acca885b5b5cb450448 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:18:08.112031 31336 raft_consensus.cc:729] T 2a4568f4fd74459aa973399b2447f643 P be8aebb4f23f4acca885b5b5cb450448 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be8aebb4f23f4acca885b5b5cb450448, State: Initialized, Role: FOLLOWER
I20260923 17:18:08.112432 31336 consensus_queue.cc:260] T 2a4568f4fd74459aa973399b2447f643 P be8aebb4f23f4acca885b5b5cb450448 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8aebb4f23f4acca885b5b5cb450448" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42045 } } peers { permanent_uuid: "b25f964f1dcb4206a724023ed0ec5360" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 34145 } } peers { permanent_uuid: "69434171c0244baba23fdeac2eae0551" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 43171 } }
I20260923 17:18:08.113190 31336 ts_tablet_manager.cc:1428] T 2a4568f4fd74459aa973399b2447f643 P be8aebb4f23f4acca885b5b5cb450448: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260923 17:18:08.113106 31335 raft_consensus.cc:348] T 2a4568f4fd74459aa973399b2447f643 P b25f964f1dcb4206a724023ed0ec5360 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8aebb4f23f4acca885b5b5cb450448" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42045 } } peers { permanent_uuid: "b25f964f1dcb4206a724023ed0ec5360" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 34145 } } peers { permanent_uuid: "69434171c0244baba23fdeac2eae0551" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 43171 } }
I20260923 17:18:08.113363 31335 raft_consensus.cc:374] T 2a4568f4fd74459aa973399b2447f643 P b25f964f1dcb4206a724023ed0ec5360 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:18:08.113418 31335 raft_consensus.cc:729] T 2a4568f4fd74459aa973399b2447f643 P b25f964f1dcb4206a724023ed0ec5360 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b25f964f1dcb4206a724023ed0ec5360, State: Initialized, Role: FOLLOWER
I20260923 17:18:08.113545 31186 heartbeater.cc:503] Master 127.11.229.190:39381 was elected leader, sending a full tablet report...
I20260923 17:18:08.113977 31335 consensus_queue.cc:260] T 2a4568f4fd74459aa973399b2447f643 P b25f964f1dcb4206a724023ed0ec5360 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8aebb4f23f4acca885b5b5cb450448" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42045 } } peers { permanent_uuid: "b25f964f1dcb4206a724023ed0ec5360" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 34145 } } peers { permanent_uuid: "69434171c0244baba23fdeac2eae0551" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 43171 } }
I20260923 17:18:08.114912 31335 ts_tablet_manager.cc:1428] T 2a4568f4fd74459aa973399b2447f643 P b25f964f1dcb4206a724023ed0ec5360: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20260923 17:18:08.115136 31317 heartbeater.cc:503] Master 127.11.229.190:39381 was elected leader, sending a full tablet report...
W20260923 17:18:08.153349 31056 tablet.cc:2369] T 2a4568f4fd74459aa973399b2447f643 P 69434171c0244baba23fdeac2eae0551: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 17:18:08.172066 31341 raft_consensus.cc:482] T 2a4568f4fd74459aa973399b2447f643 P be8aebb4f23f4acca885b5b5cb450448 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 17:18:08.172297 31341 raft_consensus.cc:504] T 2a4568f4fd74459aa973399b2447f643 P be8aebb4f23f4acca885b5b5cb450448 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8aebb4f23f4acca885b5b5cb450448" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42045 } } peers { permanent_uuid: "b25f964f1dcb4206a724023ed0ec5360" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 34145 } } peers { permanent_uuid: "69434171c0244baba23fdeac2eae0551" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 43171 } }
I20260923 17:18:08.173631 31341 leader_election.cc:288] T 2a4568f4fd74459aa973399b2447f643 P be8aebb4f23f4acca885b5b5cb450448 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b25f964f1dcb4206a724023ed0ec5360 (127.11.229.131:34145), 69434171c0244baba23fdeac2eae0551 (127.11.229.129:43171)
I20260923 17:18:08.178683 31188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:08.173888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.131:34145 (local address 127.11.229.130:46143)
0923 17:18:08.174059 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:08.174080 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:08.174316 (+ 236us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:08.174629 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:08.174633 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:08.174691 (+ 58us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:18:08.174858 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:08.174871 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:08.175938 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:08.175940 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:08.177310 (+ 1370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:08.177318 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:08.178166 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:08.178170 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:08.178319 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:08.178344 (+ 25us) client_negotiation.cc:769] Sending connection context
0923 17:18:08.178420 (+ 76us) client_negotiation.cc:240] Negotiation successful
0923 17:18:08.178516 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62,"mutex_wait_us":38,"spinlock_wait_cycles":27648}
I20260923 17:18:08.178750 31332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:08.174349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:54479 (local address 127.11.229.129:43171)
0923 17:18:08.174484 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:08.174488 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:08.174775 (+ 287us) server_negotiation.cc:407] Connection header received
0923 17:18:08.174829 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:08.174831 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:08.174872 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:08.174961 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:18:08.175211 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:08.175911 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:08.177459 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:08.178023 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:08.178155 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:08.178209 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:08.178539 (+ 330us) server_negotiation.cc:299] Negotiation successful
0923 17:18:08.178629 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260923 17:18:08.179075 31343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:08.174192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:43171 (local address 127.11.229.130:54479)
0923 17:18:08.174633 (+ 441us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:08.174646 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:08.174756 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:08.174970 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:08.174975 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:08.174992 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:18:08.175084 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:08.175088 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:08.176012 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:08.176015 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:08.177305 (+ 1290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:08.177318 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:08.178304 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:08.178307 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:08.178404 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:08.178431 (+ 27us) client_negotiation.cc:769] Sending connection context
0923 17:18:08.178871 (+ 440us) client_negotiation.cc:240] Negotiation successful
0923 17:18:08.178946 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":360,"mutex_wait_us":7,"spinlock_wait_cycles":384,"thread_start_us":132,"threads_started":1}
I20260923 17:18:08.179077 31333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:08.174027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:46143 (local address 127.11.229.131:34145)
0923 17:18:08.174204 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:08.174209 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:08.174249 (+ 40us) server_negotiation.cc:407] Connection header received
0923 17:18:08.174452 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:08.174456 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:08.174512 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:08.174588 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:18:08.174974 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:08.175801 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:08.177489 (+ 1688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:08.178009 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:08.178162 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:08.178211 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:08.178881 (+ 670us) server_negotiation.cc:299] Negotiation successful
0923 17:18:08.178957 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260923 17:18:08.179790 31271 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a4568f4fd74459aa973399b2447f643" candidate_uuid: "be8aebb4f23f4acca885b5b5cb450448" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f964f1dcb4206a724023ed0ec5360" is_pre_election: true
I20260923 17:18:08.180119 31271 raft_consensus.cc:2454] T 2a4568f4fd74459aa973399b2447f643 P b25f964f1dcb4206a724023ed0ec5360 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be8aebb4f23f4acca885b5b5cb450448 in term 0.
I20260923 17:18:08.180207 31009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a4568f4fd74459aa973399b2447f643" candidate_uuid: "be8aebb4f23f4acca885b5b5cb450448" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69434171c0244baba23fdeac2eae0551" is_pre_election: true
I20260923 17:18:08.180572 31009 raft_consensus.cc:2454] T 2a4568f4fd74459aa973399b2447f643 P 69434171c0244baba23fdeac2eae0551 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate be8aebb4f23f4acca885b5b5cb450448 in term 0.
I20260923 17:18:08.180645 31074 leader_election.cc:302] T 2a4568f4fd74459aa973399b2447f643 P be8aebb4f23f4acca885b5b5cb450448 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b25f964f1dcb4206a724023ed0ec5360, be8aebb4f23f4acca885b5b5cb450448; no voters:
I20260923 17:18:08.180989 31341 raft_consensus.cc:2781] T 2a4568f4fd74459aa973399b2447f643 P be8aebb4f23f4acca885b5b5cb450448 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 17:18:08.181087 31341 raft_consensus.cc:482] T 2a4568f4fd74459aa973399b2447f643 P be8aebb4f23f4acca885b5b5cb450448 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 17:18:08.181146 31341 raft_consensus.cc:3037] T 2a4568f4fd74459aa973399b2447f643 P be8aebb4f23f4acca885b5b5cb450448 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:18:08.182178 31341 raft_consensus.cc:504] T 2a4568f4fd74459aa973399b2447f643 P be8aebb4f23f4acca885b5b5cb450448 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8aebb4f23f4acca885b5b5cb450448" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42045 } } peers { permanent_uuid: "b25f964f1dcb4206a724023ed0ec5360" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 34145 } } peers { permanent_uuid: "69434171c0244baba23fdeac2eae0551" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 43171 } }
I20260923 17:18:08.182567 31341 leader_election.cc:288] T 2a4568f4fd74459aa973399b2447f643 P be8aebb4f23f4acca885b5b5cb450448 [CANDIDATE]: Term 1 election: Requested vote from peers b25f964f1dcb4206a724023ed0ec5360 (127.11.229.131:34145), 69434171c0244baba23fdeac2eae0551 (127.11.229.129:43171)
I20260923 17:18:08.183168 31271 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a4568f4fd74459aa973399b2447f643" candidate_uuid: "be8aebb4f23f4acca885b5b5cb450448" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b25f964f1dcb4206a724023ed0ec5360"
I20260923 17:18:08.183259 31009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a4568f4fd74459aa973399b2447f643" candidate_uuid: "be8aebb4f23f4acca885b5b5cb450448" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69434171c0244baba23fdeac2eae0551"
I20260923 17:18:08.183318 31271 raft_consensus.cc:3037] T 2a4568f4fd74459aa973399b2447f643 P b25f964f1dcb4206a724023ed0ec5360 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:18:08.183440 31009 raft_consensus.cc:3037] T 2a4568f4fd74459aa973399b2447f643 P 69434171c0244baba23fdeac2eae0551 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:18:08.184406 31271 raft_consensus.cc:2454] T 2a4568f4fd74459aa973399b2447f643 P b25f964f1dcb4206a724023ed0ec5360 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be8aebb4f23f4acca885b5b5cb450448 in term 1.
I20260923 17:18:08.184666 31009 raft_consensus.cc:2454] T 2a4568f4fd74459aa973399b2447f643 P 69434171c0244baba23fdeac2eae0551 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate be8aebb4f23f4acca885b5b5cb450448 in term 1.
I20260923 17:18:08.184762 31074 leader_election.cc:302] T 2a4568f4fd74459aa973399b2447f643 P be8aebb4f23f4acca885b5b5cb450448 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b25f964f1dcb4206a724023ed0ec5360, be8aebb4f23f4acca885b5b5cb450448; no voters:
I20260923 17:18:08.184952 31341 raft_consensus.cc:2781] T 2a4568f4fd74459aa973399b2447f643 P be8aebb4f23f4acca885b5b5cb450448 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:18:08.185202 31341 raft_consensus.cc:686] T 2a4568f4fd74459aa973399b2447f643 P be8aebb4f23f4acca885b5b5cb450448 [term 1 LEADER]: Becoming Leader. State: Replica: be8aebb4f23f4acca885b5b5cb450448, State: Running, Role: LEADER
I20260923 17:18:08.185567 31341 consensus_queue.cc:237] T 2a4568f4fd74459aa973399b2447f643 P be8aebb4f23f4acca885b5b5cb450448 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8aebb4f23f4acca885b5b5cb450448" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42045 } } peers { permanent_uuid: "b25f964f1dcb4206a724023ed0ec5360" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 34145 } } peers { permanent_uuid: "69434171c0244baba23fdeac2eae0551" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 43171 } }
I20260923 17:18:08.189000 30866 catalog_manager.cc:5495] T 2a4568f4fd74459aa973399b2447f643 P be8aebb4f23f4acca885b5b5cb450448 reported cstate change: term changed from 0 to 1, leader changed from <none> to be8aebb4f23f4acca885b5b5cb450448 (127.11.229.130). New cstate: current_term: 1 leader_uuid: "be8aebb4f23f4acca885b5b5cb450448" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "be8aebb4f23f4acca885b5b5cb450448" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 42045 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b25f964f1dcb4206a724023ed0ec5360" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 34145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "69434171c0244baba23fdeac2eae0551" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 43171 } health_report { overall_health: UNKNOWN } } }
I20260923 17:18:08.211719 31330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:08.207904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51188 (local address 127.11.229.130:42045)
0923 17:18:08.208042 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:08.208046 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:08.208058 (+ 12us) server_negotiation.cc:407] Connection header received
0923 17:18:08.208129 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:08.208131 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:08.208254 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:08.208352 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 17:18:08.208650 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:08.209217 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:08.210111 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:08.210356 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:08.210443 (+ 87us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:08.210760 (+ 317us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 17:18:08.211228 (+ 468us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 17:18:08.211344 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:08.211511 (+ 167us) server_negotiation.cc:299] Negotiation successful
0923 17:18:08.211546 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260923 17:18:08.218080 31009 raft_consensus.cc:1261] T 2a4568f4fd74459aa973399b2447f643 P 69434171c0244baba23fdeac2eae0551 [term 1 FOLLOWER]: Refusing update from remote peer be8aebb4f23f4acca885b5b5cb450448: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:18:08.218068 31271 raft_consensus.cc:1261] T 2a4568f4fd74459aa973399b2447f643 P b25f964f1dcb4206a724023ed0ec5360 [term 1 FOLLOWER]: Refusing update from remote peer be8aebb4f23f4acca885b5b5cb450448: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:18:08.218873 31341 consensus_queue.cc:1035] T 2a4568f4fd74459aa973399b2447f643 P be8aebb4f23f4acca885b5b5cb450448 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b25f964f1dcb4206a724023ed0ec5360" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 34145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:18:08.219095 31344 consensus_queue.cc:1035] T 2a4568f4fd74459aa973399b2447f643 P be8aebb4f23f4acca885b5b5cb450448 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69434171c0244baba23fdeac2eae0551" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 43171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:18:08.227140 31348 mvcc.cc:205] Tried to move back new op lower bound from 7332593206132924416 to 7332593206010896384. Current Snapshot: MvccSnapshot[applied={T|T < 7332593206132924416}]
I20260923 17:18:08.230574 31349 mvcc.cc:205] Tried to move back new op lower bound from 7332593206132924416 to 7332593206010896384. Current Snapshot: MvccSnapshot[applied={T|T < 7332593206132924416}]
I20260923 17:18:08.235353 30866 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35200:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:18:08.235519 30866 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35200:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:18:08.237911 30866 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 66868af7efaa445bbe8e9d6ba3bac3fb: Sending DeleteTablet for 3 replicas of tablet 2a4568f4fd74459aa973399b2447f643
I20260923 17:18:08.238826 31120 tablet_service.cc:1514] Processing DeleteTablet for tablet 2a4568f4fd74459aa973399b2447f643 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:18:08 UTC) from {username='slave'} at 127.0.0.1:51180
I20260923 17:18:08.238891 30989 tablet_service.cc:1514] Processing DeleteTablet for tablet 2a4568f4fd74459aa973399b2447f643 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:18:08 UTC) from {username='slave'} at 127.0.0.1:44464
I20260923 17:18:08.238921 31251 tablet_service.cc:1514] Processing DeleteTablet for tablet 2a4568f4fd74459aa973399b2447f643 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:18:08 UTC) from {username='slave'} at 127.0.0.1:49302
I20260923 17:18:08.239447 31358 tablet_replica.cc:330] T 2a4568f4fd74459aa973399b2447f643 P b25f964f1dcb4206a724023ed0ec5360: stopping tablet replica
I20260923 17:18:08.239815 31358 raft_consensus.cc:2229] T 2a4568f4fd74459aa973399b2447f643 P b25f964f1dcb4206a724023ed0ec5360 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:18:08.239885 31356 tablet_replica.cc:330] T 2a4568f4fd74459aa973399b2447f643 P be8aebb4f23f4acca885b5b5cb450448: stopping tablet replica
I20260923 17:18:08.240145 31356 raft_consensus.cc:2229] T 2a4568f4fd74459aa973399b2447f643 P be8aebb4f23f4acca885b5b5cb450448 [term 1 LEADER]: Raft consensus shutting down.
I20260923 17:18:08.240161 31358 raft_consensus.cc:2258] T 2a4568f4fd74459aa973399b2447f643 P b25f964f1dcb4206a724023ed0ec5360 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:18:08.240283 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 30927
I20260923 17:18:08.240530 31356 raft_consensus.cc:2258] T 2a4568f4fd74459aa973399b2447f643 P be8aebb4f23f4acca885b5b5cb450448 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:18:08.241911 31358 ts_tablet_manager.cc:1905] T 2a4568f4fd74459aa973399b2447f643 P b25f964f1dcb4206a724023ed0ec5360: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:18:08.242959 31356 ts_tablet_manager.cc:1905] T 2a4568f4fd74459aa973399b2447f643 P be8aebb4f23f4acca885b5b5cb450448: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:18:08.245023 31358 ts_tablet_manager.cc:1918] T 2a4568f4fd74459aa973399b2447f643 P b25f964f1dcb4206a724023ed0ec5360: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 17:18:08.245110 31358 log.cc:1196] T 2a4568f4fd74459aa973399b2447f643 P b25f964f1dcb4206a724023ed0ec5360: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-2/wal/wals/2a4568f4fd74459aa973399b2447f643
I20260923 17:18:08.245427 31358 ts_tablet_manager.cc:1939] T 2a4568f4fd74459aa973399b2447f643 P b25f964f1dcb4206a724023ed0ec5360: Deleting consensus metadata
I20260923 17:18:08.245927 31356 ts_tablet_manager.cc:1918] T 2a4568f4fd74459aa973399b2447f643 P be8aebb4f23f4acca885b5b5cb450448: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 17:18:08.246011 31356 log.cc:1196] T 2a4568f4fd74459aa973399b2447f643 P be8aebb4f23f4acca885b5b5cb450448: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790183633736342-12182-0/minicluster-data/ts-1/wal/wals/2a4568f4fd74459aa973399b2447f643
I20260923 17:18:08.246371 31356 ts_tablet_manager.cc:1939] T 2a4568f4fd74459aa973399b2447f643 P be8aebb4f23f4acca885b5b5cb450448: Deleting consensus metadata
I20260923 17:18:08.246860 30852 catalog_manager.cc:4841] TS b25f964f1dcb4206a724023ed0ec5360 (127.11.229.131:34145): tablet 2a4568f4fd74459aa973399b2447f643 (table test-table [id=fe6d5bb983bf43b19b7e73dcf283c0b8]) successfully deleted
I20260923 17:18:08.247511 30851 catalog_manager.cc:4841] TS be8aebb4f23f4acca885b5b5cb450448 (127.11.229.130:42045): tablet 2a4568f4fd74459aa973399b2447f643 (table test-table [id=fe6d5bb983bf43b19b7e73dcf283c0b8]) successfully deleted
W20260923 17:18:08.251848 30852 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.229.129:43171 (error 108)
I20260923 17:18:08.252673 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 31058
I20260923 17:18:08.252990 31329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:08.252660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:43171 (local address 127.0.0.1:44476)
0923 17:18:08.252807 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:08.252885 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.129:43171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260923 17:18:08.254135 30852 catalog_manager.cc:4584] TS 69434171c0244baba23fdeac2eae0551 (127.11.229.129:43171): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2a4568f4fd74459aa973399b2447f643: Network error: Client connection negotiation failed: client connection to 127.11.229.129:43171: connect: Connection refused (error 111)
I20260923 17:18:08.257817 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 31189
I20260923 17:18:08.263903 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 30836
2026-09-23T17:18:08Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1087 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 17:18:08 dist-test-slave-1x1f krb5kdc[31362](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 17:18:08 dist-test-slave-1x1f krb5kdc[31362](info): set up 2 sockets
Sep 23 17:18:08 dist-test-slave-1x1f krb5kdc[31362](info): commencing operation
krb5kdc: starting...
W20260923 17:18:09.326810 12182 mini_kdc.cc:121] Time spent starting KDC: real 1.041s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Sep 23 17:18:09 dist-test-slave-1x1f krb5kdc[31362](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183889, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T17:18:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:18:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.229.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
I20260923 17:18:09.449827 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:42963
--webserver_interface=127.11.229.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:34537
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:42963
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:18:09.560531 31375 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:18:09.560825 31375 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:18:09.560896 31375 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:18:09.564932 31375 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:18:09.565002 31375 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:18:09.565037 31375 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:18:09.565090 31375 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:18:09.565122 31375 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:18:09.570273 31375 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:34537
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:42963
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:42963
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.229.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31375
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:18:09.571302 31375 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:18:09.572288 31375 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:18:09.581205 31383 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:09.581127 31380 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:09.581117 31381 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:09.581408 31375 server_base.cc:1034] running on GCE node
I20260923 17:18:09.582194 31375 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:18:09.583366 31375 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:18:09.584574 31375 hybrid_clock.cc:648] HybridClock initialized: now 1790183889584545 us; error 49 us; skew 500 ppm
Sep 23 17:18:09 dist-test-slave-1x1f krb5kdc[31362](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183889, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:18:09.587467 31375 init.cc:377] Logged in from keytab as kudu/127.11.229.190@KRBTEST.COM (short username kudu)
I20260923 17:18:09.588343 31375 webserver.cc:460] Webserver started at http://127.11.229.190:44505/ using document root <none> and password file <none>
I20260923 17:18:09.588879 31375 fs_manager.cc:359] Metadata directory not provided
I20260923 17:18:09.588963 31375 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:18:09.589182 31375 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:18:09.591269 31375 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "299c30bdc4f847db878f7e584a36f9fb"
format_stamp: "Formatted at 2026-09-23 17:18:09 on dist-test-slave-1x1f"
server_key: "68e73fce8834b7e2b0b3b141835a54b8"
server_key_iv: "e6007557c8a3a82143c69df0fa6e4adb"
server_key_version: "encryptionkey@0"
I20260923 17:18:09.591812 31375 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "299c30bdc4f847db878f7e584a36f9fb"
format_stamp: "Formatted at 2026-09-23 17:18:09 on dist-test-slave-1x1f"
server_key: "68e73fce8834b7e2b0b3b141835a54b8"
server_key_iv: "e6007557c8a3a82143c69df0fa6e4adb"
server_key_version: "encryptionkey@0"
I20260923 17:18:09.595463 31375 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260923 17:18:09.597848 31390 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:09.599120 31375 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 17:18:09.599251 31375 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "299c30bdc4f847db878f7e584a36f9fb"
format_stamp: "Formatted at 2026-09-23 17:18:09 on dist-test-slave-1x1f"
server_key: "68e73fce8834b7e2b0b3b141835a54b8"
server_key_iv: "e6007557c8a3a82143c69df0fa6e4adb"
server_key_version: "encryptionkey@0"
I20260923 17:18:09.599359 31375 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:18:09.621469 31375 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:18:09.624317 31375 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:18:09.624505 31375 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:18:09.631678 31375 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.190:42963
I20260923 17:18:09.631695 31442 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.190:42963 every 8 connection(s)
I20260923 17:18:09.632607 31375 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:18:09.635531 31443 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:18:09.635839 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 31375
I20260923 17:18:09.635979 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:18:09.636343 12182 external_mini_cluster.cc:1428] Setting key 42cd15e4a21e9dc89a999b6ba9707e92
I20260923 17:18:09.642334 31443 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 299c30bdc4f847db878f7e584a36f9fb: Bootstrap starting.
I20260923 17:18:09.644837 31443 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 299c30bdc4f847db878f7e584a36f9fb: Neither blocks nor log segments found. Creating new log.
Sep 23 17:18:09 dist-test-slave-1x1f krb5kdc[31362](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183889, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:18:09.645658 31443 log.cc:824] T 00000000000000000000000000000000 P 299c30bdc4f847db878f7e584a36f9fb: Log is configured to *not* fsync() on all Append() calls
I20260923 17:18:09.647851 31443 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 299c30bdc4f847db878f7e584a36f9fb: No bootstrap required, opened a new log
I20260923 17:18:09.650301 31446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:09.637764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52908 (local address 127.11.229.190:42963)
0923 17:18:09.638312 (+ 548us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:09.638328 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:09.638360 (+ 32us) server_negotiation.cc:407] Connection header received
0923 17:18:09.639021 (+ 661us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:09.639036 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:09.639345 (+ 309us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:09.639662 (+ 317us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:09.640460 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:09.641426 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:09.642336 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:09.642851 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:09.643017 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:09.645611 (+ 2594us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:09.645616 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:09.645632 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:09.645659 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:09.647594 (+ 1935us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:09.648050 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:09.648056 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:09.648060 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:09.648166 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:09.648454 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:09.648458 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:09.648459 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:09.648841 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:09.649038 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:09.649299 (+ 261us) server_negotiation.cc:299] Negotiation successful
0923 17:18:09.649569 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":319,"thread_start_us":160,"threads_started":1}
I20260923 17:18:09.651803 31443 raft_consensus.cc:348] T 00000000000000000000000000000000 P 299c30bdc4f847db878f7e584a36f9fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "299c30bdc4f847db878f7e584a36f9fb" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 42963 } }
I20260923 17:18:09.652041 31443 raft_consensus.cc:374] T 00000000000000000000000000000000 P 299c30bdc4f847db878f7e584a36f9fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:18:09.652107 31443 raft_consensus.cc:729] T 00000000000000000000000000000000 P 299c30bdc4f847db878f7e584a36f9fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 299c30bdc4f847db878f7e584a36f9fb, State: Initialized, Role: FOLLOWER
I20260923 17:18:09.652585 31443 consensus_queue.cc:260] T 00000000000000000000000000000000 P 299c30bdc4f847db878f7e584a36f9fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "299c30bdc4f847db878f7e584a36f9fb" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 42963 } }
I20260923 17:18:09.652721 31443 raft_consensus.cc:388] T 00000000000000000000000000000000 P 299c30bdc4f847db878f7e584a36f9fb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:18:09.652773 31443 raft_consensus.cc:482] T 00000000000000000000000000000000 P 299c30bdc4f847db878f7e584a36f9fb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:18:09.652846 31443 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 299c30bdc4f847db878f7e584a36f9fb [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:18:09.653750 31443 raft_consensus.cc:504] T 00000000000000000000000000000000 P 299c30bdc4f847db878f7e584a36f9fb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "299c30bdc4f847db878f7e584a36f9fb" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 42963 } }
I20260923 17:18:09.654045 31443 leader_election.cc:302] T 00000000000000000000000000000000 P 299c30bdc4f847db878f7e584a36f9fb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 299c30bdc4f847db878f7e584a36f9fb; no voters:
I20260923 17:18:09.654358 31443 leader_election.cc:288] T 00000000000000000000000000000000 P 299c30bdc4f847db878f7e584a36f9fb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 17:18:09.654466 31448 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 299c30bdc4f847db878f7e584a36f9fb [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:18:09.654703 31448 raft_consensus.cc:686] T 00000000000000000000000000000000 P 299c30bdc4f847db878f7e584a36f9fb [term 1 LEADER]: Becoming Leader. State: Replica: 299c30bdc4f847db878f7e584a36f9fb, State: Running, Role: LEADER
I20260923 17:18:09.654989 31448 consensus_queue.cc:237] T 00000000000000000000000000000000 P 299c30bdc4f847db878f7e584a36f9fb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "299c30bdc4f847db878f7e584a36f9fb" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 42963 } }
I20260923 17:18:09.655599 31443 sys_catalog.cc:564] T 00000000000000000000000000000000 P 299c30bdc4f847db878f7e584a36f9fb [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:18:09.656708 31449 sys_catalog.cc:455] T 00000000000000000000000000000000 P 299c30bdc4f847db878f7e584a36f9fb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "299c30bdc4f847db878f7e584a36f9fb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "299c30bdc4f847db878f7e584a36f9fb" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 42963 } } }
I20260923 17:18:09.656832 31449 sys_catalog.cc:458] T 00000000000000000000000000000000 P 299c30bdc4f847db878f7e584a36f9fb [sys.catalog]: This master's current role is: LEADER
I20260923 17:18:09.657038 31450 sys_catalog.cc:455] T 00000000000000000000000000000000 P 299c30bdc4f847db878f7e584a36f9fb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 299c30bdc4f847db878f7e584a36f9fb. Latest consensus state: current_term: 1 leader_uuid: "299c30bdc4f847db878f7e584a36f9fb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "299c30bdc4f847db878f7e584a36f9fb" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 42963 } } }
I20260923 17:18:09.657130 31450 sys_catalog.cc:458] T 00000000000000000000000000000000 P 299c30bdc4f847db878f7e584a36f9fb [sys.catalog]: This master's current role is: LEADER
I20260923 17:18:09.657289 31457 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:18:09.660347 31457 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:18:09.665959 31457 catalog_manager.cc:1347] Generated new cluster ID: 412e8ef256624965b92fedce88309e5f
I20260923 17:18:09.666033 31457 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:18:09.683897 31457 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:18:09.684862 31457 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:18:09.691190 31457 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 299c30bdc4f847db878f7e584a36f9fb: Generated new TSK 0
I20260923 17:18:09.692184 31457 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.229.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab.
Entry for principal kudu/127.11.229.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab.
I20260923 17:18:09.729596 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.129:0
--local_ip_for_outbound_sockets=127.11.229.129
--webserver_interface=127.11.229.129
--webserver_port=0
--tserver_master_addrs=127.11.229.190:42963
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab
--principal=kudu/127.11.229.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:34537
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:18:09.841102 31469 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:18:09.841380 31469 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:18:09.841454 31469 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:18:09.845497 31469 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:18:09.845579 31469 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:18:09.845669 31469 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.129
I20260923 17:18:09.851354 31469 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:34537
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.129.keytab
--principal=kudu/127.11.229.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.229.129
--webserver_port=0
--tserver_master_addrs=127.11.229.190:42963
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31469
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.129
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:18:09.852504 31469 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:18:09.853564 31469 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:18:09.864270 31475 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:09.864281 31474 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:09.864277 31477 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:09.864431 31469 server_base.cc:1034] running on GCE node
I20260923 17:18:09.864861 31469 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:18:09.865479 31469 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:18:09.866655 31469 hybrid_clock.cc:648] HybridClock initialized: now 1790183889866618 us; error 51 us; skew 500 ppm
Sep 23 17:18:09 dist-test-slave-1x1f krb5kdc[31362](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183889, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:18:09.869280 31469 init.cc:377] Logged in from keytab as kudu/127.11.229.129@KRBTEST.COM (short username kudu)
I20260923 17:18:09.870097 31469 webserver.cc:460] Webserver started at http://127.11.229.129:40085/ using document root <none> and password file <none>
I20260923 17:18:09.870651 31469 fs_manager.cc:359] Metadata directory not provided
I20260923 17:18:09.870712 31469 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:18:09.870865 31469 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:18:09.872749 31469 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-0/data/instance:
uuid: "45858edf7940484380be4fa6466421c0"
format_stamp: "Formatted at 2026-09-23 17:18:09 on dist-test-slave-1x1f"
server_key: "7a42e357605a778c4737610b3e8c465a"
server_key_iv: "55effddec8e24834d93ffb422a448e4c"
server_key_version: "encryptionkey@0"
I20260923 17:18:09.873231 31469 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance:
uuid: "45858edf7940484380be4fa6466421c0"
format_stamp: "Formatted at 2026-09-23 17:18:09 on dist-test-slave-1x1f"
server_key: "7a42e357605a778c4737610b3e8c465a"
server_key_iv: "55effddec8e24834d93ffb422a448e4c"
server_key_version: "encryptionkey@0"
I20260923 17:18:09.876914 31469 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260923 17:18:09.879179 31484 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:09.880360 31469 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 17:18:09.880455 31469 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-0/wal
uuid: "45858edf7940484380be4fa6466421c0"
format_stamp: "Formatted at 2026-09-23 17:18:09 on dist-test-slave-1x1f"
server_key: "7a42e357605a778c4737610b3e8c465a"
server_key_iv: "55effddec8e24834d93ffb422a448e4c"
server_key_version: "encryptionkey@0"
I20260923 17:18:09.880534 31469 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:18:09.896111 31469 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:18:09.899035 31469 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:18:09.899192 31469 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:18:09.899696 31469 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:18:09.900457 31469 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:18:09.900501 31469 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:09.900542 31469 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:18:09.900556 31469 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:09.909797 31469 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.129:43189
I20260923 17:18:09.909817 31597 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.129:43189 every 8 connection(s)
I20260923 17:18:09.910786 31469 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
I20260923 17:18:09.916409 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 31469
I20260923 17:18:09.916563 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance
I20260923 17:18:09.916895 12182 external_mini_cluster.cc:1428] Setting key 5068c97d4a705da66d1d4b2114a66c70
Sep 23 17:18:09 dist-test-slave-1x1f krb5kdc[31362](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183889, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.129@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:18:09.925679 31446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:09.912562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:59815 (local address 127.11.229.190:42963)
0923 17:18:09.912691 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:09.912694 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:09.913518 (+ 824us) server_negotiation.cc:407] Connection header received
0923 17:18:09.914841 (+ 1323us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:09.914845 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:09.914894 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:09.914973 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:09.916034 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:09.916954 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:09.918203 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:09.918539 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:09.918666 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:09.921482 (+ 2816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:09.921485 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:09.921487 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:09.921510 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:09.923102 (+ 1592us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:09.923861 (+ 759us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:09.923864 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:09.923865 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:09.923943 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:09.924425 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:09.924428 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:09.924429 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:09.924630 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:09.924717 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:09.925436 (+ 719us) server_negotiation.cc:299] Negotiation successful
0923 17:18:09.925558 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260923 17:18:09.927024 31600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:09.912934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:42963 (local address 127.11.229.129:59815)
0923 17:18:09.913366 (+ 432us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:09.913407 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:09.914632 (+ 1225us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:09.915099 (+ 467us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:09.915104 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:09.915450 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:18:09.915894 (+ 444us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:09.915906 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:09.917076 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:09.917078 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:09.918040 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:09.918049 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:09.918715 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:09.918718 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:09.918861 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:09.919499 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:18:09.919516 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:18:09.921308 (+ 1792us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:18:09.923288 (+ 1980us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:09.923299 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:09.923327 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:09.923749 (+ 422us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:09.924053 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:09.924060 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:09.924063 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:09.924286 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:09.924766 (+ 480us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:18:09.924775 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:18:09.925144 (+ 369us) client_negotiation.cc:769] Sending connection context
0923 17:18:09.925385 (+ 241us) client_negotiation.cc:240] Negotiation successful
0923 17:18:09.925783 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":120,"threads_started":1}
WARNING: no policy specified for kudu/127.11.229.130@KRBTEST.COM; defaulting to no policy
I20260923 17:18:09.928436 31598 heartbeater.cc:347] Connected to a master server at 127.11.229.190:42963
I20260923 17:18:09.928691 31598 heartbeater.cc:464] Registering TS with master...
I20260923 17:18:09.929172 31598 heartbeater.cc:511] Master 127.11.229.190:42963 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.130@KRBTEST.COM" created.
I20260923 17:18:09.930837 31407 ts_manager.cc:194] Registered new tserver with Master: 45858edf7940484380be4fa6466421c0 (127.11.229.129:43189)
I20260923 17:18:09.932238 31407 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.129@KRBTEST.COM'} at 127.11.229.129:59815
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab.
Entry for principal kudu/127.11.229.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab.
I20260923 17:18:09.946384 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.130:0
--local_ip_for_outbound_sockets=127.11.229.130
--webserver_interface=127.11.229.130
--webserver_port=0
--tserver_master_addrs=127.11.229.190:42963
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab
--principal=kudu/127.11.229.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:34537
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:18:10.061417 31603 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:18:10.061659 31603 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:18:10.061733 31603 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:18:10.065703 31603 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:18:10.065758 31603 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:18:10.065881 31603 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.130
I20260923 17:18:10.071197 31603 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:34537
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.130.keytab
--principal=kudu/127.11.229.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.229.130
--webserver_port=0
--tserver_master_addrs=127.11.229.190:42963
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31603
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.130
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:18:10.072238 31603 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:18:10.073218 31603 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:18:10.082504 31609 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:10.082513 31611 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:10.082648 31603 server_base.cc:1034] running on GCE node
W20260923 17:18:10.082515 31608 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:10.083128 31603 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:18:10.083719 31603 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:18:10.084893 31603 hybrid_clock.cc:648] HybridClock initialized: now 1790183890084868 us; error 55 us; skew 500 ppm
Sep 23 17:18:10 dist-test-slave-1x1f krb5kdc[31362](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183890, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:18:10.087831 31603 init.cc:377] Logged in from keytab as kudu/127.11.229.130@KRBTEST.COM (short username kudu)
I20260923 17:18:10.088686 31603 webserver.cc:460] Webserver started at http://127.11.229.130:44933/ using document root <none> and password file <none>
I20260923 17:18:10.089188 31603 fs_manager.cc:359] Metadata directory not provided
I20260923 17:18:10.089252 31603 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:18:10.089409 31603 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:18:10.091394 31603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-1/data/instance:
uuid: "1ab9cbefc9a5458d9803d25946f5969d"
format_stamp: "Formatted at 2026-09-23 17:18:10 on dist-test-slave-1x1f"
server_key: "cb2807eacd59ae1483b7abc4d0a6acb2"
server_key_iv: "7d7bb94c525cfc81087d5e2a139a1142"
server_key_version: "encryptionkey@0"
I20260923 17:18:10.091914 31603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance:
uuid: "1ab9cbefc9a5458d9803d25946f5969d"
format_stamp: "Formatted at 2026-09-23 17:18:10 on dist-test-slave-1x1f"
server_key: "cb2807eacd59ae1483b7abc4d0a6acb2"
server_key_iv: "7d7bb94c525cfc81087d5e2a139a1142"
server_key_version: "encryptionkey@0"
I20260923 17:18:10.095603 31603 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260923 17:18:10.097823 31618 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:10.099035 31603 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 17:18:10.099129 31603 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-1/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-1/wal
uuid: "1ab9cbefc9a5458d9803d25946f5969d"
format_stamp: "Formatted at 2026-09-23 17:18:10 on dist-test-slave-1x1f"
server_key: "cb2807eacd59ae1483b7abc4d0a6acb2"
server_key_iv: "7d7bb94c525cfc81087d5e2a139a1142"
server_key_version: "encryptionkey@0"
I20260923 17:18:10.099247 31603 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:18:10.121402 31603 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:18:10.124599 31603 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:18:10.124753 31603 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:18:10.125279 31603 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:18:10.126044 31603 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:18:10.126089 31603 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:10.126129 31603 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:18:10.126150 31603 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:10.135128 31603 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.130:44771
I20260923 17:18:10.135152 31731 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.130:44771 every 8 connection(s)
I20260923 17:18:10.136055 31603 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
I20260923 17:18:10.143610 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 31603
I20260923 17:18:10.143790 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance
I20260923 17:18:10.144182 12182 external_mini_cluster.cc:1428] Setting key e1022dc0e773843ea99d81eefa8c8698
Sep 23 17:18:10 dist-test-slave-1x1f krb5kdc[31362](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183890, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.130@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:18:10.149443 31446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:10.137820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:45983 (local address 127.11.229.190:42963)
0923 17:18:10.137989 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:10.137994 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:10.138820 (+ 826us) server_negotiation.cc:407] Connection header received
0923 17:18:10.140040 (+ 1220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:10.140043 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:10.140088 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:10.140162 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:10.141251 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:10.141817 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:10.143019 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:10.143355 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:10.143495 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:10.146004 (+ 2509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:10.146007 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:10.146009 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:10.146032 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:10.147524 (+ 1492us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:10.148018 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:10.148023 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:10.148025 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:10.148101 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:10.148418 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:10.148423 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:10.148424 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:10.148602 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:10.148711 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:10.149172 (+ 461us) server_negotiation.cc:299] Negotiation successful
0923 17:18:10.149290 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260923 17:18:10.150450 31734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:10.138188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:42963 (local address 127.11.229.130:45983)
0923 17:18:10.138674 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:10.138715 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:10.139851 (+ 1136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:10.140315 (+ 464us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:10.140321 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:10.140641 (+ 320us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:18:10.141106 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:10.141119 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:10.141934 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:10.141937 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:10.142892 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:10.142902 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:10.143505 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:10.143507 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:10.143637 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:10.144362 (+ 725us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:18:10.144377 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:18:10.145848 (+ 1471us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:18:10.147653 (+ 1805us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:10.147659 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:10.147674 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:10.147921 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:10.148193 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:10.148197 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:10.148199 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:10.148330 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:10.148710 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:18:10.148716 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:18:10.148952 (+ 236us) client_negotiation.cc:769] Sending connection context
0923 17:18:10.149130 (+ 178us) client_negotiation.cc:240] Negotiation successful
0923 17:18:10.149446 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"thread_start_us":107,"threads_started":1}
I20260923 17:18:10.151808 31732 heartbeater.cc:347] Connected to a master server at 127.11.229.190:42963
I20260923 17:18:10.152033 31732 heartbeater.cc:464] Registering TS with master...
I20260923 17:18:10.152522 31732 heartbeater.cc:511] Master 127.11.229.190:42963 requested a full tablet report, sending...
I20260923 17:18:10.153610 31407 ts_manager.cc:194] Registered new tserver with Master: 1ab9cbefc9a5458d9803d25946f5969d (127.11.229.130:44771)
WARNING: no policy specified for kudu/127.11.229.131@KRBTEST.COM; defaulting to no policy
I20260923 17:18:10.154573 31407 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.130@KRBTEST.COM'} at 127.11.229.130:45983
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab.
Entry for principal kudu/127.11.229.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab.
I20260923 17:18:10.173945 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.131:0
--local_ip_for_outbound_sockets=127.11.229.131
--webserver_interface=127.11.229.131
--webserver_port=0
--tserver_master_addrs=127.11.229.190:42963
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab
--principal=kudu/127.11.229.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:34537
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:18:10.290870 31737 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:18:10.291114 31737 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:18:10.291224 31737 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:18:10.295383 31737 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:18:10.295437 31737 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:18:10.295495 31737 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.131
I20260923 17:18:10.300612 31737 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:34537
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.131.keytab
--principal=kudu/127.11.229.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.229.131
--webserver_port=0
--tserver_master_addrs=127.11.229.190:42963
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31737
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.131
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:18:10.301548 31737 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:18:10.302634 31737 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:18:10.312369 31745 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:10.312353 31742 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:10.312393 31737 server_base.cc:1034] running on GCE node
W20260923 17:18:10.312347 31743 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:10.313019 31737 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:18:10.313632 31737 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:18:10.314824 31737 hybrid_clock.cc:648] HybridClock initialized: now 1790183890314804 us; error 33 us; skew 500 ppm
Sep 23 17:18:10 dist-test-slave-1x1f krb5kdc[31362](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183890, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:18:10.317745 31737 init.cc:377] Logged in from keytab as kudu/127.11.229.131@KRBTEST.COM (short username kudu)
I20260923 17:18:10.318710 31737 webserver.cc:460] Webserver started at http://127.11.229.131:36799/ using document root <none> and password file <none>
I20260923 17:18:10.319291 31737 fs_manager.cc:359] Metadata directory not provided
I20260923 17:18:10.319386 31737 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:18:10.319625 31737 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:18:10.321730 31737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-2/data/instance:
uuid: "4ab16012ad464e508f726043f2d54625"
format_stamp: "Formatted at 2026-09-23 17:18:10 on dist-test-slave-1x1f"
server_key: "c673d384643249e923053647363240ea"
server_key_iv: "d286a3a91d0c8adc3888fe8869c51ee2"
server_key_version: "encryptionkey@0"
I20260923 17:18:10.322373 31737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance:
uuid: "4ab16012ad464e508f726043f2d54625"
format_stamp: "Formatted at 2026-09-23 17:18:10 on dist-test-slave-1x1f"
server_key: "c673d384643249e923053647363240ea"
server_key_iv: "d286a3a91d0c8adc3888fe8869c51ee2"
server_key_version: "encryptionkey@0"
I20260923 17:18:10.326116 31737 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260923 17:18:10.328603 31752 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:10.329965 31737 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 17:18:10.330108 31737 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-2/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-2/wal
uuid: "4ab16012ad464e508f726043f2d54625"
format_stamp: "Formatted at 2026-09-23 17:18:10 on dist-test-slave-1x1f"
server_key: "c673d384643249e923053647363240ea"
server_key_iv: "d286a3a91d0c8adc3888fe8869c51ee2"
server_key_version: "encryptionkey@0"
I20260923 17:18:10.330224 31737 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:18:10.350550 31737 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:18:10.353519 31737 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:18:10.353739 31737 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:18:10.354383 31737 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:18:10.355280 31737 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:18:10.355353 31737 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:10.355427 31737 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:18:10.355476 31737 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:10.365051 31737 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.131:38829
I20260923 17:18:10.365065 31865 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.131:38829 every 8 connection(s)
I20260923 17:18:10.365949 31737 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
I20260923 17:18:10.370383 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 31737
I20260923 17:18:10.370524 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance
I20260923 17:18:10.370834 12182 external_mini_cluster.cc:1428] Setting key ec59f9ae4e1863c3092f1c6d1c186ac0
Sep 23 17:18:10 dist-test-slave-1x1f krb5kdc[31362](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183890, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.131@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:18:10.380040 31446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:10.367793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:52909 (local address 127.11.229.190:42963)
0923 17:18:10.367958 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:10.367963 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:10.368777 (+ 814us) server_negotiation.cc:407] Connection header received
0923 17:18:10.370075 (+ 1298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:10.370078 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:10.370155 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:10.370276 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:10.371828 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:10.372506 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:10.373811 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:10.374025 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:10.374101 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:10.376758 (+ 2657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:10.376761 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:10.376763 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:10.376787 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:10.378183 (+ 1396us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:10.378744 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:10.378747 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:10.378749 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:10.378841 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:10.379158 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:10.379161 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:10.379162 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:10.379323 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:10.379396 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:10.379838 (+ 442us) server_negotiation.cc:299] Negotiation successful
0923 17:18:10.379926 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260923 17:18:10.380925 31868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:10.368105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:42963 (local address 127.11.229.131:52909)
0923 17:18:10.368622 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:10.368666 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:10.369876 (+ 1210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:10.370538 (+ 662us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:10.370546 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:10.371013 (+ 467us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:18:10.371646 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:10.371682 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:10.372636 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:10.372639 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:10.373687 (+ 1048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:10.373698 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:10.374195 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:10.374199 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:10.374488 (+ 289us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:10.375112 (+ 624us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:18:10.375129 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:18:10.376613 (+ 1484us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:18:10.378343 (+ 1730us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:10.378348 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:10.378359 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:10.378625 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:10.378936 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:10.378939 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:10.378940 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:10.379079 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:10.379406 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:18:10.379411 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:18:10.379642 (+ 231us) client_negotiation.cc:769] Sending connection context
0923 17:18:10.379801 (+ 159us) client_negotiation.cc:240] Negotiation successful
0923 17:18:10.380129 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":304,"thread_start_us":116,"threads_started":1}
I20260923 17:18:10.381973 31866 heartbeater.cc:347] Connected to a master server at 127.11.229.190:42963
I20260923 17:18:10.382215 31866 heartbeater.cc:464] Registering TS with master...
I20260923 17:18:10.382733 31866 heartbeater.cc:511] Master 127.11.229.190:42963 requested a full tablet report, sending...
I20260923 17:18:10.383769 31406 ts_manager.cc:194] Registered new tserver with Master: 4ab16012ad464e508f726043f2d54625 (127.11.229.131:38829)
I20260923 17:18:10.384449 31406 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.229.131@KRBTEST.COM'} at 127.11.229.131:52909
I20260923 17:18:10.384697 12182 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 17:18:10.394837 31446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:10.386979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52922 (local address 127.11.229.190:42963)
0923 17:18:10.387121 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:10.387125 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:10.387271 (+ 146us) server_negotiation.cc:407] Connection header received
0923 17:18:10.387394 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:10.387397 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:10.387436 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:10.387521 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:10.388171 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:10.388672 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:10.389499 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:10.389731 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:10.389831 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:10.391147 (+ 1316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:10.391150 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:10.391153 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:10.391176 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:10.392936 (+ 1760us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:10.393430 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:10.393435 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:10.393437 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:10.393526 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:10.393826 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:10.393831 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:10.393833 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:10.394072 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:10.394302 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:10.394548 (+ 246us) server_negotiation.cc:299] Negotiation successful
0923 17:18:10.394668 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260923 17:18:10.397665 31406 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52922:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 17:18:10.400803 31406 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 17:18:10.415876 31877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:10.410344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.130:44771 (local address 127.0.0.1:41800)
0923 17:18:10.410678 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:10.410731 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:10.410870 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:10.411625 (+ 755us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:10.411629 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:10.411646 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:18:10.411752 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:10.411759 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:10.413237 (+ 1478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:10.413241 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:10.414415 (+ 1174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:10.414424 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:10.415421 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:10.415424 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:10.415499 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:10.415529 (+ 30us) client_negotiation.cc:769] Sending connection context
0923 17:18:10.415606 (+ 77us) client_negotiation.cc:240] Negotiation successful
0923 17:18:10.415701 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":223,"mutex_wait_us":86,"spinlock_wait_cycles":3200,"thread_start_us":92,"threads_started":1}
I20260923 17:18:10.415900 31882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:10.410485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41800 (local address 127.11.229.130:44771)
0923 17:18:10.411161 (+ 676us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:10.411173 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:10.411196 (+ 23us) server_negotiation.cc:407] Connection header received
0923 17:18:10.411270 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:10.411275 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:10.411453 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:10.411645 (+ 192us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:18:10.411882 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:10.413031 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:10.414530 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:10.415310 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:10.415437 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:10.415563 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:10.415653 (+ 90us) server_negotiation.cc:299] Negotiation successful
0923 17:18:10.415762 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":572,"thread_start_us":132,"threads_started":1}
I20260923 17:18:10.416311 31880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:10.409981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57224 (local address 127.11.229.129:43189)
0923 17:18:10.410399 (+ 418us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:10.410412 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:10.411167 (+ 755us) server_negotiation.cc:407] Connection header received
0923 17:18:10.411272 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:10.411277 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:10.411444 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:10.411567 (+ 123us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:18:10.412034 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:10.412759 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:10.414837 (+ 2078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:10.415680 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:10.415799 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:10.415908 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:10.416091 (+ 183us) server_negotiation.cc:299] Negotiation successful
0923 17:18:10.416184 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":316,"thread_start_us":125,"threads_started":1}
I20260923 17:18:10.416712 31881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:10.409580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:43189 (local address 127.0.0.1:57224)
0923 17:18:10.411036 (+ 1456us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:10.411049 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:10.411161 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:10.411810 (+ 649us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:10.411815 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:10.411837 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:18:10.411929 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:10.411934 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:10.412888 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:10.412894 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:10.414704 (+ 1810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:10.414715 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:10.415800 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:10.415803 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:10.415902 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:10.415934 (+ 32us) client_negotiation.cc:769] Sending connection context
0923 17:18:10.416507 (+ 573us) client_negotiation.cc:240] Negotiation successful
0923 17:18:10.416588 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":975,"mutex_wait_us":243,"thread_start_us":96,"threads_started":1}
I20260923 17:18:10.417238 31878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:10.409561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.131:38829 (local address 127.0.0.1:39280)
0923 17:18:10.410678 (+ 1117us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:10.410731 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:10.410870 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:10.411440 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:10.411446 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:10.411470 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:18:10.411629 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:10.411637 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:10.413204 (+ 1567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:10.413210 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:10.414709 (+ 1499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:10.414715 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:10.416962 (+ 2247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:10.416965 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:10.417039 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:10.417056 (+ 17us) client_negotiation.cc:769] Sending connection context
0923 17:18:10.417099 (+ 43us) client_negotiation.cc:240] Negotiation successful
0923 17:18:10.417143 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":933,"mutex_wait_us":137,"spinlock_wait_cycles":7040,"thread_start_us":97,"threads_started":1}
I20260923 17:18:10.417351 31879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:10.409706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39280 (local address 127.11.229.131:38829)
0923 17:18:10.410423 (+ 717us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:10.410435 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:10.410823 (+ 388us) server_negotiation.cc:407] Connection header received
0923 17:18:10.411035 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:10.411041 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:10.411274 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:10.411430 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:18:10.411765 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:10.413031 (+ 1266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:10.415973 (+ 2942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:10.416845 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:10.416963 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:10.417074 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:10.417140 (+ 66us) server_negotiation.cc:299] Negotiation successful
0923 17:18:10.417220 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":628,"thread_start_us":162,"threads_started":1}
I20260923 17:18:10.419669 31532 tablet_service.cc:1467] Processing CreateTablet for tablet 78663a807e884c9faea6e0a84b761c8a (DEFAULT_TABLE table=test-table [id=c2e55d0fa09d4a19b85fa57a513b05c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:18:10.419679 31666 tablet_service.cc:1467] Processing CreateTablet for tablet 78663a807e884c9faea6e0a84b761c8a (DEFAULT_TABLE table=test-table [id=c2e55d0fa09d4a19b85fa57a513b05c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:18:10.419800 31800 tablet_service.cc:1467] Processing CreateTablet for tablet 78663a807e884c9faea6e0a84b761c8a (DEFAULT_TABLE table=test-table [id=c2e55d0fa09d4a19b85fa57a513b05c4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:18:10.420619 31532 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78663a807e884c9faea6e0a84b761c8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:18:10.420640 31666 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78663a807e884c9faea6e0a84b761c8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:18:10.420640 31800 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78663a807e884c9faea6e0a84b761c8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:18:10.426403 31883 tablet_bootstrap.cc:492] T 78663a807e884c9faea6e0a84b761c8a P 45858edf7940484380be4fa6466421c0: Bootstrap starting.
I20260923 17:18:10.427955 31885 tablet_bootstrap.cc:492] T 78663a807e884c9faea6e0a84b761c8a P 4ab16012ad464e508f726043f2d54625: Bootstrap starting.
I20260923 17:18:10.428810 31883 tablet_bootstrap.cc:654] T 78663a807e884c9faea6e0a84b761c8a P 45858edf7940484380be4fa6466421c0: Neither blocks nor log segments found. Creating new log.
I20260923 17:18:10.429673 31883 log.cc:824] T 78663a807e884c9faea6e0a84b761c8a P 45858edf7940484380be4fa6466421c0: Log is configured to *not* fsync() on all Append() calls
I20260923 17:18:10.430020 31885 tablet_bootstrap.cc:654] T 78663a807e884c9faea6e0a84b761c8a P 4ab16012ad464e508f726043f2d54625: Neither blocks nor log segments found. Creating new log.
I20260923 17:18:10.430397 31884 tablet_bootstrap.cc:492] T 78663a807e884c9faea6e0a84b761c8a P 1ab9cbefc9a5458d9803d25946f5969d: Bootstrap starting.
I20260923 17:18:10.431316 31885 log.cc:824] T 78663a807e884c9faea6e0a84b761c8a P 4ab16012ad464e508f726043f2d54625: Log is configured to *not* fsync() on all Append() calls
I20260923 17:18:10.431519 31883 tablet_bootstrap.cc:492] T 78663a807e884c9faea6e0a84b761c8a P 45858edf7940484380be4fa6466421c0: No bootstrap required, opened a new log
I20260923 17:18:10.431717 31883 ts_tablet_manager.cc:1397] T 78663a807e884c9faea6e0a84b761c8a P 45858edf7940484380be4fa6466421c0: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260923 17:18:10.432483 31884 tablet_bootstrap.cc:654] T 78663a807e884c9faea6e0a84b761c8a P 1ab9cbefc9a5458d9803d25946f5969d: Neither blocks nor log segments found. Creating new log.
I20260923 17:18:10.433308 31885 tablet_bootstrap.cc:492] T 78663a807e884c9faea6e0a84b761c8a P 4ab16012ad464e508f726043f2d54625: No bootstrap required, opened a new log
I20260923 17:18:10.433485 31885 ts_tablet_manager.cc:1397] T 78663a807e884c9faea6e0a84b761c8a P 4ab16012ad464e508f726043f2d54625: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260923 17:18:10.433813 31884 log.cc:824] T 78663a807e884c9faea6e0a84b761c8a P 1ab9cbefc9a5458d9803d25946f5969d: Log is configured to *not* fsync() on all Append() calls
I20260923 17:18:10.435848 31884 tablet_bootstrap.cc:492] T 78663a807e884c9faea6e0a84b761c8a P 1ab9cbefc9a5458d9803d25946f5969d: No bootstrap required, opened a new log
I20260923 17:18:10.435698 31883 raft_consensus.cc:348] T 78663a807e884c9faea6e0a84b761c8a P 45858edf7940484380be4fa6466421c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ab16012ad464e508f726043f2d54625" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38829 } } peers { permanent_uuid: "45858edf7940484380be4fa6466421c0" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 43189 } } peers { permanent_uuid: "1ab9cbefc9a5458d9803d25946f5969d" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44771 } }
I20260923 17:18:10.435948 31883 raft_consensus.cc:374] T 78663a807e884c9faea6e0a84b761c8a P 45858edf7940484380be4fa6466421c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:18:10.436029 31884 ts_tablet_manager.cc:1397] T 78663a807e884c9faea6e0a84b761c8a P 1ab9cbefc9a5458d9803d25946f5969d: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260923 17:18:10.436035 31883 raft_consensus.cc:729] T 78663a807e884c9faea6e0a84b761c8a P 45858edf7940484380be4fa6466421c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45858edf7940484380be4fa6466421c0, State: Initialized, Role: FOLLOWER
I20260923 17:18:10.436494 31883 consensus_queue.cc:260] T 78663a807e884c9faea6e0a84b761c8a P 45858edf7940484380be4fa6466421c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ab16012ad464e508f726043f2d54625" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38829 } } peers { permanent_uuid: "45858edf7940484380be4fa6466421c0" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 43189 } } peers { permanent_uuid: "1ab9cbefc9a5458d9803d25946f5969d" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44771 } }
I20260923 17:18:10.437139 31598 heartbeater.cc:503] Master 127.11.229.190:42963 was elected leader, sending a full tablet report...
I20260923 17:18:10.437013 31885 raft_consensus.cc:348] T 78663a807e884c9faea6e0a84b761c8a P 4ab16012ad464e508f726043f2d54625 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ab16012ad464e508f726043f2d54625" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38829 } } peers { permanent_uuid: "45858edf7940484380be4fa6466421c0" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 43189 } } peers { permanent_uuid: "1ab9cbefc9a5458d9803d25946f5969d" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44771 } }
I20260923 17:18:10.437249 31885 raft_consensus.cc:374] T 78663a807e884c9faea6e0a84b761c8a P 4ab16012ad464e508f726043f2d54625 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:18:10.437292 31885 raft_consensus.cc:729] T 78663a807e884c9faea6e0a84b761c8a P 4ab16012ad464e508f726043f2d54625 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ab16012ad464e508f726043f2d54625, State: Initialized, Role: FOLLOWER
I20260923 17:18:10.437470 31883 ts_tablet_manager.cc:1428] T 78663a807e884c9faea6e0a84b761c8a P 45858edf7940484380be4fa6466421c0: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260923 17:18:10.437697 31885 consensus_queue.cc:260] T 78663a807e884c9faea6e0a84b761c8a P 4ab16012ad464e508f726043f2d54625 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ab16012ad464e508f726043f2d54625" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38829 } } peers { permanent_uuid: "45858edf7940484380be4fa6466421c0" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 43189 } } peers { permanent_uuid: "1ab9cbefc9a5458d9803d25946f5969d" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44771 } }
I20260923 17:18:10.438342 31866 heartbeater.cc:503] Master 127.11.229.190:42963 was elected leader, sending a full tablet report...
I20260923 17:18:10.438612 31885 ts_tablet_manager.cc:1428] T 78663a807e884c9faea6e0a84b761c8a P 4ab16012ad464e508f726043f2d54625: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260923 17:18:10.439680 31884 raft_consensus.cc:348] T 78663a807e884c9faea6e0a84b761c8a P 1ab9cbefc9a5458d9803d25946f5969d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ab16012ad464e508f726043f2d54625" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38829 } } peers { permanent_uuid: "45858edf7940484380be4fa6466421c0" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 43189 } } peers { permanent_uuid: "1ab9cbefc9a5458d9803d25946f5969d" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44771 } }
I20260923 17:18:10.439935 31884 raft_consensus.cc:374] T 78663a807e884c9faea6e0a84b761c8a P 1ab9cbefc9a5458d9803d25946f5969d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:18:10.440026 31884 raft_consensus.cc:729] T 78663a807e884c9faea6e0a84b761c8a P 1ab9cbefc9a5458d9803d25946f5969d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ab9cbefc9a5458d9803d25946f5969d, State: Initialized, Role: FOLLOWER
I20260923 17:18:10.440734 31884 consensus_queue.cc:260] T 78663a807e884c9faea6e0a84b761c8a P 1ab9cbefc9a5458d9803d25946f5969d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ab16012ad464e508f726043f2d54625" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38829 } } peers { permanent_uuid: "45858edf7940484380be4fa6466421c0" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 43189 } } peers { permanent_uuid: "1ab9cbefc9a5458d9803d25946f5969d" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44771 } }
I20260923 17:18:10.441541 31732 heartbeater.cc:503] Master 127.11.229.190:42963 was elected leader, sending a full tablet report...
I20260923 17:18:10.441708 31884 ts_tablet_manager.cc:1428] T 78663a807e884c9faea6e0a84b761c8a P 1ab9cbefc9a5458d9803d25946f5969d: Time spent starting tablet: real 0.006s user 0.003s sys 0.003s
I20260923 17:18:10.613466 31891 raft_consensus.cc:482] T 78663a807e884c9faea6e0a84b761c8a P 1ab9cbefc9a5458d9803d25946f5969d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 17:18:10.613686 31891 raft_consensus.cc:504] T 78663a807e884c9faea6e0a84b761c8a P 1ab9cbefc9a5458d9803d25946f5969d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ab16012ad464e508f726043f2d54625" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38829 } } peers { permanent_uuid: "45858edf7940484380be4fa6466421c0" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 43189 } } peers { permanent_uuid: "1ab9cbefc9a5458d9803d25946f5969d" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44771 } }
I20260923 17:18:10.615149 31891 leader_election.cc:288] T 78663a807e884c9faea6e0a84b761c8a P 1ab9cbefc9a5458d9803d25946f5969d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ab16012ad464e508f726043f2d54625 (127.11.229.131:38829), 45858edf7940484380be4fa6466421c0 (127.11.229.129:43189)
W20260923 17:18:10.616992 31867 tablet.cc:2369] T 78663a807e884c9faea6e0a84b761c8a P 4ab16012ad464e508f726043f2d54625: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 17:18:10.619848 31879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:10.615568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:49511 (local address 127.11.229.131:38829)
0923 17:18:10.615726 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:10.615732 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:10.615751 (+ 19us) server_negotiation.cc:407] Connection header received
0923 17:18:10.615891 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:10.615897 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:10.615956 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:10.616054 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:18:10.616380 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:10.617236 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:10.618544 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:10.619156 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:10.619272 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:10.619312 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:10.619647 (+ 335us) server_negotiation.cc:299] Negotiation successful
0923 17:18:10.619735 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260923 17:18:10.619849 31880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:10.615819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:56093 (local address 127.11.229.129:43189)
0923 17:18:10.615938 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:10.615941 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:10.616040 (+ 99us) server_negotiation.cc:407] Connection header received
0923 17:18:10.616179 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:10.616182 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:10.616260 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:10.616345 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:18:10.616656 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:10.617226 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:10.618411 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:10.619030 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:10.619155 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:10.619237 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:10.619645 (+ 408us) server_negotiation.cc:299] Negotiation successful
0923 17:18:10.619716 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260923 17:18:10.619920 31734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:10.615343 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.131:38829 (local address 127.11.229.130:49511)
0923 17:18:10.615569 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:10.615588 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:10.615738 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:10.616090 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:10.616092 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:10.616109 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:18:10.616260 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:10.616267 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:10.617383 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:10.617386 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:10.618411 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:10.618422 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:10.619256 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:10.619259 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:10.619464 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:10.619513 (+ 49us) client_negotiation.cc:769] Sending connection context
0923 17:18:10.619615 (+ 102us) client_negotiation.cc:240] Negotiation successful
0923 17:18:10.619761 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58,"mutex_wait_us":154}
I20260923 17:18:10.619930 31892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:10.615579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:43189 (local address 127.11.229.130:56093)
0923 17:18:10.615937 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:10.615953 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:10.616068 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:10.616375 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:10.616379 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:10.616397 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:18:10.616528 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:10.616534 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:10.617347 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:10.617352 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:10.618293 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:10.618302 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:10.619230 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:10.619236 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:10.619471 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:10.619517 (+ 46us) client_negotiation.cc:769] Sending connection context
0923 17:18:10.619617 (+ 100us) client_negotiation.cc:240] Negotiation successful
0923 17:18:10.619763 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"mutex_wait_us":124,"thread_start_us":121,"threads_started":1}
I20260923 17:18:10.620733 31820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78663a807e884c9faea6e0a84b761c8a" candidate_uuid: "1ab9cbefc9a5458d9803d25946f5969d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ab16012ad464e508f726043f2d54625" is_pre_election: true
I20260923 17:18:10.620872 31552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78663a807e884c9faea6e0a84b761c8a" candidate_uuid: "1ab9cbefc9a5458d9803d25946f5969d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45858edf7940484380be4fa6466421c0" is_pre_election: true
I20260923 17:18:10.621037 31820 raft_consensus.cc:2454] T 78663a807e884c9faea6e0a84b761c8a P 4ab16012ad464e508f726043f2d54625 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ab9cbefc9a5458d9803d25946f5969d in term 0.
I20260923 17:18:10.621310 31552 raft_consensus.cc:2454] T 78663a807e884c9faea6e0a84b761c8a P 45858edf7940484380be4fa6466421c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ab9cbefc9a5458d9803d25946f5969d in term 0.
I20260923 17:18:10.621529 31621 leader_election.cc:302] T 78663a807e884c9faea6e0a84b761c8a P 1ab9cbefc9a5458d9803d25946f5969d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ab9cbefc9a5458d9803d25946f5969d, 4ab16012ad464e508f726043f2d54625; no voters:
I20260923 17:18:10.621846 31891 raft_consensus.cc:2781] T 78663a807e884c9faea6e0a84b761c8a P 1ab9cbefc9a5458d9803d25946f5969d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 17:18:10.621940 31891 raft_consensus.cc:482] T 78663a807e884c9faea6e0a84b761c8a P 1ab9cbefc9a5458d9803d25946f5969d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 17:18:10.621997 31891 raft_consensus.cc:3037] T 78663a807e884c9faea6e0a84b761c8a P 1ab9cbefc9a5458d9803d25946f5969d [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:18:10.623087 31891 raft_consensus.cc:504] T 78663a807e884c9faea6e0a84b761c8a P 1ab9cbefc9a5458d9803d25946f5969d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ab16012ad464e508f726043f2d54625" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38829 } } peers { permanent_uuid: "45858edf7940484380be4fa6466421c0" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 43189 } } peers { permanent_uuid: "1ab9cbefc9a5458d9803d25946f5969d" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44771 } }
I20260923 17:18:10.623431 31891 leader_election.cc:288] T 78663a807e884c9faea6e0a84b761c8a P 1ab9cbefc9a5458d9803d25946f5969d [CANDIDATE]: Term 1 election: Requested vote from peers 4ab16012ad464e508f726043f2d54625 (127.11.229.131:38829), 45858edf7940484380be4fa6466421c0 (127.11.229.129:43189)
I20260923 17:18:10.623801 31552 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78663a807e884c9faea6e0a84b761c8a" candidate_uuid: "1ab9cbefc9a5458d9803d25946f5969d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45858edf7940484380be4fa6466421c0"
I20260923 17:18:10.623903 31820 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78663a807e884c9faea6e0a84b761c8a" candidate_uuid: "1ab9cbefc9a5458d9803d25946f5969d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ab16012ad464e508f726043f2d54625"
I20260923 17:18:10.623948 31552 raft_consensus.cc:3037] T 78663a807e884c9faea6e0a84b761c8a P 45858edf7940484380be4fa6466421c0 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:18:10.624055 31820 raft_consensus.cc:3037] T 78663a807e884c9faea6e0a84b761c8a P 4ab16012ad464e508f726043f2d54625 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:18:10.625052 31820 raft_consensus.cc:2454] T 78663a807e884c9faea6e0a84b761c8a P 4ab16012ad464e508f726043f2d54625 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ab9cbefc9a5458d9803d25946f5969d in term 1.
I20260923 17:18:10.625231 31552 raft_consensus.cc:2454] T 78663a807e884c9faea6e0a84b761c8a P 45858edf7940484380be4fa6466421c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ab9cbefc9a5458d9803d25946f5969d in term 1.
I20260923 17:18:10.625365 31621 leader_election.cc:302] T 78663a807e884c9faea6e0a84b761c8a P 1ab9cbefc9a5458d9803d25946f5969d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ab9cbefc9a5458d9803d25946f5969d, 4ab16012ad464e508f726043f2d54625; no voters:
I20260923 17:18:10.625545 31891 raft_consensus.cc:2781] T 78663a807e884c9faea6e0a84b761c8a P 1ab9cbefc9a5458d9803d25946f5969d [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:18:10.625770 31891 raft_consensus.cc:686] T 78663a807e884c9faea6e0a84b761c8a P 1ab9cbefc9a5458d9803d25946f5969d [term 1 LEADER]: Becoming Leader. State: Replica: 1ab9cbefc9a5458d9803d25946f5969d, State: Running, Role: LEADER
I20260923 17:18:10.626086 31891 consensus_queue.cc:237] T 78663a807e884c9faea6e0a84b761c8a P 1ab9cbefc9a5458d9803d25946f5969d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ab16012ad464e508f726043f2d54625" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38829 } } peers { permanent_uuid: "45858edf7940484380be4fa6466421c0" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 43189 } } peers { permanent_uuid: "1ab9cbefc9a5458d9803d25946f5969d" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44771 } }
I20260923 17:18:10.629503 31407 catalog_manager.cc:5495] T 78663a807e884c9faea6e0a84b761c8a P 1ab9cbefc9a5458d9803d25946f5969d reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ab9cbefc9a5458d9803d25946f5969d (127.11.229.130). New cstate: current_term: 1 leader_uuid: "1ab9cbefc9a5458d9803d25946f5969d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ab16012ad464e508f726043f2d54625" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38829 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45858edf7940484380be4fa6466421c0" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 43189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ab9cbefc9a5458d9803d25946f5969d" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44771 } health_report { overall_health: HEALTHY } } }
W20260923 17:18:10.637126 31733 tablet.cc:2369] T 78663a807e884c9faea6e0a84b761c8a P 1ab9cbefc9a5458d9803d25946f5969d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 17:18:10.651907 31882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:10.648764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41812 (local address 127.11.229.130:44771)
0923 17:18:10.648884 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:10.648887 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:10.648900 (+ 13us) server_negotiation.cc:407] Connection header received
0923 17:18:10.648984 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:10.648987 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:10.649040 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:10.649121 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 17:18:10.649330 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:10.649824 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:10.650630 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:10.650844 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:10.650921 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:10.651156 (+ 235us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 17:18:10.651539 (+ 383us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 17:18:10.651626 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:10.651756 (+ 130us) server_negotiation.cc:299] Negotiation successful
0923 17:18:10.651804 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260923 17:18:10.657490 31820 raft_consensus.cc:1261] T 78663a807e884c9faea6e0a84b761c8a P 4ab16012ad464e508f726043f2d54625 [term 1 FOLLOWER]: Refusing update from remote peer 1ab9cbefc9a5458d9803d25946f5969d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:18:10.657490 31552 raft_consensus.cc:1261] T 78663a807e884c9faea6e0a84b761c8a P 45858edf7940484380be4fa6466421c0 [term 1 FOLLOWER]: Refusing update from remote peer 1ab9cbefc9a5458d9803d25946f5969d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:18:10.658269 31891 consensus_queue.cc:1035] T 78663a807e884c9faea6e0a84b761c8a P 1ab9cbefc9a5458d9803d25946f5969d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ab16012ad464e508f726043f2d54625" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 38829 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:18:10.658468 31893 consensus_queue.cc:1035] T 78663a807e884c9faea6e0a84b761c8a P 1ab9cbefc9a5458d9803d25946f5969d [LEADER]: Connected to new peer: Peer: permanent_uuid: "45858edf7940484380be4fa6466421c0" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 43189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260923 17:18:10.662498 31599 tablet.cc:2369] T 78663a807e884c9faea6e0a84b761c8a P 45858edf7940484380be4fa6466421c0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 17:18:10.665108 31896 mvcc.cc:205] Tried to move back new op lower bound from 7332593216126181376 to 7332593216007213056. Current Snapshot: MvccSnapshot[applied={T|T < 7332593216126181376}]
I20260923 17:18:10.667160 31897 mvcc.cc:205] Tried to move back new op lower bound from 7332593216126181376 to 7332593216007213056. Current Snapshot: MvccSnapshot[applied={T|T < 7332593216126181376}]
I20260923 17:18:10.667774 31898 mvcc.cc:205] Tried to move back new op lower bound from 7332593216126181376 to 7332593216007213056. Current Snapshot: MvccSnapshot[applied={T|T < 7332593216126181376 or (T in {7332593216126181376})}]
I20260923 17:18:10.674914 31407 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52922:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:18:10.675084 31407 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52922:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:18:10.677431 31407 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 299c30bdc4f847db878f7e584a36f9fb: Sending DeleteTablet for 3 replicas of tablet 78663a807e884c9faea6e0a84b761c8a
I20260923 17:18:10.678154 31800 tablet_service.cc:1514] Processing DeleteTablet for tablet 78663a807e884c9faea6e0a84b761c8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:18:10 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:39280
I20260923 17:18:10.678208 31666 tablet_service.cc:1514] Processing DeleteTablet for tablet 78663a807e884c9faea6e0a84b761c8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:18:10 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:41800
I20260923 17:18:10.678288 31532 tablet_service.cc:1514] Processing DeleteTablet for tablet 78663a807e884c9faea6e0a84b761c8a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:18:10 UTC) from {username='kudu', principal='kudu/127.11.229.190@KRBTEST.COM'} at 127.0.0.1:57224
I20260923 17:18:10.678710 31906 tablet_replica.cc:330] T 78663a807e884c9faea6e0a84b761c8a P 45858edf7940484380be4fa6466421c0: stopping tablet replica
I20260923 17:18:10.679008 31905 tablet_replica.cc:330] T 78663a807e884c9faea6e0a84b761c8a P 4ab16012ad464e508f726043f2d54625: stopping tablet replica
I20260923 17:18:10.679032 31906 raft_consensus.cc:2229] T 78663a807e884c9faea6e0a84b761c8a P 45858edf7940484380be4fa6466421c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:18:10.679284 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 31469
I20260923 17:18:10.680754 31907 tablet_replica.cc:330] T 78663a807e884c9faea6e0a84b761c8a P 1ab9cbefc9a5458d9803d25946f5969d: stopping tablet replica
I20260923 17:18:10.681034 31907 raft_consensus.cc:2229] T 78663a807e884c9faea6e0a84b761c8a P 1ab9cbefc9a5458d9803d25946f5969d [term 1 LEADER]: Raft consensus shutting down.
I20260923 17:18:10.681432 31907 raft_consensus.cc:2258] T 78663a807e884c9faea6e0a84b761c8a P 1ab9cbefc9a5458d9803d25946f5969d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:18:10.681732 31905 raft_consensus.cc:2229] T 78663a807e884c9faea6e0a84b761c8a P 4ab16012ad464e508f726043f2d54625 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:18:10.682087 31905 raft_consensus.cc:2258] T 78663a807e884c9faea6e0a84b761c8a P 4ab16012ad464e508f726043f2d54625 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:18:10.683018 31907 ts_tablet_manager.cc:1905] T 78663a807e884c9faea6e0a84b761c8a P 1ab9cbefc9a5458d9803d25946f5969d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:18:10.683647 31905 ts_tablet_manager.cc:1905] T 78663a807e884c9faea6e0a84b761c8a P 4ab16012ad464e508f726043f2d54625: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:18:10.685763 31907 ts_tablet_manager.cc:1918] T 78663a807e884c9faea6e0a84b761c8a P 1ab9cbefc9a5458d9803d25946f5969d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 17:18:10.685860 31907 log.cc:1196] T 78663a807e884c9faea6e0a84b761c8a P 1ab9cbefc9a5458d9803d25946f5969d: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-1/wal/wals/78663a807e884c9faea6e0a84b761c8a
I20260923 17:18:10.686182 31907 ts_tablet_manager.cc:1939] T 78663a807e884c9faea6e0a84b761c8a P 1ab9cbefc9a5458d9803d25946f5969d: Deleting consensus metadata
W20260923 17:18:10.686282 31391 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.229.129:43189 (error 108)
I20260923 17:18:10.686981 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 31603
I20260923 17:18:10.687489 31878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:10.687152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:43189 (local address 127.0.0.1:57226)
0923 17:18:10.687300 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:10.687385 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.129:43189: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260923 17:18:10.687726 31391 catalog_manager.cc:4584] TS 45858edf7940484380be4fa6466421c0 (127.11.229.129:43189): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 78663a807e884c9faea6e0a84b761c8a: Network error: Client connection negotiation failed: client connection to 127.11.229.129:43189: connect: Connection refused (error 111)
I20260923 17:18:10.688256 31905 ts_tablet_manager.cc:1918] T 78663a807e884c9faea6e0a84b761c8a P 4ab16012ad464e508f726043f2d54625: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 17:18:10.688369 31905 log.cc:1196] T 78663a807e884c9faea6e0a84b761c8a P 4ab16012ad464e508f726043f2d54625: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790183633736342-12182-0/minicluster-data/ts-2/wal/wals/78663a807e884c9faea6e0a84b761c8a
I20260923 17:18:10.688650 31905 ts_tablet_manager.cc:1939] T 78663a807e884c9faea6e0a84b761c8a P 4ab16012ad464e508f726043f2d54625: Deleting consensus metadata
I20260923 17:18:10.689759 31393 catalog_manager.cc:4841] TS 4ab16012ad464e508f726043f2d54625 (127.11.229.131:38829): tablet 78663a807e884c9faea6e0a84b761c8a (table test-table [id=c2e55d0fa09d4a19b85fa57a513b05c4]) successfully deleted
I20260923 17:18:10.693406 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 31737
I20260923 17:18:10.695019 31878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:10.693558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.130:44771 (local address 127.0.0.1:41824)
0923 17:18:10.694825 (+ 1267us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:10.694902 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.130:44771: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1152}
I20260923 17:18:10.699402 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 31375
2026-09-23T17:18:10Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2435 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-09-23T17:18:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:18:10Z Disabled control of system clock
I20260923 17:18:10.729576 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:39709
--webserver_interface=127.11.229.190
--webserver_port=0
--builtin_ntp_servers=127.11.229.148:41707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:39709
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260923 17:18:10.837414 31912 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:18:10.837689 31912 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:18:10.837724 31912 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:18:10.841686 31912 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:18:10.841738 31912 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:18:10.841753 31912 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:18:10.841770 31912 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:18:10.841785 31912 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:18:10.846530 31912 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:41707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:39709
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:39709
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.229.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31912
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:18:10.847525 31912 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:18:10.848783 31912 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:18:10.857019 31918 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:10.856987 31917 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:10.857184 31912 server_base.cc:1034] running on GCE node
W20260923 17:18:10.856987 31920 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:10.857807 31912 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:18:10.858893 31912 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:18:10.860074 31912 hybrid_clock.cc:648] HybridClock initialized: now 1790183890860051 us; error 41 us; skew 500 ppm
I20260923 17:18:10.861812 31912 webserver.cc:460] Webserver started at http://127.11.229.190:45543/ using document root <none> and password file <none>
I20260923 17:18:10.862447 31912 fs_manager.cc:359] Metadata directory not provided
I20260923 17:18:10.862531 31912 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:18:10.862753 31912 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:18:10.864753 31912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "081d04282f33441eb71d56998ee562b8"
format_stamp: "Formatted at 2026-09-23 17:18:10 on dist-test-slave-1x1f"
server_key: "44a85614a76ffe5ff092928b7b7df95b"
server_key_iv: "de84ef0f248c2d9d7cda80ca9043ea15"
server_key_version: "encryptionkey@0"
I20260923 17:18:10.865293 31912 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "081d04282f33441eb71d56998ee562b8"
format_stamp: "Formatted at 2026-09-23 17:18:10 on dist-test-slave-1x1f"
server_key: "44a85614a76ffe5ff092928b7b7df95b"
server_key_iv: "de84ef0f248c2d9d7cda80ca9043ea15"
server_key_version: "encryptionkey@0"
I20260923 17:18:10.868880 31912 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260923 17:18:10.871542 31926 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:10.872874 31912 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260923 17:18:10.873034 31912 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "081d04282f33441eb71d56998ee562b8"
format_stamp: "Formatted at 2026-09-23 17:18:10 on dist-test-slave-1x1f"
server_key: "44a85614a76ffe5ff092928b7b7df95b"
server_key_iv: "de84ef0f248c2d9d7cda80ca9043ea15"
server_key_version: "encryptionkey@0"
I20260923 17:18:10.873153 31912 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:18:10.892969 31912 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:18:10.893844 31912 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:18:10.894040 31912 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:18:10.901224 31912 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.190:39709
I20260923 17:18:10.901237 31978 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.190:39709 every 8 connection(s)
I20260923 17:18:10.902159 31912 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:18:10.905143 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 31912
I20260923 17:18:10.905296 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:18:10.905339 31979 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:18:10.905603 12182 external_mini_cluster.cc:1428] Setting key 6e827c3e8d45d475dab8b8a15157d371
I20260923 17:18:10.912102 31979 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 081d04282f33441eb71d56998ee562b8: Bootstrap starting.
I20260923 17:18:10.914569 31979 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 081d04282f33441eb71d56998ee562b8: Neither blocks nor log segments found. Creating new log.
I20260923 17:18:10.914968 31982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:10.906966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48848 (local address 127.11.229.190:39709)
0923 17:18:10.907573 (+ 607us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:10.907587 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:10.907621 (+ 34us) server_negotiation.cc:407] Connection header received
0923 17:18:10.908403 (+ 782us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:10.908422 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:10.908807 (+ 385us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:10.909084 (+ 277us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:10.909412 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:10.910536 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:10.911702 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:10.912156 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:10.912324 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:10.913224 (+ 900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:10.913229 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:10.913241 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:18:10.913611 (+ 370us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:10.913663 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:18:10.913683 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:10.913798 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:10.913913 (+ 115us) server_negotiation.cc:299] Negotiation successful
0923 17:18:10.914170 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":277,"thread_start_us":145,"threads_started":1}
I20260923 17:18:10.915354 31979 log.cc:824] T 00000000000000000000000000000000 P 081d04282f33441eb71d56998ee562b8: Log is configured to *not* fsync() on all Append() calls
I20260923 17:18:10.917227 31979 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 081d04282f33441eb71d56998ee562b8: No bootstrap required, opened a new log
I20260923 17:18:10.920858 31979 raft_consensus.cc:348] T 00000000000000000000000000000000 P 081d04282f33441eb71d56998ee562b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "081d04282f33441eb71d56998ee562b8" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 39709 } }
I20260923 17:18:10.921097 31979 raft_consensus.cc:374] T 00000000000000000000000000000000 P 081d04282f33441eb71d56998ee562b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:18:10.921171 31979 raft_consensus.cc:729] T 00000000000000000000000000000000 P 081d04282f33441eb71d56998ee562b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 081d04282f33441eb71d56998ee562b8, State: Initialized, Role: FOLLOWER
I20260923 17:18:10.921617 31979 consensus_queue.cc:260] T 00000000000000000000000000000000 P 081d04282f33441eb71d56998ee562b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "081d04282f33441eb71d56998ee562b8" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 39709 } }
I20260923 17:18:10.921738 31979 raft_consensus.cc:388] T 00000000000000000000000000000000 P 081d04282f33441eb71d56998ee562b8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:18:10.921779 31979 raft_consensus.cc:482] T 00000000000000000000000000000000 P 081d04282f33441eb71d56998ee562b8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:18:10.921849 31979 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 081d04282f33441eb71d56998ee562b8 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:18:10.922770 31979 raft_consensus.cc:504] T 00000000000000000000000000000000 P 081d04282f33441eb71d56998ee562b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "081d04282f33441eb71d56998ee562b8" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 39709 } }
I20260923 17:18:10.923044 31979 leader_election.cc:302] T 00000000000000000000000000000000 P 081d04282f33441eb71d56998ee562b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 081d04282f33441eb71d56998ee562b8; no voters:
I20260923 17:18:10.923288 31979 leader_election.cc:288] T 00000000000000000000000000000000 P 081d04282f33441eb71d56998ee562b8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 17:18:10.923413 31984 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 081d04282f33441eb71d56998ee562b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:18:10.923637 31984 raft_consensus.cc:686] T 00000000000000000000000000000000 P 081d04282f33441eb71d56998ee562b8 [term 1 LEADER]: Becoming Leader. State: Replica: 081d04282f33441eb71d56998ee562b8, State: Running, Role: LEADER
I20260923 17:18:10.923918 31984 consensus_queue.cc:237] T 00000000000000000000000000000000 P 081d04282f33441eb71d56998ee562b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "081d04282f33441eb71d56998ee562b8" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 39709 } }
I20260923 17:18:10.924474 31979 sys_catalog.cc:564] T 00000000000000000000000000000000 P 081d04282f33441eb71d56998ee562b8 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:18:10.925539 31986 sys_catalog.cc:455] T 00000000000000000000000000000000 P 081d04282f33441eb71d56998ee562b8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 081d04282f33441eb71d56998ee562b8. Latest consensus state: current_term: 1 leader_uuid: "081d04282f33441eb71d56998ee562b8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "081d04282f33441eb71d56998ee562b8" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 39709 } } }
I20260923 17:18:10.925535 31985 sys_catalog.cc:455] T 00000000000000000000000000000000 P 081d04282f33441eb71d56998ee562b8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "081d04282f33441eb71d56998ee562b8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "081d04282f33441eb71d56998ee562b8" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 39709 } } }
I20260923 17:18:10.925779 31986 sys_catalog.cc:458] T 00000000000000000000000000000000 P 081d04282f33441eb71d56998ee562b8 [sys.catalog]: This master's current role is: LEADER
I20260923 17:18:10.925793 31985 sys_catalog.cc:458] T 00000000000000000000000000000000 P 081d04282f33441eb71d56998ee562b8 [sys.catalog]: This master's current role is: LEADER
I20260923 17:18:10.926489 31995 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:18:10.929090 31995 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:18:10.934664 31995 catalog_manager.cc:1347] Generated new cluster ID: 649ce905f57c440681d8a68def1c9bff
I20260923 17:18:10.934741 31995 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:18:10.954145 31995 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:18:10.955384 31995 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:18:10.961143 31995 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 081d04282f33441eb71d56998ee562b8: Generated new TSK 0
I20260923 17:18:10.961956 31995 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 17:18:10.968719 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.129:0
--local_ip_for_outbound_sockets=127.11.229.129
--webserver_interface=127.11.229.129
--webserver_port=0
--tserver_master_addrs=127.11.229.190:39709
--builtin_ntp_servers=127.11.229.148:41707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260923 17:18:11.079309 32003 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:18:11.079609 32003 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:18:11.079681 32003 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:18:11.083732 32003 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:18:11.083806 32003 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:18:11.083897 32003 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.129
I20260923 17:18:11.088641 32003 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:41707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.229.129
--webserver_port=0
--tserver_master_addrs=127.11.229.190:39709
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32003
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.129
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:18:11.089740 32003 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:18:11.091205 32003 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:18:11.100824 32008 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:11.100852 32003 server_base.cc:1034] running on GCE node
W20260923 17:18:11.100824 32011 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:11.100883 32009 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:11.101529 32003 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:18:11.102133 32003 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:18:11.103367 32003 hybrid_clock.cc:648] HybridClock initialized: now 1790183891103349 us; error 30 us; skew 500 ppm
I20260923 17:18:11.105209 32003 webserver.cc:460] Webserver started at http://127.11.229.129:42339/ using document root <none> and password file <none>
I20260923 17:18:11.105783 32003 fs_manager.cc:359] Metadata directory not provided
I20260923 17:18:11.105873 32003 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:18:11.106092 32003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:18:11.108178 32003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-0/data/instance:
uuid: "67d5dde115454a669a59ff9d31c6a95c"
format_stamp: "Formatted at 2026-09-23 17:18:11 on dist-test-slave-1x1f"
server_key: "7eb940720a2fa1d48178c4478d9a09a4"
server_key_iv: "1e1a052f94356466f4797368759f59c6"
server_key_version: "encryptionkey@0"
I20260923 17:18:11.108764 32003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance:
uuid: "67d5dde115454a669a59ff9d31c6a95c"
format_stamp: "Formatted at 2026-09-23 17:18:11 on dist-test-slave-1x1f"
server_key: "7eb940720a2fa1d48178c4478d9a09a4"
server_key_iv: "1e1a052f94356466f4797368759f59c6"
server_key_version: "encryptionkey@0"
I20260923 17:18:11.112434 32003 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260923 17:18:11.114828 32017 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:11.115953 32003 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 17:18:11.116080 32003 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-0/wal
uuid: "67d5dde115454a669a59ff9d31c6a95c"
format_stamp: "Formatted at 2026-09-23 17:18:11 on dist-test-slave-1x1f"
server_key: "7eb940720a2fa1d48178c4478d9a09a4"
server_key_iv: "1e1a052f94356466f4797368759f59c6"
server_key_version: "encryptionkey@0"
I20260923 17:18:11.116183 32003 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:18:11.126950 32003 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:18:11.127527 32003 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:18:11.127710 32003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:18:11.128234 32003 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:18:11.129105 32003 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:18:11.129172 32003 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:11.129257 32003 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:18:11.129302 32003 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:11.138151 32003 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.129:38273
I20260923 17:18:11.138177 32130 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.129:38273 every 8 connection(s)
I20260923 17:18:11.139135 32003 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-0/data/info.pb
I20260923 17:18:11.144992 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 32003
I20260923 17:18:11.145126 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-0/wal/instance
I20260923 17:18:11.145466 12182 external_mini_cluster.cc:1428] Setting key 54936a5820058bfeab52ee6da7b0238e
I20260923 17:18:11.147722 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.130:0
--local_ip_for_outbound_sockets=127.11.229.130
--webserver_interface=127.11.229.130
--webserver_port=0
--tserver_master_addrs=127.11.229.190:39709
--builtin_ntp_servers=127.11.229.148:41707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260923 17:18:11.149811 31982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:11.141057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.129:40097 (local address 127.11.229.190:39709)
0923 17:18:11.141240 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:11.141245 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:11.142402 (+ 1157us) server_negotiation.cc:407] Connection header received
0923 17:18:11.143890 (+ 1488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:11.143893 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:11.143954 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:11.144035 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:11.144945 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:11.145666 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:11.147372 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:11.147616 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:11.147719 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:11.149206 (+ 1487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:11.149211 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:11.149216 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:18:11.149234 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:11.149262 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:18:11.149276 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:11.149363 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:11.149521 (+ 158us) server_negotiation.cc:299] Negotiation successful
0923 17:18:11.149622 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260923 17:18:11.150976 32133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:11.141508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:39709 (local address 127.11.229.129:40097)
0923 17:18:11.142189 (+ 681us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:11.142292 (+ 103us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:11.143636 (+ 1344us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:11.144208 (+ 572us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:11.144215 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:11.144301 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:18:11.144796 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:11.144808 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:11.145814 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:11.145818 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:11.147228 (+ 1410us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:11.147241 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:11.147797 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:11.147803 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:11.148085 (+ 282us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:11.148838 (+ 753us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 17:18:11.148843 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:18:11.148907 (+ 64us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 17:18:11.149004 (+ 97us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:18:11.149377 (+ 373us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:18:11.149385 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:18:11.149390 (+ 5us) client_negotiation.cc:769] Sending connection context
0923 17:18:11.149499 (+ 109us) client_negotiation.cc:240] Negotiation successful
0923 17:18:11.149745 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":114,"threads_started":1}
I20260923 17:18:11.152456 32131 heartbeater.cc:347] Connected to a master server at 127.11.229.190:39709
I20260923 17:18:11.152758 32131 heartbeater.cc:464] Registering TS with master...
I20260923 17:18:11.153321 32131 heartbeater.cc:511] Master 127.11.229.190:39709 requested a full tablet report, sending...
I20260923 17:18:11.155129 31943 ts_manager.cc:194] Registered new tserver with Master: 67d5dde115454a669a59ff9d31c6a95c (127.11.229.129:38273)
I20260923 17:18:11.156996 31943 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.229.129:40097
W20260923 17:18:11.263690 32134 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:18:11.264016 32134 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:18:11.264070 32134 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:18:11.268540 32134 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:18:11.268589 32134 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:18:11.268647 32134 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.130
I20260923 17:18:11.273839 32134 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:41707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.229.130
--webserver_port=0
--tserver_master_addrs=127.11.229.190:39709
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32134
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.130
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:18:11.274976 32134 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:18:11.276371 32134 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:18:11.285916 32142 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:11.285916 32139 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:11.286072 32134 server_base.cc:1034] running on GCE node
W20260923 17:18:11.285929 32140 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:11.286715 32134 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:18:11.287338 32134 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:18:11.288532 32134 hybrid_clock.cc:648] HybridClock initialized: now 1790183891288506 us; error 32 us; skew 500 ppm
I20260923 17:18:11.290886 32134 webserver.cc:460] Webserver started at http://127.11.229.130:35569/ using document root <none> and password file <none>
I20260923 17:18:11.291456 32134 fs_manager.cc:359] Metadata directory not provided
I20260923 17:18:11.291540 32134 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:18:11.291764 32134 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:18:11.294158 32134 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-1/data/instance:
uuid: "927a0905817548b99bed52c82615f45f"
format_stamp: "Formatted at 2026-09-23 17:18:11 on dist-test-slave-1x1f"
server_key: "9b6d52bb29ec604e9707dab0a43c0e72"
server_key_iv: "137e5d9bb2639e6ec3e56e6b18c05138"
server_key_version: "encryptionkey@0"
I20260923 17:18:11.294889 32134 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance:
uuid: "927a0905817548b99bed52c82615f45f"
format_stamp: "Formatted at 2026-09-23 17:18:11 on dist-test-slave-1x1f"
server_key: "9b6d52bb29ec604e9707dab0a43c0e72"
server_key_iv: "137e5d9bb2639e6ec3e56e6b18c05138"
server_key_version: "encryptionkey@0"
I20260923 17:18:11.299353 32134 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260923 17:18:11.301679 32148 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:11.302907 32134 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 17:18:11.303030 32134 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-1/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-1/wal
uuid: "927a0905817548b99bed52c82615f45f"
format_stamp: "Formatted at 2026-09-23 17:18:11 on dist-test-slave-1x1f"
server_key: "9b6d52bb29ec604e9707dab0a43c0e72"
server_key_iv: "137e5d9bb2639e6ec3e56e6b18c05138"
server_key_version: "encryptionkey@0"
I20260923 17:18:11.303133 32134 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:18:11.319512 32134 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:18:11.320214 32134 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:18:11.320427 32134 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:18:11.320997 32134 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:18:11.322000 32134 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:18:11.322067 32134 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:11.322139 32134 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:18:11.322184 32134 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:11.330936 32134 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.130:44543
I20260923 17:18:11.331000 32261 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.130:44543 every 8 connection(s)
I20260923 17:18:11.331823 32134 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-1/data/info.pb
I20260923 17:18:11.335099 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 32134
I20260923 17:18:11.335255 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-1/wal/instance
I20260923 17:18:11.335552 12182 external_mini_cluster.cc:1428] Setting key b147789103c64a64bd2df09a8e162458
I20260923 17:18:11.337489 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.229.131:0
--local_ip_for_outbound_sockets=127.11.229.131
--webserver_interface=127.11.229.131
--webserver_port=0
--tserver_master_addrs=127.11.229.190:39709
--builtin_ntp_servers=127.11.229.148:41707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260923 17:18:11.341593 31982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:11.333564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:57735 (local address 127.11.229.190:39709)
0923 17:18:11.333700 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:11.333704 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:11.334906 (+ 1202us) server_negotiation.cc:407] Connection header received
0923 17:18:11.336396 (+ 1490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:11.336399 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:11.336442 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:11.336506 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:11.337411 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:11.337993 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:11.339611 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:11.339849 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:11.339937 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:11.341097 (+ 1160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:11.341100 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:11.341103 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:18:11.341116 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:11.341133 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:18:11.341141 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:11.341226 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:11.341378 (+ 152us) server_negotiation.cc:299] Negotiation successful
0923 17:18:11.341444 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260923 17:18:11.342537 32264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:11.333954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:39709 (local address 127.11.229.130:57735)
0923 17:18:11.334767 (+ 813us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:11.334806 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:11.336186 (+ 1380us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:11.336674 (+ 488us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:11.336682 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:11.336808 (+ 126us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:18:11.337279 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:11.337292 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:11.338123 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:11.338126 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:11.339487 (+ 1361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:11.339500 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:11.339993 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:11.339995 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:11.340173 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:11.340825 (+ 652us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 17:18:11.340827 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:18:11.340868 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 17:18:11.340936 (+ 68us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:18:11.341222 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:18:11.341233 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:18:11.341241 (+ 8us) client_negotiation.cc:769] Sending connection context
0923 17:18:11.341367 (+ 126us) client_negotiation.cc:240] Negotiation successful
0923 17:18:11.341662 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":416,"thread_start_us":106,"threads_started":1}
I20260923 17:18:11.343828 32262 heartbeater.cc:347] Connected to a master server at 127.11.229.190:39709
I20260923 17:18:11.344079 32262 heartbeater.cc:464] Registering TS with master...
I20260923 17:18:11.344623 32262 heartbeater.cc:511] Master 127.11.229.190:39709 requested a full tablet report, sending...
I20260923 17:18:11.345728 31943 ts_manager.cc:194] Registered new tserver with Master: 927a0905817548b99bed52c82615f45f (127.11.229.130:44543)
I20260923 17:18:11.346666 31943 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.229.130:57735
W20260923 17:18:11.451166 32265 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:18:11.451421 32265 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:18:11.451457 32265 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:18:11.455543 32265 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:18:11.455600 32265 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:18:11.455654 32265 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.229.131
I20260923 17:18:11.460345 32265 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:41707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.229.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.229.131
--webserver_port=0
--tserver_master_addrs=127.11.229.190:39709
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32265
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.229.131
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:18:11.461488 32265 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:18:11.462839 32265 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:18:11.472254 32271 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:11.472208 32270 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:11.472462 32265 server_base.cc:1034] running on GCE node
W20260923 17:18:11.472483 32273 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:11.472924 32265 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:18:11.473567 32265 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:18:11.474728 32265 hybrid_clock.cc:648] HybridClock initialized: now 1790183891474713 us; error 26 us; skew 500 ppm
I20260923 17:18:11.476627 32265 webserver.cc:460] Webserver started at http://127.11.229.131:44099/ using document root <none> and password file <none>
I20260923 17:18:11.477195 32265 fs_manager.cc:359] Metadata directory not provided
I20260923 17:18:11.477257 32265 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:18:11.477494 32265 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:18:11.479553 32265 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-2/data/instance:
uuid: "73dfe02f79894d59a421bdb5fdf59ad1"
format_stamp: "Formatted at 2026-09-23 17:18:11 on dist-test-slave-1x1f"
server_key: "8eac41b84c8219be062a86fc67eac3a1"
server_key_iv: "8c941ce9f7bd6ef392c12cec692e0042"
server_key_version: "encryptionkey@0"
I20260923 17:18:11.480090 32265 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance:
uuid: "73dfe02f79894d59a421bdb5fdf59ad1"
format_stamp: "Formatted at 2026-09-23 17:18:11 on dist-test-slave-1x1f"
server_key: "8eac41b84c8219be062a86fc67eac3a1"
server_key_iv: "8c941ce9f7bd6ef392c12cec692e0042"
server_key_version: "encryptionkey@0"
I20260923 17:18:11.483661 32265 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260923 17:18:11.486060 32279 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:11.487385 32265 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 17:18:11.487519 32265 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-2/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-2/wal
uuid: "73dfe02f79894d59a421bdb5fdf59ad1"
format_stamp: "Formatted at 2026-09-23 17:18:11 on dist-test-slave-1x1f"
server_key: "8eac41b84c8219be062a86fc67eac3a1"
server_key_iv: "8c941ce9f7bd6ef392c12cec692e0042"
server_key_version: "encryptionkey@0"
I20260923 17:18:11.487624 32265 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:18:11.515991 32265 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:18:11.516728 32265 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:18:11.516921 32265 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:18:11.517496 32265 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260923 17:18:11.518476 32265 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260923 17:18:11.518541 32265 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:11.518610 32265 ts_tablet_manager.cc:610] Registered 0 tablets
I20260923 17:18:11.518658 32265 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:11.527940 32265 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.131:36313
I20260923 17:18:11.528021 32392 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.131:36313 every 8 connection(s)
I20260923 17:18:11.528821 32265 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-2/data/info.pb
I20260923 17:18:11.534415 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 32265
I20260923 17:18:11.534520 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-2/wal/instance
I20260923 17:18:11.534804 12182 external_mini_cluster.cc:1428] Setting key a4866b9266a833942c00acd64dc0e98b
I20260923 17:18:11.544885 31982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:11.536573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.131:44055 (local address 127.11.229.190:39709)
0923 17:18:11.536730 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:11.536734 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:11.537340 (+ 606us) server_negotiation.cc:407] Connection header received
0923 17:18:11.539330 (+ 1990us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:11.539333 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:11.539387 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:11.539470 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:11.541190 (+ 1720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:11.541732 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:11.542933 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:11.543161 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:11.543253 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:11.544485 (+ 1232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:11.544488 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:11.544490 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:18:11.544502 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:11.544527 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:18:11.544534 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:11.544592 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:11.544724 (+ 132us) server_negotiation.cc:299] Negotiation successful
0923 17:18:11.544773 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260923 17:18:11.545778 32395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:11.531289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:39709 (local address 127.11.229.131:44055)
0923 17:18:11.537131 (+ 5842us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:11.537209 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:11.539069 (+ 1860us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:11.540372 (+ 1303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:11.540386 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:11.540502 (+ 116us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:18:11.541063 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:11.541076 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:11.541837 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:11.541839 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:11.542826 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:11.542835 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:11.543471 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:11.543474 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:11.543624 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:11.544203 (+ 579us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0923 17:18:11.544205 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:18:11.544276 (+ 71us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0923 17:18:11.544343 (+ 67us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:18:11.544607 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:18:11.544613 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:18:11.544618 (+ 5us) client_negotiation.cc:769] Sending connection context
0923 17:18:11.544711 (+ 93us) client_negotiation.cc:240] Negotiation successful
0923 17:18:11.544943 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5291,"thread_start_us":124,"threads_started":1}
I20260923 17:18:11.546829 32393 heartbeater.cc:347] Connected to a master server at 127.11.229.190:39709
I20260923 17:18:11.547055 32393 heartbeater.cc:464] Registering TS with master...
I20260923 17:18:11.547559 32393 heartbeater.cc:511] Master 127.11.229.190:39709 requested a full tablet report, sending...
I20260923 17:18:11.548527 31943 ts_manager.cc:194] Registered new tserver with Master: 73dfe02f79894d59a421bdb5fdf59ad1 (127.11.229.131:36313)
I20260923 17:18:11.549034 31943 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.229.131:44055
I20260923 17:18:11.551313 12182 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260923 17:18:11.556722 31982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:11.553238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48864 (local address 127.11.229.190:39709)
0923 17:18:11.553373 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:11.553378 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:11.553486 (+ 108us) server_negotiation.cc:407] Connection header received
0923 17:18:11.553579 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:11.553581 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:11.553619 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:11.553695 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:11.553912 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:11.554571 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:11.555400 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:11.555638 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:11.555724 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:11.556392 (+ 668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:11.556395 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:11.556398 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:18:11.556409 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:11.556426 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:18:11.556434 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:11.556495 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:11.556566 (+ 71us) server_negotiation.cc:299] Negotiation successful
0923 17:18:11.556619 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260923 17:18:11.559384 31943 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48864:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260923 17:18:11.562410 31943 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260923 17:18:11.576362 32404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:11.570651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.131:36313 (local address 127.0.0.1:34732)
0923 17:18:11.570936 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:11.570981 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:11.571100 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:11.572100 (+ 1000us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:11.572106 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:11.572128 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:18:11.572260 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:11.572269 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:11.573520 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:11.573526 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:11.574833 (+ 1307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:11.574845 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:11.575862 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:11.575865 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:11.575965 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:11.576003 (+ 38us) client_negotiation.cc:769] Sending connection context
0923 17:18:11.576094 (+ 91us) client_negotiation.cc:240] Negotiation successful
0923 17:18:11.576211 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"mutex_wait_us":52,"thread_start_us":60,"threads_started":1}
I20260923 17:18:11.576443 32405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:11.570804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34732 (local address 127.11.229.131:36313)
0923 17:18:11.571362 (+ 558us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:11.571375 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:11.571403 (+ 28us) server_negotiation.cc:407] Connection header received
0923 17:18:11.571488 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:11.571493 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:11.571713 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:11.571877 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:18:11.572404 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:11.573410 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:11.574981 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:11.575746 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:11.575886 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:11.576058 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:11.576121 (+ 63us) server_negotiation.cc:299] Negotiation successful
0923 17:18:11.576219 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":438,"thread_start_us":164,"threads_started":1}
I20260923 17:18:11.576983 32408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:11.571625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.130:44543 (local address 127.0.0.1:57334)
0923 17:18:11.572198 (+ 573us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:11.572210 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:11.572280 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:11.572977 (+ 697us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:11.572980 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:11.572999 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:18:11.573096 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:11.573102 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:11.574454 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:11.574459 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:11.575657 (+ 1198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:11.575664 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:11.576641 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:11.576645 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:11.576738 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:11.576761 (+ 23us) client_negotiation.cc:769] Sending connection context
0923 17:18:11.576806 (+ 45us) client_negotiation.cc:240] Negotiation successful
0923 17:18:11.576872 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":520,"mutex_wait_us":6,"thread_start_us":79,"threads_started":1}
I20260923 17:18:11.577229 32406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:11.571327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:38273 (local address 127.0.0.1:38958)
0923 17:18:11.571922 (+ 595us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:11.571935 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:11.572016 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:11.572506 (+ 490us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:11.572509 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:11.572526 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:18:11.572628 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:11.572634 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:11.574208 (+ 1574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:11.574212 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:11.575477 (+ 1265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:11.575487 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:11.576836 (+ 1349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:11.576840 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:11.576937 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:11.576961 (+ 24us) client_negotiation.cc:769] Sending connection context
0923 17:18:11.577013 (+ 52us) client_negotiation.cc:240] Negotiation successful
0923 17:18:11.577093 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":531,"mutex_wait_us":38,"thread_start_us":102,"threads_started":1}
I20260923 17:18:11.577652 32409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:11.571827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57334 (local address 127.11.229.130:44543)
0923 17:18:11.572524 (+ 697us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:11.572535 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:11.572556 (+ 21us) server_negotiation.cc:407] Connection header received
0923 17:18:11.572627 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:11.572631 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:11.572824 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:11.572974 (+ 150us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:18:11.573222 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:11.574346 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:11.575762 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:11.576509 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:11.577183 (+ 674us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:11.577348 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:11.577403 (+ 55us) server_negotiation.cc:299] Negotiation successful
0923 17:18:11.577489 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":586,"thread_start_us":89,"threads_started":1}
I20260923 17:18:11.578154 32407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:11.571544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38958 (local address 127.11.229.129:38273)
0923 17:18:11.572043 (+ 499us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:11.572057 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:11.572083 (+ 26us) server_negotiation.cc:407] Connection header received
0923 17:18:11.572158 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:11.572164 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:11.572359 (+ 195us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:11.572766 (+ 407us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:18:11.572899 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:11.574075 (+ 1176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:11.575616 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:11.576690 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:11.577448 (+ 758us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:11.577610 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:11.577659 (+ 49us) server_negotiation.cc:299] Negotiation successful
0923 17:18:11.577747 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":404,"thread_start_us":116,"threads_started":1}
I20260923 17:18:11.579721 32327 tablet_service.cc:1467] Processing CreateTablet for tablet 2d5fda950acf4778a83fbf8d312ef50c (DEFAULT_TABLE table=test-table [id=25925a8370994af48889e516e70bfa8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:18:11.580336 32196 tablet_service.cc:1467] Processing CreateTablet for tablet 2d5fda950acf4778a83fbf8d312ef50c (DEFAULT_TABLE table=test-table [id=25925a8370994af48889e516e70bfa8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:18:11.580902 32327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d5fda950acf4778a83fbf8d312ef50c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:18:11.580760 32065 tablet_service.cc:1467] Processing CreateTablet for tablet 2d5fda950acf4778a83fbf8d312ef50c (DEFAULT_TABLE table=test-table [id=25925a8370994af48889e516e70bfa8f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260923 17:18:11.581183 32196 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d5fda950acf4778a83fbf8d312ef50c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:18:11.581759 32065 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2d5fda950acf4778a83fbf8d312ef50c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:18:11.587409 32410 tablet_bootstrap.cc:492] T 2d5fda950acf4778a83fbf8d312ef50c P 927a0905817548b99bed52c82615f45f: Bootstrap starting.
I20260923 17:18:11.589056 32412 tablet_bootstrap.cc:492] T 2d5fda950acf4778a83fbf8d312ef50c P 67d5dde115454a669a59ff9d31c6a95c: Bootstrap starting.
I20260923 17:18:11.589855 32410 tablet_bootstrap.cc:654] T 2d5fda950acf4778a83fbf8d312ef50c P 927a0905817548b99bed52c82615f45f: Neither blocks nor log segments found. Creating new log.
I20260923 17:18:11.590415 32411 tablet_bootstrap.cc:492] T 2d5fda950acf4778a83fbf8d312ef50c P 73dfe02f79894d59a421bdb5fdf59ad1: Bootstrap starting.
I20260923 17:18:11.590775 32410 log.cc:824] T 2d5fda950acf4778a83fbf8d312ef50c P 927a0905817548b99bed52c82615f45f: Log is configured to *not* fsync() on all Append() calls
I20260923 17:18:11.591261 32412 tablet_bootstrap.cc:654] T 2d5fda950acf4778a83fbf8d312ef50c P 67d5dde115454a669a59ff9d31c6a95c: Neither blocks nor log segments found. Creating new log.
I20260923 17:18:11.592010 32412 log.cc:824] T 2d5fda950acf4778a83fbf8d312ef50c P 67d5dde115454a669a59ff9d31c6a95c: Log is configured to *not* fsync() on all Append() calls
I20260923 17:18:11.592650 32411 tablet_bootstrap.cc:654] T 2d5fda950acf4778a83fbf8d312ef50c P 73dfe02f79894d59a421bdb5fdf59ad1: Neither blocks nor log segments found. Creating new log.
I20260923 17:18:11.593010 32410 tablet_bootstrap.cc:492] T 2d5fda950acf4778a83fbf8d312ef50c P 927a0905817548b99bed52c82615f45f: No bootstrap required, opened a new log
I20260923 17:18:11.593219 32410 ts_tablet_manager.cc:1397] T 2d5fda950acf4778a83fbf8d312ef50c P 927a0905817548b99bed52c82615f45f: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260923 17:18:11.593462 32411 log.cc:824] T 2d5fda950acf4778a83fbf8d312ef50c P 73dfe02f79894d59a421bdb5fdf59ad1: Log is configured to *not* fsync() on all Append() calls
I20260923 17:18:11.594290 32412 tablet_bootstrap.cc:492] T 2d5fda950acf4778a83fbf8d312ef50c P 67d5dde115454a669a59ff9d31c6a95c: No bootstrap required, opened a new log
I20260923 17:18:11.594460 32412 ts_tablet_manager.cc:1397] T 2d5fda950acf4778a83fbf8d312ef50c P 67d5dde115454a669a59ff9d31c6a95c: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260923 17:18:11.595502 32411 tablet_bootstrap.cc:492] T 2d5fda950acf4778a83fbf8d312ef50c P 73dfe02f79894d59a421bdb5fdf59ad1: No bootstrap required, opened a new log
I20260923 17:18:11.595731 32411 ts_tablet_manager.cc:1397] T 2d5fda950acf4778a83fbf8d312ef50c P 73dfe02f79894d59a421bdb5fdf59ad1: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260923 17:18:11.597671 32412 raft_consensus.cc:348] T 2d5fda950acf4778a83fbf8d312ef50c P 67d5dde115454a669a59ff9d31c6a95c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73dfe02f79894d59a421bdb5fdf59ad1" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 36313 } } peers { permanent_uuid: "67d5dde115454a669a59ff9d31c6a95c" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38273 } } peers { permanent_uuid: "927a0905817548b99bed52c82615f45f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44543 } }
I20260923 17:18:11.597903 32412 raft_consensus.cc:374] T 2d5fda950acf4778a83fbf8d312ef50c P 67d5dde115454a669a59ff9d31c6a95c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:18:11.597954 32412 raft_consensus.cc:729] T 2d5fda950acf4778a83fbf8d312ef50c P 67d5dde115454a669a59ff9d31c6a95c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67d5dde115454a669a59ff9d31c6a95c, State: Initialized, Role: FOLLOWER
I20260923 17:18:11.597929 32410 raft_consensus.cc:348] T 2d5fda950acf4778a83fbf8d312ef50c P 927a0905817548b99bed52c82615f45f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73dfe02f79894d59a421bdb5fdf59ad1" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 36313 } } peers { permanent_uuid: "67d5dde115454a669a59ff9d31c6a95c" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38273 } } peers { permanent_uuid: "927a0905817548b99bed52c82615f45f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44543 } }
I20260923 17:18:11.598196 32410 raft_consensus.cc:374] T 2d5fda950acf4778a83fbf8d312ef50c P 927a0905817548b99bed52c82615f45f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:18:11.598278 32410 raft_consensus.cc:729] T 2d5fda950acf4778a83fbf8d312ef50c P 927a0905817548b99bed52c82615f45f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 927a0905817548b99bed52c82615f45f, State: Initialized, Role: FOLLOWER
I20260923 17:18:11.598433 32412 consensus_queue.cc:260] T 2d5fda950acf4778a83fbf8d312ef50c P 67d5dde115454a669a59ff9d31c6a95c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73dfe02f79894d59a421bdb5fdf59ad1" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 36313 } } peers { permanent_uuid: "67d5dde115454a669a59ff9d31c6a95c" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38273 } } peers { permanent_uuid: "927a0905817548b99bed52c82615f45f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44543 } }
I20260923 17:18:11.598708 32410 consensus_queue.cc:260] T 2d5fda950acf4778a83fbf8d312ef50c P 927a0905817548b99bed52c82615f45f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73dfe02f79894d59a421bdb5fdf59ad1" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 36313 } } peers { permanent_uuid: "67d5dde115454a669a59ff9d31c6a95c" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38273 } } peers { permanent_uuid: "927a0905817548b99bed52c82615f45f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44543 } }
I20260923 17:18:11.599110 32131 heartbeater.cc:503] Master 127.11.229.190:39709 was elected leader, sending a full tablet report...
I20260923 17:18:11.599421 32412 ts_tablet_manager.cc:1428] T 2d5fda950acf4778a83fbf8d312ef50c P 67d5dde115454a669a59ff9d31c6a95c: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260923 17:18:11.599794 32410 ts_tablet_manager.cc:1428] T 2d5fda950acf4778a83fbf8d312ef50c P 927a0905817548b99bed52c82615f45f: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260923 17:18:11.600267 32262 heartbeater.cc:503] Master 127.11.229.190:39709 was elected leader, sending a full tablet report...
I20260923 17:18:11.600165 32411 raft_consensus.cc:348] T 2d5fda950acf4778a83fbf8d312ef50c P 73dfe02f79894d59a421bdb5fdf59ad1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73dfe02f79894d59a421bdb5fdf59ad1" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 36313 } } peers { permanent_uuid: "67d5dde115454a669a59ff9d31c6a95c" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38273 } } peers { permanent_uuid: "927a0905817548b99bed52c82615f45f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44543 } }
I20260923 17:18:11.600445 32411 raft_consensus.cc:374] T 2d5fda950acf4778a83fbf8d312ef50c P 73dfe02f79894d59a421bdb5fdf59ad1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:18:11.600512 32411 raft_consensus.cc:729] T 2d5fda950acf4778a83fbf8d312ef50c P 73dfe02f79894d59a421bdb5fdf59ad1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73dfe02f79894d59a421bdb5fdf59ad1, State: Initialized, Role: FOLLOWER
I20260923 17:18:11.600932 32411 consensus_queue.cc:260] T 2d5fda950acf4778a83fbf8d312ef50c P 73dfe02f79894d59a421bdb5fdf59ad1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73dfe02f79894d59a421bdb5fdf59ad1" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 36313 } } peers { permanent_uuid: "67d5dde115454a669a59ff9d31c6a95c" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38273 } } peers { permanent_uuid: "927a0905817548b99bed52c82615f45f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44543 } }
I20260923 17:18:11.601907 32411 ts_tablet_manager.cc:1428] T 2d5fda950acf4778a83fbf8d312ef50c P 73dfe02f79894d59a421bdb5fdf59ad1: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260923 17:18:11.602162 32393 heartbeater.cc:503] Master 127.11.229.190:39709 was elected leader, sending a full tablet report...
W20260923 17:18:11.640354 32132 tablet.cc:2369] T 2d5fda950acf4778a83fbf8d312ef50c P 67d5dde115454a669a59ff9d31c6a95c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260923 17:18:11.779932 32394 tablet.cc:2369] T 2d5fda950acf4778a83fbf8d312ef50c P 73dfe02f79894d59a421bdb5fdf59ad1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 17:18:11.819717 32417 raft_consensus.cc:482] T 2d5fda950acf4778a83fbf8d312ef50c P 927a0905817548b99bed52c82615f45f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260923 17:18:11.820024 32417 raft_consensus.cc:504] T 2d5fda950acf4778a83fbf8d312ef50c P 927a0905817548b99bed52c82615f45f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73dfe02f79894d59a421bdb5fdf59ad1" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 36313 } } peers { permanent_uuid: "67d5dde115454a669a59ff9d31c6a95c" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38273 } } peers { permanent_uuid: "927a0905817548b99bed52c82615f45f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44543 } }
I20260923 17:18:11.821223 32417 leader_election.cc:288] T 2d5fda950acf4778a83fbf8d312ef50c P 927a0905817548b99bed52c82615f45f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73dfe02f79894d59a421bdb5fdf59ad1 (127.11.229.131:36313), 67d5dde115454a669a59ff9d31c6a95c (127.11.229.129:38273)
I20260923 17:18:11.825748 32264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:11.821432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.131:36313 (local address 127.11.229.130:50877)
0923 17:18:11.821553 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:11.821571 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:11.821673 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:11.821987 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:11.821991 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:11.822014 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:18:11.822157 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:11.822164 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:11.823182 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:11.823184 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:11.824422 (+ 1238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:11.824432 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:11.825301 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:11.825304 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:11.825419 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:11.825446 (+ 27us) client_negotiation.cc:769] Sending connection context
0923 17:18:11.825523 (+ 77us) client_negotiation.cc:240] Negotiation successful
0923 17:18:11.825604 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260923 17:18:11.825760 32405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:11.821558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:50877 (local address 127.11.229.131:36313)
0923 17:18:11.821719 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:11.821724 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:11.821742 (+ 18us) server_negotiation.cc:407] Connection header received
0923 17:18:11.821803 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:11.821806 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:11.821862 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:11.821949 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:18:11.822283 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:11.823076 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:11.824533 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:11.825193 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:11.825324 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:11.825380 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:11.825556 (+ 176us) server_negotiation.cc:299] Negotiation successful
0923 17:18:11.825635 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260923 17:18:11.825796 32419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:11.821723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:38273 (local address 127.11.229.130:46073)
0923 17:18:11.821979 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:11.821991 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:11.822072 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:11.822329 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:11.822332 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:11.822348 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0923 17:18:11.822431 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:11.822435 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:11.823387 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:11.823390 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:11.824523 (+ 1133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:11.824533 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:11.825384 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:11.825391 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:11.825476 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:11.825509 (+ 33us) client_negotiation.cc:769] Sending connection context
0923 17:18:11.825573 (+ 64us) client_negotiation.cc:240] Negotiation successful
0923 17:18:11.825621 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":107,"threads_started":1}
I20260923 17:18:11.825760 32407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:11.821839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.229.130:46073 (local address 127.11.229.129:38273)
0923 17:18:11.821969 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:11.821974 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:11.822078 (+ 104us) server_negotiation.cc:407] Connection header received
0923 17:18:11.822165 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:11.822167 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:11.822210 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:11.822317 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0923 17:18:11.822540 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:11.823298 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:11.824636 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:11.825272 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:11.825423 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:11.825467 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:11.825587 (+ 120us) server_negotiation.cc:299] Negotiation successful
0923 17:18:11.825649 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260923 17:18:11.826532 32347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d5fda950acf4778a83fbf8d312ef50c" candidate_uuid: "927a0905817548b99bed52c82615f45f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73dfe02f79894d59a421bdb5fdf59ad1" is_pre_election: true
I20260923 17:18:11.826786 32085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d5fda950acf4778a83fbf8d312ef50c" candidate_uuid: "927a0905817548b99bed52c82615f45f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67d5dde115454a669a59ff9d31c6a95c" is_pre_election: true
I20260923 17:18:11.826871 32347 raft_consensus.cc:2454] T 2d5fda950acf4778a83fbf8d312ef50c P 73dfe02f79894d59a421bdb5fdf59ad1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 927a0905817548b99bed52c82615f45f in term 0.
I20260923 17:18:11.827054 32085 raft_consensus.cc:2454] T 2d5fda950acf4778a83fbf8d312ef50c P 67d5dde115454a669a59ff9d31c6a95c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 927a0905817548b99bed52c82615f45f in term 0.
I20260923 17:18:11.827432 32149 leader_election.cc:302] T 2d5fda950acf4778a83fbf8d312ef50c P 927a0905817548b99bed52c82615f45f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 73dfe02f79894d59a421bdb5fdf59ad1, 927a0905817548b99bed52c82615f45f; no voters:
I20260923 17:18:11.827673 32417 raft_consensus.cc:2781] T 2d5fda950acf4778a83fbf8d312ef50c P 927a0905817548b99bed52c82615f45f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260923 17:18:11.827905 32417 raft_consensus.cc:482] T 2d5fda950acf4778a83fbf8d312ef50c P 927a0905817548b99bed52c82615f45f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260923 17:18:11.828014 32417 raft_consensus.cc:3037] T 2d5fda950acf4778a83fbf8d312ef50c P 927a0905817548b99bed52c82615f45f [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:18:11.829044 32417 raft_consensus.cc:504] T 2d5fda950acf4778a83fbf8d312ef50c P 927a0905817548b99bed52c82615f45f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73dfe02f79894d59a421bdb5fdf59ad1" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 36313 } } peers { permanent_uuid: "67d5dde115454a669a59ff9d31c6a95c" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38273 } } peers { permanent_uuid: "927a0905817548b99bed52c82615f45f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44543 } }
I20260923 17:18:11.829391 32417 leader_election.cc:288] T 2d5fda950acf4778a83fbf8d312ef50c P 927a0905817548b99bed52c82615f45f [CANDIDATE]: Term 1 election: Requested vote from peers 73dfe02f79894d59a421bdb5fdf59ad1 (127.11.229.131:36313), 67d5dde115454a669a59ff9d31c6a95c (127.11.229.129:38273)
I20260923 17:18:11.829797 32347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d5fda950acf4778a83fbf8d312ef50c" candidate_uuid: "927a0905817548b99bed52c82615f45f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73dfe02f79894d59a421bdb5fdf59ad1"
I20260923 17:18:11.829818 32085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2d5fda950acf4778a83fbf8d312ef50c" candidate_uuid: "927a0905817548b99bed52c82615f45f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67d5dde115454a669a59ff9d31c6a95c"
I20260923 17:18:11.829927 32085 raft_consensus.cc:3037] T 2d5fda950acf4778a83fbf8d312ef50c P 67d5dde115454a669a59ff9d31c6a95c [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:18:11.829926 32347 raft_consensus.cc:3037] T 2d5fda950acf4778a83fbf8d312ef50c P 73dfe02f79894d59a421bdb5fdf59ad1 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:18:11.831199 32347 raft_consensus.cc:2454] T 2d5fda950acf4778a83fbf8d312ef50c P 73dfe02f79894d59a421bdb5fdf59ad1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 927a0905817548b99bed52c82615f45f in term 1.
I20260923 17:18:11.831209 32085 raft_consensus.cc:2454] T 2d5fda950acf4778a83fbf8d312ef50c P 67d5dde115454a669a59ff9d31c6a95c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 927a0905817548b99bed52c82615f45f in term 1.
I20260923 17:18:11.831487 32149 leader_election.cc:302] T 2d5fda950acf4778a83fbf8d312ef50c P 927a0905817548b99bed52c82615f45f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67d5dde115454a669a59ff9d31c6a95c, 927a0905817548b99bed52c82615f45f; no voters:
I20260923 17:18:11.831640 32417 raft_consensus.cc:2781] T 2d5fda950acf4778a83fbf8d312ef50c P 927a0905817548b99bed52c82615f45f [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:18:11.831847 32417 raft_consensus.cc:686] T 2d5fda950acf4778a83fbf8d312ef50c P 927a0905817548b99bed52c82615f45f [term 1 LEADER]: Becoming Leader. State: Replica: 927a0905817548b99bed52c82615f45f, State: Running, Role: LEADER
I20260923 17:18:11.832182 32417 consensus_queue.cc:237] T 2d5fda950acf4778a83fbf8d312ef50c P 927a0905817548b99bed52c82615f45f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73dfe02f79894d59a421bdb5fdf59ad1" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 36313 } } peers { permanent_uuid: "67d5dde115454a669a59ff9d31c6a95c" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38273 } } peers { permanent_uuid: "927a0905817548b99bed52c82615f45f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44543 } }
W20260923 17:18:11.832875 32263 tablet.cc:2369] T 2d5fda950acf4778a83fbf8d312ef50c P 927a0905817548b99bed52c82615f45f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260923 17:18:11.835424 31941 catalog_manager.cc:5495] T 2d5fda950acf4778a83fbf8d312ef50c P 927a0905817548b99bed52c82615f45f reported cstate change: term changed from 0 to 1, leader changed from <none> to 927a0905817548b99bed52c82615f45f (127.11.229.130). New cstate: current_term: 1 leader_uuid: "927a0905817548b99bed52c82615f45f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73dfe02f79894d59a421bdb5fdf59ad1" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 36313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67d5dde115454a669a59ff9d31c6a95c" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38273 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "927a0905817548b99bed52c82615f45f" member_type: VOTER last_known_addr { host: "127.11.229.130" port: 44543 } health_report { overall_health: HEALTHY } } }
I20260923 17:18:11.869796 32409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:11.866328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57338 (local address 127.11.229.130:44543)
0923 17:18:11.866468 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:11.866475 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:11.866493 (+ 18us) server_negotiation.cc:407] Connection header received
0923 17:18:11.866579 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:11.866581 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:11.866635 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:11.866744 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 17:18:11.866977 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:11.867488 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:11.868350 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:11.868568 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:11.868678 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:11.868981 (+ 303us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 17:18:11.869390 (+ 409us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 17:18:11.869516 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:11.869582 (+ 66us) server_negotiation.cc:299] Negotiation successful
0923 17:18:11.869635 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260923 17:18:11.875329 32085 raft_consensus.cc:1261] T 2d5fda950acf4778a83fbf8d312ef50c P 67d5dde115454a669a59ff9d31c6a95c [term 1 FOLLOWER]: Refusing update from remote peer 927a0905817548b99bed52c82615f45f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:18:11.875327 32347 raft_consensus.cc:1261] T 2d5fda950acf4778a83fbf8d312ef50c P 73dfe02f79894d59a421bdb5fdf59ad1 [term 1 FOLLOWER]: Refusing update from remote peer 927a0905817548b99bed52c82615f45f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:18:11.875991 32420 consensus_queue.cc:1035] T 2d5fda950acf4778a83fbf8d312ef50c P 927a0905817548b99bed52c82615f45f [LEADER]: Connected to new peer: Peer: permanent_uuid: "67d5dde115454a669a59ff9d31c6a95c" member_type: VOTER last_known_addr { host: "127.11.229.129" port: 38273 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:18:11.876190 32417 consensus_queue.cc:1035] T 2d5fda950acf4778a83fbf8d312ef50c P 927a0905817548b99bed52c82615f45f [LEADER]: Connected to new peer: Peer: permanent_uuid: "73dfe02f79894d59a421bdb5fdf59ad1" member_type: VOTER last_known_addr { host: "127.11.229.131" port: 36313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:18:11.883123 32423 mvcc.cc:205] Tried to move back new op lower bound from 7332593221114556416 to 7332593220947505152. Current Snapshot: MvccSnapshot[applied={T|T < 7332593221114556416}]
I20260923 17:18:11.887581 32425 mvcc.cc:205] Tried to move back new op lower bound from 7332593221114556416 to 7332593220947505152. Current Snapshot: MvccSnapshot[applied={T|T < 7332593221114556416 or (T in {7332593221114556416})}]
I20260923 17:18:11.887876 32424 mvcc.cc:205] Tried to move back new op lower bound from 7332593221114556416 to 7332593220947505152. Current Snapshot: MvccSnapshot[applied={T|T < 7332593221114556416 or (T in {7332593221114556416})}]
I20260923 17:18:11.900823 31941 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48864:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:18:11.901005 31941 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48864:
table { table_name: "test-table" } modify_external_catalogs: true
I20260923 17:18:11.904181 31941 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 081d04282f33441eb71d56998ee562b8: Sending DeleteTablet for 3 replicas of tablet 2d5fda950acf4778a83fbf8d312ef50c
I20260923 17:18:11.905263 32065 tablet_service.cc:1514] Processing DeleteTablet for tablet 2d5fda950acf4778a83fbf8d312ef50c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:18:11 UTC) from {username='slave'} at 127.0.0.1:38958
I20260923 17:18:11.905438 32196 tablet_service.cc:1514] Processing DeleteTablet for tablet 2d5fda950acf4778a83fbf8d312ef50c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:18:11 UTC) from {username='slave'} at 127.0.0.1:57334
I20260923 17:18:11.905856 32327 tablet_service.cc:1514] Processing DeleteTablet for tablet 2d5fda950acf4778a83fbf8d312ef50c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-23 17:18:11 UTC) from {username='slave'} at 127.0.0.1:34732
I20260923 17:18:11.906406 32435 tablet_replica.cc:330] T 2d5fda950acf4778a83fbf8d312ef50c P 73dfe02f79894d59a421bdb5fdf59ad1: stopping tablet replica
I20260923 17:18:11.906809 32435 raft_consensus.cc:2229] T 2d5fda950acf4778a83fbf8d312ef50c P 73dfe02f79894d59a421bdb5fdf59ad1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260923 17:18:11.906836 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 32003
I20260923 17:18:11.908423 32435 raft_consensus.cc:2258] T 2d5fda950acf4778a83fbf8d312ef50c P 73dfe02f79894d59a421bdb5fdf59ad1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:18:11.908807 32434 tablet_replica.cc:330] T 2d5fda950acf4778a83fbf8d312ef50c P 927a0905817548b99bed52c82615f45f: stopping tablet replica
I20260923 17:18:11.909076 32434 raft_consensus.cc:2229] T 2d5fda950acf4778a83fbf8d312ef50c P 927a0905817548b99bed52c82615f45f [term 1 LEADER]: Raft consensus shutting down.
I20260923 17:18:11.909446 32434 raft_consensus.cc:2258] T 2d5fda950acf4778a83fbf8d312ef50c P 927a0905817548b99bed52c82615f45f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260923 17:18:11.910955 32434 ts_tablet_manager.cc:1905] T 2d5fda950acf4778a83fbf8d312ef50c P 927a0905817548b99bed52c82615f45f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:18:11.914888 32434 ts_tablet_manager.cc:1918] T 2d5fda950acf4778a83fbf8d312ef50c P 927a0905817548b99bed52c82615f45f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 17:18:11.915058 32434 log.cc:1196] T 2d5fda950acf4778a83fbf8d312ef50c P 927a0905817548b99bed52c82615f45f: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-1/wal/wals/2d5fda950acf4778a83fbf8d312ef50c
I20260923 17:18:11.915474 32434 ts_tablet_manager.cc:1939] T 2d5fda950acf4778a83fbf8d312ef50c P 927a0905817548b99bed52c82615f45f: Deleting consensus metadata
I20260923 17:18:11.916780 31927 catalog_manager.cc:4841] TS 927a0905817548b99bed52c82615f45f (127.11.229.130:44543): tablet 2d5fda950acf4778a83fbf8d312ef50c (table test-table [id=25925a8370994af48889e516e70bfa8f]) successfully deleted
I20260923 17:18:11.916940 32435 ts_tablet_manager.cc:1905] T 2d5fda950acf4778a83fbf8d312ef50c P 73dfe02f79894d59a421bdb5fdf59ad1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260923 17:18:11.919116 32435 ts_tablet_manager.cc:1918] T 2d5fda950acf4778a83fbf8d312ef50c P 73dfe02f79894d59a421bdb5fdf59ad1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260923 17:18:11.919215 32435 log.cc:1196] T 2d5fda950acf4778a83fbf8d312ef50c P 73dfe02f79894d59a421bdb5fdf59ad1: Deleting WAL directory at /tmp/dist-test-taskks427P/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790183633736342-12182-0/minicluster-data/ts-2/wal/wals/2d5fda950acf4778a83fbf8d312ef50c
W20260923 17:18:11.919438 31927 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.229.129:38273 (error 108)
I20260923 17:18:11.919479 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 32134
I20260923 17:18:11.919525 32435 ts_tablet_manager.cc:1939] T 2d5fda950acf4778a83fbf8d312ef50c P 73dfe02f79894d59a421bdb5fdf59ad1: Deleting consensus metadata
I20260923 17:18:11.921625 32406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:11.921329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.129:38273 (local address 127.0.0.1:38970)
0923 17:18:11.921463 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:11.921535 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.129:38273: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260923 17:18:11.921844 31927 catalog_manager.cc:4584] TS 67d5dde115454a669a59ff9d31c6a95c (127.11.229.129:38273): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2d5fda950acf4778a83fbf8d312ef50c: Network error: Client connection negotiation failed: client connection to 127.11.229.129:38273: connect: Connection refused (error 111)
I20260923 17:18:11.922080 31927 catalog_manager.cc:4841] TS 73dfe02f79894d59a421bdb5fdf59ad1 (127.11.229.131:36313): tablet 2d5fda950acf4778a83fbf8d312ef50c (table test-table [id=25925a8370994af48889e516e70bfa8f]) successfully deleted
I20260923 17:18:11.925086 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 32265
I20260923 17:18:11.930471 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 31912
2026-09-23T17:18:11Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1229 ms)
[----------] 6 tests from EncryptionPolicyTest (10585 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790183633736342-12182-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 17:18:11 dist-test-slave-1x1f krb5kdc[32439](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 17:18:11 dist-test-slave-1x1f krb5kdc[32439](info): set up 2 sockets
Sep 23 17:18:11 dist-test-slave-1x1f krb5kdc[32439](info): commencing operation
krb5kdc: starting...
W20260923 17:18:12.994812 12182 mini_kdc.cc:121] Time spent starting KDC: real 1.043s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Sep 23 17:18:13 dist-test-slave-1x1f krb5kdc[32439](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183893, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T17:18:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:18:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790183633736342-12182-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790183633736342-12182-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260923 17:18:13.119490 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37267
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790183633736342-12182-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45509
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37267
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:18:13.227809 32452 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:18:13.228071 32452 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:18:13.228148 32452 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:18:13.232079 32452 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:18:13.232139 32452 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:18:13.232158 32452 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:18:13.232175 32452 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:18:13.232223 32452 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:18:13.237382 32452 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45509
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37267
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790183633736342-12182-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37267
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32452
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:18:13.238399 32452 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:18:13.239473 32452 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:18:13.247929 32460 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:13.247987 32457 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:13.247942 32458 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:13.248260 32452 server_base.cc:1034] running on GCE node
I20260923 17:18:13.248839 32452 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:18:13.249866 32452 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:18:13.251019 32452 hybrid_clock.cc:648] HybridClock initialized: now 1790183893250985 us; error 45 us; skew 500 ppm
Sep 23 17:18:13 dist-test-slave-1x1f krb5kdc[32439](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183893, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:18:13.264029 32452 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260923 17:18:13.264919 32452 webserver.cc:460] Webserver started at http://127.0.0.1:40539/ using document root <none> and password file <none>
I20260923 17:18:13.265488 32452 fs_manager.cc:359] Metadata directory not provided
I20260923 17:18:13.265548 32452 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:18:13.265710 32452 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:18:13.267745 32452 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "438a5cb7386c46fa919b0d7b07c5a8df"
format_stamp: "Formatted at 2026-09-23 17:18:13 on dist-test-slave-1x1f"
server_key: "c9b88acf95c4ec211f1d4eb116531c59"
server_key_iv: "960c636ae881a3c808e55676b38e1da4"
server_key_version: "encryptionkey@0"
I20260923 17:18:13.268249 32452 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "438a5cb7386c46fa919b0d7b07c5a8df"
format_stamp: "Formatted at 2026-09-23 17:18:13 on dist-test-slave-1x1f"
server_key: "c9b88acf95c4ec211f1d4eb116531c59"
server_key_iv: "960c636ae881a3c808e55676b38e1da4"
server_key_version: "encryptionkey@0"
I20260923 17:18:13.271836 32452 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.005s sys 0.000s
I20260923 17:18:13.274470 32467 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:13.275808 32452 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 17:18:13.275913 32452 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "438a5cb7386c46fa919b0d7b07c5a8df"
format_stamp: "Formatted at 2026-09-23 17:18:13 on dist-test-slave-1x1f"
server_key: "c9b88acf95c4ec211f1d4eb116531c59"
server_key_iv: "960c636ae881a3c808e55676b38e1da4"
server_key_version: "encryptionkey@0"
I20260923 17:18:13.276002 32452 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:18:13.302460 32452 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:18:13.305686 32452 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:18:13.305882 32452 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:18:13.313162 32452 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37267
I20260923 17:18:13.313463 32519 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37267 every 8 connection(s)
I20260923 17:18:13.314155 32452 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:18:13.316026 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 32452
I20260923 17:18:13.316124 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:18:13.316464 12182 external_mini_cluster.cc:1428] Setting key e392a0e5bfeec60b3537649b3c793673
I20260923 17:18:13.317169 32520 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:18:13.324373 32520 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 438a5cb7386c46fa919b0d7b07c5a8df: Bootstrap starting.
Sep 23 17:18:13 dist-test-slave-1x1f krb5kdc[32439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183893, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260923 17:18:13.326792 32520 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 438a5cb7386c46fa919b0d7b07c5a8df: Neither blocks nor log segments found. Creating new log.
I20260923 17:18:13.327518 32520 log.cc:824] T 00000000000000000000000000000000 P 438a5cb7386c46fa919b0d7b07c5a8df: Log is configured to *not* fsync() on all Append() calls
I20260923 17:18:13.329615 32520 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 438a5cb7386c46fa919b0d7b07c5a8df: No bootstrap required, opened a new log
I20260923 17:18:13.330991 32523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:13.317798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51747 (local address 127.0.0.1:37267)
0923 17:18:13.318218 (+ 420us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:13.318295 (+ 77us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:13.318339 (+ 44us) server_negotiation.cc:407] Connection header received
0923 17:18:13.319014 (+ 675us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:13.319030 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:13.319393 (+ 363us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:13.319702 (+ 309us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:13.320601 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:13.321630 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:13.322793 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:13.323282 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:13.323406 (+ 124us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:13.326142 (+ 2736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:13.326147 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:13.326158 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:13.326186 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:13.328136 (+ 1950us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:13.328727 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:13.328731 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:13.328736 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:13.328856 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:13.329174 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:13.329176 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:13.329177 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:13.329564 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:13.329779 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:13.330030 (+ 251us) server_negotiation.cc:299] Negotiation successful
0923 17:18:13.330271 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":267,"thread_start_us":115,"threads_started":1}
I20260923 17:18:13.333710 32520 raft_consensus.cc:348] T 00000000000000000000000000000000 P 438a5cb7386c46fa919b0d7b07c5a8df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "438a5cb7386c46fa919b0d7b07c5a8df" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37267 } }
I20260923 17:18:13.333922 12182 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 17:18:13.333968 32520 raft_consensus.cc:374] T 00000000000000000000000000000000 P 438a5cb7386c46fa919b0d7b07c5a8df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:18:13.334045 32520 raft_consensus.cc:729] T 00000000000000000000000000000000 P 438a5cb7386c46fa919b0d7b07c5a8df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 438a5cb7386c46fa919b0d7b07c5a8df, State: Initialized, Role: FOLLOWER
I20260923 17:18:13.334506 32520 consensus_queue.cc:260] T 00000000000000000000000000000000 P 438a5cb7386c46fa919b0d7b07c5a8df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "438a5cb7386c46fa919b0d7b07c5a8df" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37267 } }
I20260923 17:18:13.334625 32520 raft_consensus.cc:388] T 00000000000000000000000000000000 P 438a5cb7386c46fa919b0d7b07c5a8df [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:18:13.334704 32520 raft_consensus.cc:482] T 00000000000000000000000000000000 P 438a5cb7386c46fa919b0d7b07c5a8df [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:18:13.334797 32520 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 438a5cb7386c46fa919b0d7b07c5a8df [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:18:13.335774 32520 raft_consensus.cc:504] T 00000000000000000000000000000000 P 438a5cb7386c46fa919b0d7b07c5a8df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "438a5cb7386c46fa919b0d7b07c5a8df" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37267 } }
I20260923 17:18:13.336154 32520 leader_election.cc:302] T 00000000000000000000000000000000 P 438a5cb7386c46fa919b0d7b07c5a8df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 438a5cb7386c46fa919b0d7b07c5a8df; no voters:
I20260923 17:18:13.336536 32520 leader_election.cc:288] T 00000000000000000000000000000000 P 438a5cb7386c46fa919b0d7b07c5a8df [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 17:18:13.336628 32530 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 438a5cb7386c46fa919b0d7b07c5a8df [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:18:13.336858 32530 raft_consensus.cc:686] T 00000000000000000000000000000000 P 438a5cb7386c46fa919b0d7b07c5a8df [term 1 LEADER]: Becoming Leader. State: Replica: 438a5cb7386c46fa919b0d7b07c5a8df, State: Running, Role: LEADER
I20260923 17:18:13.337265 32530 consensus_queue.cc:237] T 00000000000000000000000000000000 P 438a5cb7386c46fa919b0d7b07c5a8df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "438a5cb7386c46fa919b0d7b07c5a8df" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37267 } }
I20260923 17:18:13.337700 32520 sys_catalog.cc:564] T 00000000000000000000000000000000 P 438a5cb7386c46fa919b0d7b07c5a8df [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:18:13.338918 32531 sys_catalog.cc:455] T 00000000000000000000000000000000 P 438a5cb7386c46fa919b0d7b07c5a8df [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "438a5cb7386c46fa919b0d7b07c5a8df" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "438a5cb7386c46fa919b0d7b07c5a8df" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37267 } } }
I20260923 17:18:13.339043 32531 sys_catalog.cc:458] T 00000000000000000000000000000000 P 438a5cb7386c46fa919b0d7b07c5a8df [sys.catalog]: This master's current role is: LEADER
I20260923 17:18:13.339267 32531 sys_catalog.cc:455] T 00000000000000000000000000000000 P 438a5cb7386c46fa919b0d7b07c5a8df [sys.catalog]: SysCatalogTable state changed. Reason: New leader 438a5cb7386c46fa919b0d7b07c5a8df. Latest consensus state: current_term: 1 leader_uuid: "438a5cb7386c46fa919b0d7b07c5a8df" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "438a5cb7386c46fa919b0d7b07c5a8df" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37267 } } }
I20260923 17:18:13.339331 32531 sys_catalog.cc:458] T 00000000000000000000000000000000 P 438a5cb7386c46fa919b0d7b07c5a8df [sys.catalog]: This master's current role is: LEADER
I20260923 17:18:13.339687 32541 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:18:13.343218 32541 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:18:13.345808 32523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:13.336104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34065 (local address 127.0.0.1:37267)
0923 17:18:13.336236 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:13.336240 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:13.336390 (+ 150us) server_negotiation.cc:407] Connection header received
0923 17:18:13.336566 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:13.336570 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:13.336619 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:13.336705 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:13.337603 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:13.338386 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:13.339628 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:13.339949 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:13.340021 (+ 72us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:13.341941 (+ 1920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:13.341945 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:13.341948 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:13.341972 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:13.343665 (+ 1693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:13.344232 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:13.344236 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:13.344237 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:13.344333 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:13.344731 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:13.344734 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:13.344736 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:13.344964 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:13.345099 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:13.345559 (+ 460us) server_negotiation.cc:299] Negotiation successful
0923 17:18:13.345660 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260923 17:18:13.349786 32541 catalog_manager.cc:1347] Generated new cluster ID: 6f2b41a301264205884c797140f71f7c
I20260923 17:18:13.349850 32541 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:18:13.363966 32541 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:18:13.365721 32541 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:18:13.373858 32541 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 438a5cb7386c46fa919b0d7b07c5a8df: Generated new TSK 0
I20260923 17:18:13.374616 32541 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 17:18:13.379989 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 32452
W20260923 17:18:13.385325 32437 connection.cc:535] client connection to 127.0.0.1:37267 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37267): Connection reset by peer (error 104)
2026-09-23T17:18:13Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1447 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790183633736342-12182-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 17:18:13 dist-test-slave-1x1f krb5kdc[32551](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 17:18:13 dist-test-slave-1x1f krb5kdc[32551](info): set up 2 sockets
Sep 23 17:18:13 dist-test-slave-1x1f krb5kdc[32551](info): commencing operation
krb5kdc: starting...
W20260923 17:18:14.482836 12182 mini_kdc.cc:121] Time spent starting KDC: real 1.083s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Sep 23 17:18:14 dist-test-slave-1x1f krb5kdc[32551](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183894, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T17:18:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:18:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790183633736342-12182-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790183633736342-12182-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260923 17:18:14.609084 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41749
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790183633736342-12182-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41749
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:18:14.720726 32564 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:18:14.721030 32564 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:18:14.721125 32564 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:18:14.725615 32564 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:18:14.725713 32564 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:18:14.725754 32564 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:18:14.725814 32564 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:18:14.725852 32564 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:18:14.731215 32564 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41749
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790183633736342-12182-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41749
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32564
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:18:14.732307 32564 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:18:14.733327 32564 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:18:14.741845 32572 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:14.741997 32569 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:14.741912 32564 server_base.cc:1034] running on GCE node
W20260923 17:18:14.741835 32570 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:14.742666 32564 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:18:14.743729 32564 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:18:14.744920 32564 hybrid_clock.cc:648] HybridClock initialized: now 1790183894744906 us; error 25 us; skew 500 ppm
Sep 23 17:18:14 dist-test-slave-1x1f krb5kdc[32551](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183894, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:18:14.747959 32564 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260923 17:18:14.748960 32564 webserver.cc:460] Webserver started at http://127.0.0.1:44161/ using document root <none> and password file <none>
I20260923 17:18:14.749608 32564 fs_manager.cc:359] Metadata directory not provided
I20260923 17:18:14.749713 32564 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:18:14.749969 32564 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:18:14.752333 32564 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "08fe9c9aff68499986cdf53121c74ac5"
format_stamp: "Formatted at 2026-09-23 17:18:14 on dist-test-slave-1x1f"
server_key: "6799c6ce0fe5fff2756603de56e4ccdc"
server_key_iv: "513497ead299a33818cb90fd016332a3"
server_key_version: "encryptionkey@0"
I20260923 17:18:14.752969 32564 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "08fe9c9aff68499986cdf53121c74ac5"
format_stamp: "Formatted at 2026-09-23 17:18:14 on dist-test-slave-1x1f"
server_key: "6799c6ce0fe5fff2756603de56e4ccdc"
server_key_iv: "513497ead299a33818cb90fd016332a3"
server_key_version: "encryptionkey@0"
I20260923 17:18:14.756934 32564 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260923 17:18:14.759619 32579 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:14.760982 32564 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260923 17:18:14.761150 32564 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "08fe9c9aff68499986cdf53121c74ac5"
format_stamp: "Formatted at 2026-09-23 17:18:14 on dist-test-slave-1x1f"
server_key: "6799c6ce0fe5fff2756603de56e4ccdc"
server_key_iv: "513497ead299a33818cb90fd016332a3"
server_key_version: "encryptionkey@0"
I20260923 17:18:14.761274 32564 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:18:14.793218 32564 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:18:14.796561 32564 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:18:14.796902 32564 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:18:14.804445 32564 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41749
I20260923 17:18:14.804472 32631 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41749 every 8 connection(s)
I20260923 17:18:14.805388 32564 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:18:14.805806 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 32564
I20260923 17:18:14.805994 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:18:14.806366 12182 external_mini_cluster.cc:1428] Setting key 4db3ece425cfd5d85f4c29f47ccee6f6
I20260923 17:18:14.808275 32632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:18:14.814118 32632 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 08fe9c9aff68499986cdf53121c74ac5: Bootstrap starting.
I20260923 17:18:14.816062 32635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:14.807906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40441 (local address 127.0.0.1:41749)
0923 17:18:14.808339 (+ 433us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:14.808355 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:14.808420 (+ 65us) server_negotiation.cc:407] Connection header received
0923 17:18:14.809108 (+ 688us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:14.809124 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:14.809451 (+ 327us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:14.809805 (+ 354us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:14.810220 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:14.811368 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:14.812466 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:14.812980 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:14.813161 (+ 181us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:14.814339 (+ 1178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:14.814344 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:14.814357 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:18:14.814769 (+ 412us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:14.814822 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:18:14.814845 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:14.814995 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:14.815194 (+ 199us) server_negotiation.cc:299] Negotiation successful
0923 17:18:14.815335 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":154,"threads_started":1}
I20260923 17:18:14.816437 32632 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 08fe9c9aff68499986cdf53121c74ac5: Neither blocks nor log segments found. Creating new log.
I20260923 17:18:14.817250 32632 log.cc:824] T 00000000000000000000000000000000 P 08fe9c9aff68499986cdf53121c74ac5: Log is configured to *not* fsync() on all Append() calls
I20260923 17:18:14.819314 12182 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 17:18:14.819461 32632 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 08fe9c9aff68499986cdf53121c74ac5: No bootstrap required, opened a new log
I20260923 17:18:14.823499 32632 raft_consensus.cc:348] T 00000000000000000000000000000000 P 08fe9c9aff68499986cdf53121c74ac5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08fe9c9aff68499986cdf53121c74ac5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41749 } }
I20260923 17:18:14.823779 32632 raft_consensus.cc:374] T 00000000000000000000000000000000 P 08fe9c9aff68499986cdf53121c74ac5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:18:14.823843 32632 raft_consensus.cc:729] T 00000000000000000000000000000000 P 08fe9c9aff68499986cdf53121c74ac5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08fe9c9aff68499986cdf53121c74ac5, State: Initialized, Role: FOLLOWER
I20260923 17:18:14.824251 32632 consensus_queue.cc:260] T 00000000000000000000000000000000 P 08fe9c9aff68499986cdf53121c74ac5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08fe9c9aff68499986cdf53121c74ac5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41749 } }
I20260923 17:18:14.824433 32632 raft_consensus.cc:388] T 00000000000000000000000000000000 P 08fe9c9aff68499986cdf53121c74ac5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:18:14.824504 32632 raft_consensus.cc:482] T 00000000000000000000000000000000 P 08fe9c9aff68499986cdf53121c74ac5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:18:14.824613 32632 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 08fe9c9aff68499986cdf53121c74ac5 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:18:14.825600 32635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:14.821342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60379 (local address 127.0.0.1:41749)
0923 17:18:14.821452 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:14.821455 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:14.821697 (+ 242us) server_negotiation.cc:407] Connection header received
0923 17:18:14.821737 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:14.821739 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:14.821776 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:14.821846 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:14.822154 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:14.822741 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:14.823882 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:14.824210 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:14.824310 (+ 100us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:14.825204 (+ 894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:14.825208 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:14.825211 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:18:14.825221 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:14.825244 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:18:14.825254 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:14.825333 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:14.825474 (+ 141us) server_negotiation.cc:299] Negotiation successful
0923 17:18:14.825503 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260923 17:18:14.825845 32632 raft_consensus.cc:504] T 00000000000000000000000000000000 P 08fe9c9aff68499986cdf53121c74ac5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08fe9c9aff68499986cdf53121c74ac5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41749 } }
I20260923 17:18:14.826225 32632 leader_election.cc:302] T 00000000000000000000000000000000 P 08fe9c9aff68499986cdf53121c74ac5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 08fe9c9aff68499986cdf53121c74ac5; no voters:
I20260923 17:18:14.826582 32632 leader_election.cc:288] T 00000000000000000000000000000000 P 08fe9c9aff68499986cdf53121c74ac5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 17:18:14.826709 32642 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 08fe9c9aff68499986cdf53121c74ac5 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:18:14.827021 32642 raft_consensus.cc:686] T 00000000000000000000000000000000 P 08fe9c9aff68499986cdf53121c74ac5 [term 1 LEADER]: Becoming Leader. State: Replica: 08fe9c9aff68499986cdf53121c74ac5, State: Running, Role: LEADER
I20260923 17:18:14.827386 32642 consensus_queue.cc:237] T 00000000000000000000000000000000 P 08fe9c9aff68499986cdf53121c74ac5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08fe9c9aff68499986cdf53121c74ac5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41749 } }
I20260923 17:18:14.827840 32632 sys_catalog.cc:564] T 00000000000000000000000000000000 P 08fe9c9aff68499986cdf53121c74ac5 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:18:14.829121 32644 sys_catalog.cc:455] T 00000000000000000000000000000000 P 08fe9c9aff68499986cdf53121c74ac5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 08fe9c9aff68499986cdf53121c74ac5. Latest consensus state: current_term: 1 leader_uuid: "08fe9c9aff68499986cdf53121c74ac5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08fe9c9aff68499986cdf53121c74ac5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41749 } } }
I20260923 17:18:14.829164 32643 sys_catalog.cc:455] T 00000000000000000000000000000000 P 08fe9c9aff68499986cdf53121c74ac5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "08fe9c9aff68499986cdf53121c74ac5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08fe9c9aff68499986cdf53121c74ac5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41749 } } }
I20260923 17:18:14.829257 32644 sys_catalog.cc:458] T 00000000000000000000000000000000 P 08fe9c9aff68499986cdf53121c74ac5 [sys.catalog]: This master's current role is: LEADER
I20260923 17:18:14.829257 32643 sys_catalog.cc:458] T 00000000000000000000000000000000 P 08fe9c9aff68499986cdf53121c74ac5 [sys.catalog]: This master's current role is: LEADER
I20260923 17:18:14.829638 32653 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:18:14.832754 32653 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:18:14.838737 32653 catalog_manager.cc:1347] Generated new cluster ID: 66478589947f4b068e86b54edf21550f
I20260923 17:18:14.838824 32653 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:18:14.854599 32653 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:18:14.855609 32653 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:18:14.862716 32653 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 08fe9c9aff68499986cdf53121c74ac5: Generated new TSK 0
I20260923 17:18:14.863425 32653 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 17:18:14.869863 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 32564
W20260923 17:18:14.875156 32549 connection.cc:535] client connection to 127.0.0.1:41749 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:41749): Connection reset by peer (error 104)
2026-09-23T17:18:14Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1490 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790183633736342-12182-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 17:18:14 dist-test-slave-1x1f krb5kdc[32663](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 17:18:14 dist-test-slave-1x1f krb5kdc[32663](info): set up 2 sockets
Sep 23 17:18:14 dist-test-slave-1x1f krb5kdc[32663](info): commencing operation
krb5kdc: starting...
W20260923 17:18:15.939052 12182 mini_kdc.cc:121] Time spent starting KDC: real 1.049s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Sep 23 17:18:16 dist-test-slave-1x1f krb5kdc[32663](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183896, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T17:18:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:18:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790183633736342-12182-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790183633736342-12182-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260923 17:18:16.070485 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45665
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790183633736342-12182-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45665
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:18:16.181129 32676 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:18:16.181412 32676 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:18:16.181454 32676 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:18:16.185523 32676 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:18:16.185595 32676 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:18:16.185614 32676 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:18:16.185631 32676 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:18:16.185647 32676 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:18:16.191048 32676 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45665
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790183633736342-12182-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45665
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32676
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:18:16.192106 32676 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:18:16.193096 32676 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:18:16.201638 32682 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:16.201675 32681 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:16.201675 32684 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:16.201898 32676 server_base.cc:1034] running on GCE node
I20260923 17:18:16.202533 32676 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:18:16.203701 32676 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:18:16.204949 32676 hybrid_clock.cc:648] HybridClock initialized: now 1790183896204922 us; error 51 us; skew 500 ppm
Sep 23 17:18:16 dist-test-slave-1x1f krb5kdc[32663](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183896, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:18:16.208094 32676 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260923 17:18:16.209141 32676 webserver.cc:460] Webserver started at http://127.0.0.1:38801/ using document root <none> and password file <none>
I20260923 17:18:16.209759 32676 fs_manager.cc:359] Metadata directory not provided
I20260923 17:18:16.209861 32676 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:18:16.210114 32676 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:18:16.212384 32676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "70177a25599e4fef9f06d1f667093c5d"
format_stamp: "Formatted at 2026-09-23 17:18:16 on dist-test-slave-1x1f"
server_key: "0eac42b0b87c8b6c5abde40a64c0eaeb"
server_key_iv: "043ddc438ae65a40414a4f91452a8f0b"
server_key_version: "encryptionkey@0"
I20260923 17:18:16.212996 32676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "70177a25599e4fef9f06d1f667093c5d"
format_stamp: "Formatted at 2026-09-23 17:18:16 on dist-test-slave-1x1f"
server_key: "0eac42b0b87c8b6c5abde40a64c0eaeb"
server_key_iv: "043ddc438ae65a40414a4f91452a8f0b"
server_key_version: "encryptionkey@0"
I20260923 17:18:16.217052 32676 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260923 17:18:16.219789 32691 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:16.221274 32676 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260923 17:18:16.221521 32676 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "70177a25599e4fef9f06d1f667093c5d"
format_stamp: "Formatted at 2026-09-23 17:18:16 on dist-test-slave-1x1f"
server_key: "0eac42b0b87c8b6c5abde40a64c0eaeb"
server_key_iv: "043ddc438ae65a40414a4f91452a8f0b"
server_key_version: "encryptionkey@0"
I20260923 17:18:16.221647 32676 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:18:16.226411 32676 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:18:16.229661 32676 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:18:16.229863 32676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:18:16.237201 32676 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45665
I20260923 17:18:16.237229 32743 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45665 every 8 connection(s)
I20260923 17:18:16.238135 32676 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:18:16.240998 32744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:18:16.246248 32744 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70177a25599e4fef9f06d1f667093c5d: Bootstrap starting.
I20260923 17:18:16.247186 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 32676
I20260923 17:18:16.247335 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:18:16.247665 12182 external_mini_cluster.cc:1428] Setting key 2486689a9256a1467097ce204eeac0c1
I20260923 17:18:16.249068 32744 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 70177a25599e4fef9f06d1f667093c5d: Neither blocks nor log segments found. Creating new log.
I20260923 17:18:16.249755 32744 log.cc:824] T 00000000000000000000000000000000 P 70177a25599e4fef9f06d1f667093c5d: Log is configured to *not* fsync() on all Append() calls
I20260923 17:18:16.251806 32744 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70177a25599e4fef9f06d1f667093c5d: No bootstrap required, opened a new log
I20260923 17:18:16.252734 32747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:16.248800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39475 (local address 127.0.0.1:45665)
0923 17:18:16.249298 (+ 498us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:16.249311 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:16.249344 (+ 33us) server_negotiation.cc:407] Connection header received
0923 17:18:16.250038 (+ 694us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:16.250055 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:16.250441 (+ 386us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:16.250819 (+ 378us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:16.251595 (+ 776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:16.251600 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:16.251622 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:18:16.251632 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:16.251683 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:18:16.251702 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:16.251820 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:16.251918 (+ 98us) server_negotiation.cc:299] Negotiation successful
0923 17:18:16.252070 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":138,"threads_started":1}
I20260923 17:18:16.255604 12182 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 17:18:16.255923 32744 raft_consensus.cc:348] T 00000000000000000000000000000000 P 70177a25599e4fef9f06d1f667093c5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70177a25599e4fef9f06d1f667093c5d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45665 } }
I20260923 17:18:16.256146 32744 raft_consensus.cc:374] T 00000000000000000000000000000000 P 70177a25599e4fef9f06d1f667093c5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:18:16.256220 32744 raft_consensus.cc:729] T 00000000000000000000000000000000 P 70177a25599e4fef9f06d1f667093c5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70177a25599e4fef9f06d1f667093c5d, State: Initialized, Role: FOLLOWER
I20260923 17:18:16.256614 32744 consensus_queue.cc:260] T 00000000000000000000000000000000 P 70177a25599e4fef9f06d1f667093c5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70177a25599e4fef9f06d1f667093c5d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45665 } }
I20260923 17:18:16.256764 32744 raft_consensus.cc:388] T 00000000000000000000000000000000 P 70177a25599e4fef9f06d1f667093c5d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:18:16.256852 32744 raft_consensus.cc:482] T 00000000000000000000000000000000 P 70177a25599e4fef9f06d1f667093c5d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:18:16.257027 32744 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 70177a25599e4fef9f06d1f667093c5d [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:18:16.257982 32744 raft_consensus.cc:504] T 00000000000000000000000000000000 P 70177a25599e4fef9f06d1f667093c5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70177a25599e4fef9f06d1f667093c5d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45665 } }
I20260923 17:18:16.258354 32744 leader_election.cc:302] T 00000000000000000000000000000000 P 70177a25599e4fef9f06d1f667093c5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 70177a25599e4fef9f06d1f667093c5d; no voters:
I20260923 17:18:16.258678 32744 leader_election.cc:288] T 00000000000000000000000000000000 P 70177a25599e4fef9f06d1f667093c5d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 17:18:16.258772 32754 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 70177a25599e4fef9f06d1f667093c5d [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:18:16.259032 32754 raft_consensus.cc:686] T 00000000000000000000000000000000 P 70177a25599e4fef9f06d1f667093c5d [term 1 LEADER]: Becoming Leader. State: Replica: 70177a25599e4fef9f06d1f667093c5d, State: Running, Role: LEADER
I20260923 17:18:16.259546 32747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:16.257737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59547 (local address 127.0.0.1:45665)
0923 17:18:16.257867 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:16.257874 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:16.258074 (+ 200us) server_negotiation.cc:407] Connection header received
0923 17:18:16.258271 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:16.258276 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:16.258313 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:16.258386 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:16.259115 (+ 729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:16.259130 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:16.259133 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:18:16.259146 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:16.259173 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:18:16.259186 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:16.259245 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:16.259403 (+ 158us) server_negotiation.cc:299] Negotiation successful
0923 17:18:16.259442 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260923 17:18:16.259408 32754 consensus_queue.cc:237] T 00000000000000000000000000000000 P 70177a25599e4fef9f06d1f667093c5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70177a25599e4fef9f06d1f667093c5d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45665 } }
I20260923 17:18:16.259933 32744 sys_catalog.cc:564] T 00000000000000000000000000000000 P 70177a25599e4fef9f06d1f667093c5d [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:18:16.261368 32756 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70177a25599e4fef9f06d1f667093c5d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 70177a25599e4fef9f06d1f667093c5d. Latest consensus state: current_term: 1 leader_uuid: "70177a25599e4fef9f06d1f667093c5d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70177a25599e4fef9f06d1f667093c5d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45665 } } }
I20260923 17:18:16.261399 32755 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70177a25599e4fef9f06d1f667093c5d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "70177a25599e4fef9f06d1f667093c5d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70177a25599e4fef9f06d1f667093c5d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45665 } } }
I20260923 17:18:16.261482 32756 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70177a25599e4fef9f06d1f667093c5d [sys.catalog]: This master's current role is: LEADER
I20260923 17:18:16.261492 32755 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70177a25599e4fef9f06d1f667093c5d [sys.catalog]: This master's current role is: LEADER
I20260923 17:18:16.261828 32765 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:18:16.264390 32765 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:18:16.269608 32765 catalog_manager.cc:1347] Generated new cluster ID: 00718891ccbc4e2bbf14911dbfb31ffd
I20260923 17:18:16.269711 32765 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:18:16.280208 32765 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:18:16.280514 32765 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:18:16.290527 32765 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 70177a25599e4fef9f06d1f667093c5d: Generated new TSK 0
I20260923 17:18:16.291400 32765 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 17:18:16.295646 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 32676
2026-09-23T17:18:16Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1426 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790183633736342-12182-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 17:18:16 dist-test-slave-1x1f krb5kdc[307](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 17:18:16 dist-test-slave-1x1f krb5kdc[307](info): set up 2 sockets
Sep 23 17:18:16 dist-test-slave-1x1f krb5kdc[307](info): commencing operation
krb5kdc: starting...
W20260923 17:18:17.366825 12182 mini_kdc.cc:121] Time spent starting KDC: real 1.050s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Sep 23 17:18:17 dist-test-slave-1x1f krb5kdc[307](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183897, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T17:18:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:18:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790183633736342-12182-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790183633736342-12182-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260923 17:18:17.491536 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40389
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790183633736342-12182-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36749
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40389
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:18:17.618845 320 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:18:17.619143 320 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:18:17.619235 320 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:18:17.623360 320 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:18:17.623451 320 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:18:17.623490 320 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:18:17.623546 320 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:18:17.623586 320 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:18:17.628901 320 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36749
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40389
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790183633736342-12182-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40389
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.320
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:18:17.629966 320 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:18:17.631000 320 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:18:17.639518 328 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:17.639487 326 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:17.639488 325 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:17.639662 320 server_base.cc:1034] running on GCE node
I20260923 17:18:17.640430 320 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:18:17.641566 320 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:18:17.642729 320 hybrid_clock.cc:648] HybridClock initialized: now 1790183897642699 us; error 44 us; skew 500 ppm
Sep 23 17:18:17 dist-test-slave-1x1f krb5kdc[307](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183897, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:18:17.645637 320 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260923 17:18:17.646548 320 webserver.cc:460] Webserver started at http://127.0.0.1:46409/ using document root <none> and password file <none>
I20260923 17:18:17.647109 320 fs_manager.cc:359] Metadata directory not provided
I20260923 17:18:17.647174 320 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:18:17.647387 320 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:18:17.649398 320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "aa0bb7a0ce804f06958b5c3e2cc91933"
format_stamp: "Formatted at 2026-09-23 17:18:17 on dist-test-slave-1x1f"
server_key: "11a054b6a9e9a84b6979894816e0e14b"
server_key_iv: "865d1285c091526eee821468c11e944c"
server_key_version: "encryptionkey@0"
I20260923 17:18:17.649945 320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "aa0bb7a0ce804f06958b5c3e2cc91933"
format_stamp: "Formatted at 2026-09-23 17:18:17 on dist-test-slave-1x1f"
server_key: "11a054b6a9e9a84b6979894816e0e14b"
server_key_iv: "865d1285c091526eee821468c11e944c"
server_key_version: "encryptionkey@0"
I20260923 17:18:17.653667 320 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.006s sys 0.000s
I20260923 17:18:17.656332 335 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:17.657577 320 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260923 17:18:17.657723 320 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "aa0bb7a0ce804f06958b5c3e2cc91933"
format_stamp: "Formatted at 2026-09-23 17:18:17 on dist-test-slave-1x1f"
server_key: "11a054b6a9e9a84b6979894816e0e14b"
server_key_iv: "865d1285c091526eee821468c11e944c"
server_key_version: "encryptionkey@0"
I20260923 17:18:17.657841 320 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:18:17.679919 320 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:18:17.683596 320 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:18:17.683815 320 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:18:17.691533 320 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40389
I20260923 17:18:17.691573 387 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40389 every 8 connection(s)
I20260923 17:18:17.692509 320 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:18:17.695182 388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:18:17.698730 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 320
I20260923 17:18:17.698866 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:18:17.699172 12182 external_mini_cluster.cc:1428] Setting key 3b8a7e9c83c382614353a3623ccacb61
I20260923 17:18:17.700845 388 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa0bb7a0ce804f06958b5c3e2cc91933: Bootstrap starting.
I20260923 17:18:17.703289 388 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aa0bb7a0ce804f06958b5c3e2cc91933: Neither blocks nor log segments found. Creating new log.
I20260923 17:18:17.704017 388 log.cc:824] T 00000000000000000000000000000000 P aa0bb7a0ce804f06958b5c3e2cc91933: Log is configured to *not* fsync() on all Append() calls
I20260923 17:18:17.706144 388 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa0bb7a0ce804f06958b5c3e2cc91933: No bootstrap required, opened a new log
Sep 23 17:18:17 dist-test-slave-1x1f krb5kdc[307](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183897, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260923 17:18:17.710913 388 raft_consensus.cc:348] T 00000000000000000000000000000000 P aa0bb7a0ce804f06958b5c3e2cc91933 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa0bb7a0ce804f06958b5c3e2cc91933" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40389 } }
I20260923 17:18:17.711233 388 raft_consensus.cc:374] T 00000000000000000000000000000000 P aa0bb7a0ce804f06958b5c3e2cc91933 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:18:17.711309 388 raft_consensus.cc:729] T 00000000000000000000000000000000 P aa0bb7a0ce804f06958b5c3e2cc91933 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa0bb7a0ce804f06958b5c3e2cc91933, State: Initialized, Role: FOLLOWER
I20260923 17:18:17.711849 388 consensus_queue.cc:260] T 00000000000000000000000000000000 P aa0bb7a0ce804f06958b5c3e2cc91933 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa0bb7a0ce804f06958b5c3e2cc91933" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40389 } }
I20260923 17:18:17.712036 388 raft_consensus.cc:388] T 00000000000000000000000000000000 P aa0bb7a0ce804f06958b5c3e2cc91933 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:18:17.712113 388 raft_consensus.cc:482] T 00000000000000000000000000000000 P aa0bb7a0ce804f06958b5c3e2cc91933 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:18:17.712217 388 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aa0bb7a0ce804f06958b5c3e2cc91933 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:18:17.713392 388 raft_consensus.cc:504] T 00000000000000000000000000000000 P aa0bb7a0ce804f06958b5c3e2cc91933 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa0bb7a0ce804f06958b5c3e2cc91933" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40389 } }
I20260923 17:18:17.713761 388 leader_election.cc:302] T 00000000000000000000000000000000 P aa0bb7a0ce804f06958b5c3e2cc91933 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aa0bb7a0ce804f06958b5c3e2cc91933; no voters:
I20260923 17:18:17.714093 388 leader_election.cc:288] T 00000000000000000000000000000000 P aa0bb7a0ce804f06958b5c3e2cc91933 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 17:18:17.714211 393 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aa0bb7a0ce804f06958b5c3e2cc91933 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:18:17.714376 391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:17.700585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39487 (local address 127.0.0.1:40389)
0923 17:18:17.700976 (+ 391us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:17.700994 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:17.701039 (+ 45us) server_negotiation.cc:407] Connection header received
0923 17:18:17.701714 (+ 675us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:17.701730 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:17.702054 (+ 324us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:17.702407 (+ 353us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:17.703297 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:17.704500 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:17.705423 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:17.706146 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:17.706354 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:17.708810 (+ 2456us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:17.708818 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:17.708841 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:17.708882 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:17.710994 (+ 2112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:17.711559 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:17.711567 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:17.711573 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:17.711713 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:17.711978 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:17.711985 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:17.711987 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:17.712547 (+ 560us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:17.712733 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:17.712976 (+ 243us) server_negotiation.cc:299] Negotiation successful
0923 17:18:17.713312 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":262,"thread_start_us":135,"threads_started":1}
I20260923 17:18:17.714439 393 raft_consensus.cc:686] T 00000000000000000000000000000000 P aa0bb7a0ce804f06958b5c3e2cc91933 [term 1 LEADER]: Becoming Leader. State: Replica: aa0bb7a0ce804f06958b5c3e2cc91933, State: Running, Role: LEADER
I20260923 17:18:17.715023 393 consensus_queue.cc:237] T 00000000000000000000000000000000 P aa0bb7a0ce804f06958b5c3e2cc91933 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa0bb7a0ce804f06958b5c3e2cc91933" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40389 } }
I20260923 17:18:17.715425 388 sys_catalog.cc:564] T 00000000000000000000000000000000 P aa0bb7a0ce804f06958b5c3e2cc91933 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:18:17.716611 394 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa0bb7a0ce804f06958b5c3e2cc91933 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aa0bb7a0ce804f06958b5c3e2cc91933" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa0bb7a0ce804f06958b5c3e2cc91933" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40389 } } }
I20260923 17:18:17.716746 394 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa0bb7a0ce804f06958b5c3e2cc91933 [sys.catalog]: This master's current role is: LEADER
I20260923 17:18:17.717059 395 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa0bb7a0ce804f06958b5c3e2cc91933 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aa0bb7a0ce804f06958b5c3e2cc91933. Latest consensus state: current_term: 1 leader_uuid: "aa0bb7a0ce804f06958b5c3e2cc91933" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa0bb7a0ce804f06958b5c3e2cc91933" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40389 } } }
I20260923 17:18:17.717120 402 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:18:17.717144 395 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa0bb7a0ce804f06958b5c3e2cc91933 [sys.catalog]: This master's current role is: LEADER
I20260923 17:18:17.718585 12182 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 17:18:17.721004 402 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:18:17.727833 402 catalog_manager.cc:1347] Generated new cluster ID: b215ee81f5244eebaba8c5010bad8737
I20260923 17:18:17.728156 402 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:18:17.730475 391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:17.720621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38009 (local address 127.0.0.1:40389)
0923 17:18:17.720734 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:17.720738 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:17.720970 (+ 232us) server_negotiation.cc:407] Connection header received
0923 17:18:17.721349 (+ 379us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:17.721353 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:17.721403 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:17.721491 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:17.722516 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:17.723347 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:17.724282 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:17.725056 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:17.725189 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:17.726933 (+ 1744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:17.726937 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:17.726940 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:17.726967 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:17.728709 (+ 1742us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:17.729151 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:17.729156 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:17.729158 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:17.729239 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:17.729534 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:17.729540 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:17.729545 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:17.729723 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:17.729865 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:17.730115 (+ 250us) server_negotiation.cc:299] Negotiation successful
0923 17:18:17.730282 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260923 17:18:17.749526 402 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:18:17.750651 402 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:18:17.773291 402 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aa0bb7a0ce804f06958b5c3e2cc91933: Generated new TSK 0
I20260923 17:18:17.774087 402 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 17:18:17.782040 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 320
2026-09-23T17:18:17Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1485 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790183633736342-12182-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 17:18:17 dist-test-slave-1x1f krb5kdc[419](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 17:18:17 dist-test-slave-1x1f krb5kdc[419](info): set up 2 sockets
Sep 23 17:18:17 dist-test-slave-1x1f krb5kdc[419](info): commencing operation
krb5kdc: starting...
W20260923 17:18:18.839005 12182 mini_kdc.cc:121] Time spent starting KDC: real 1.037s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Sep 23 17:18:18 dist-test-slave-1x1f krb5kdc[419](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183898, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T17:18:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:18:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790183633736342-12182-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790183633736342-12182-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260923 17:18:18.969851 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45401
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790183633736342-12182-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37229
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45401
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:18:19.084481 432 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:18:19.084748 432 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:18:19.084789 432 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:18:19.088701 432 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:18:19.088754 432 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:18:19.088773 432 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:18:19.088790 432 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:18:19.088806 432 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:18:19.093875 432 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37229
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45401
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790183633736342-12182-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45401
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.432
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:18:19.094933 432 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:18:19.095870 432 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:18:19.104341 440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:19.104336 438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:19.104357 437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:19.104765 432 server_base.cc:1034] running on GCE node
I20260923 17:18:19.105294 432 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:18:19.106542 432 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:18:19.107736 432 hybrid_clock.cc:648] HybridClock initialized: now 1790183899107713 us; error 55 us; skew 500 ppm
Sep 23 17:18:19 dist-test-slave-1x1f krb5kdc[419](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183899, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:18:19.116236 432 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260923 17:18:19.117204 432 webserver.cc:460] Webserver started at http://127.0.0.1:40269/ using document root <none> and password file <none>
I20260923 17:18:19.117774 432 fs_manager.cc:359] Metadata directory not provided
I20260923 17:18:19.117867 432 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:18:19.118096 432 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:18:19.120179 432 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "b950d77c02c84af2adc1a8b01f89e138"
format_stamp: "Formatted at 2026-09-23 17:18:19 on dist-test-slave-1x1f"
server_key: "3db689901129acc552626c2fa1acabc6"
server_key_iv: "7a381f5899593e428ee534568f6740a1"
server_key_version: "encryptionkey@0"
I20260923 17:18:19.120781 432 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "b950d77c02c84af2adc1a8b01f89e138"
format_stamp: "Formatted at 2026-09-23 17:18:19 on dist-test-slave-1x1f"
server_key: "3db689901129acc552626c2fa1acabc6"
server_key_iv: "7a381f5899593e428ee534568f6740a1"
server_key_version: "encryptionkey@0"
I20260923 17:18:19.124591 432 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260923 17:18:19.127136 447 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:19.128364 432 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 17:18:19.128513 432 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "b950d77c02c84af2adc1a8b01f89e138"
format_stamp: "Formatted at 2026-09-23 17:18:19 on dist-test-slave-1x1f"
server_key: "3db689901129acc552626c2fa1acabc6"
server_key_iv: "7a381f5899593e428ee534568f6740a1"
server_key_version: "encryptionkey@0"
I20260923 17:18:19.128623 432 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:18:19.152904 432 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:18:19.155933 432 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:18:19.156162 432 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:18:19.163046 432 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45401
I20260923 17:18:19.163064 499 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45401 every 8 connection(s)
I20260923 17:18:19.164004 432 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:18:19.166698 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 432
I20260923 17:18:19.166836 500 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:18:19.166854 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:18:19.167168 12182 external_mini_cluster.cc:1428] Setting key 179ca3ba3b0386ef784846058b8681ec
I20260923 17:18:19.173556 500 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b950d77c02c84af2adc1a8b01f89e138: Bootstrap starting.
I20260923 17:18:19.176064 500 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b950d77c02c84af2adc1a8b01f89e138: Neither blocks nor log segments found. Creating new log.
I20260923 17:18:19.176772 500 log.cc:824] T 00000000000000000000000000000000 P b950d77c02c84af2adc1a8b01f89e138: Log is configured to *not* fsync() on all Append() calls
I20260923 17:18:19.176815 503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:19.168597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34893 (local address 127.0.0.1:45401)
0923 17:18:19.169040 (+ 443us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:19.169060 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:19.169095 (+ 35us) server_negotiation.cc:407] Connection header received
0923 17:18:19.170018 (+ 923us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:19.170038 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:19.170454 (+ 416us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:19.170768 (+ 314us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:19.171097 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:19.172165 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:19.173393 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:19.173966 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:19.174102 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:19.175047 (+ 945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:19.175054 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:19.175068 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:18:19.175473 (+ 405us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:19.175533 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:18:19.175557 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:19.175641 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:19.175835 (+ 194us) server_negotiation.cc:299] Negotiation successful
0923 17:18:19.176075 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":123,"threads_started":1}
I20260923 17:18:19.178850 500 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b950d77c02c84af2adc1a8b01f89e138: No bootstrap required, opened a new log
I20260923 17:18:19.179816 12182 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 17:18:19.183257 500 raft_consensus.cc:348] T 00000000000000000000000000000000 P b950d77c02c84af2adc1a8b01f89e138 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b950d77c02c84af2adc1a8b01f89e138" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45401 } }
I20260923 17:18:19.183516 500 raft_consensus.cc:374] T 00000000000000000000000000000000 P b950d77c02c84af2adc1a8b01f89e138 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:18:19.183570 500 raft_consensus.cc:729] T 00000000000000000000000000000000 P b950d77c02c84af2adc1a8b01f89e138 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b950d77c02c84af2adc1a8b01f89e138, State: Initialized, Role: FOLLOWER
I20260923 17:18:19.184010 500 consensus_queue.cc:260] T 00000000000000000000000000000000 P b950d77c02c84af2adc1a8b01f89e138 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b950d77c02c84af2adc1a8b01f89e138" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45401 } }
I20260923 17:18:19.184130 500 raft_consensus.cc:388] T 00000000000000000000000000000000 P b950d77c02c84af2adc1a8b01f89e138 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:18:19.184221 500 raft_consensus.cc:482] T 00000000000000000000000000000000 P b950d77c02c84af2adc1a8b01f89e138 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:18:19.184334 500 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b950d77c02c84af2adc1a8b01f89e138 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:18:19.185421 500 raft_consensus.cc:504] T 00000000000000000000000000000000 P b950d77c02c84af2adc1a8b01f89e138 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b950d77c02c84af2adc1a8b01f89e138" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45401 } }
I20260923 17:18:19.185765 500 leader_election.cc:302] T 00000000000000000000000000000000 P b950d77c02c84af2adc1a8b01f89e138 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b950d77c02c84af2adc1a8b01f89e138; no voters:
I20260923 17:18:19.186101 500 leader_election.cc:288] T 00000000000000000000000000000000 P b950d77c02c84af2adc1a8b01f89e138 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 17:18:19.186358 510 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b950d77c02c84af2adc1a8b01f89e138 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:18:19.186650 510 raft_consensus.cc:686] T 00000000000000000000000000000000 P b950d77c02c84af2adc1a8b01f89e138 [term 1 LEADER]: Becoming Leader. State: Replica: b950d77c02c84af2adc1a8b01f89e138, State: Running, Role: LEADER
I20260923 17:18:19.186813 503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:19.182104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50045 (local address 127.0.0.1:45401)
0923 17:18:19.182245 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:19.182252 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:19.182461 (+ 209us) server_negotiation.cc:407] Connection header received
0923 17:18:19.182610 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:19.182614 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:19.182656 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:19.182738 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:19.183072 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:19.183836 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:19.184874 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:19.185235 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:19.185351 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:19.186202 (+ 851us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:19.186205 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:19.186207 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:18:19.186218 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:19.186310 (+ 92us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:18:19.186326 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:19.186405 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:19.186584 (+ 179us) server_negotiation.cc:299] Negotiation successful
0923 17:18:19.186649 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260923 17:18:19.186978 510 consensus_queue.cc:237] T 00000000000000000000000000000000 P b950d77c02c84af2adc1a8b01f89e138 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b950d77c02c84af2adc1a8b01f89e138" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45401 } }
I20260923 17:18:19.187456 500 sys_catalog.cc:564] T 00000000000000000000000000000000 P b950d77c02c84af2adc1a8b01f89e138 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:18:19.188213 510 sys_catalog.cc:455] T 00000000000000000000000000000000 P b950d77c02c84af2adc1a8b01f89e138 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b950d77c02c84af2adc1a8b01f89e138. Latest consensus state: current_term: 1 leader_uuid: "b950d77c02c84af2adc1a8b01f89e138" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b950d77c02c84af2adc1a8b01f89e138" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45401 } } }
I20260923 17:18:19.188325 510 sys_catalog.cc:458] T 00000000000000000000000000000000 P b950d77c02c84af2adc1a8b01f89e138 [sys.catalog]: This master's current role is: LEADER
I20260923 17:18:19.188755 511 sys_catalog.cc:455] T 00000000000000000000000000000000 P b950d77c02c84af2adc1a8b01f89e138 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b950d77c02c84af2adc1a8b01f89e138" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b950d77c02c84af2adc1a8b01f89e138" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45401 } } }
I20260923 17:18:19.188917 511 sys_catalog.cc:458] T 00000000000000000000000000000000 P b950d77c02c84af2adc1a8b01f89e138 [sys.catalog]: This master's current role is: LEADER
W20260923 17:18:19.191991 525 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b950d77c02c84af2adc1a8b01f89e138: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 17:18:19.192085 525 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 17:18:19.192163 519 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:18:19.193074 519 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:18:19.199018 519 catalog_manager.cc:1347] Generated new cluster ID: 863fb530f6a14036850c1e9a581c19b5
I20260923 17:18:19.199080 519 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:18:19.211472 519 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:18:19.212781 519 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:18:19.218844 519 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b950d77c02c84af2adc1a8b01f89e138: Generated new TSK 0
I20260923 17:18:19.219666 519 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 17:18:19.224356 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 432
2026-09-23T17:18:19Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1442 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790183633736342-12182-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 17:18:19 dist-test-slave-1x1f krb5kdc[531](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 17:18:19 dist-test-slave-1x1f krb5kdc[531](info): set up 2 sockets
Sep 23 17:18:19 dist-test-slave-1x1f krb5kdc[531](info): commencing operation
krb5kdc: starting...
W20260923 17:18:20.315501 12182 mini_kdc.cc:121] Time spent starting KDC: real 1.071s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Sep 23 17:18:20 dist-test-slave-1x1f krb5kdc[531](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183900, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T17:18:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:18:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790183633736342-12182-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790183633736342-12182-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260923 17:18:20.445310 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39177
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790183633736342-12182-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39177
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:18:20.553643 544 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:18:20.553938 544 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:18:20.554013 544 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:18:20.557950 544 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:18:20.558065 544 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:18:20.558115 544 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:18:20.558149 544 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:18:20.558204 544 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:18:20.563467 544 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39177
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790183633736342-12182-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39177
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.544
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:18:20.564563 544 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:18:20.565603 544 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:18:20.574162 549 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:20.574184 552 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:20.574254 544 server_base.cc:1034] running on GCE node
W20260923 17:18:20.574203 550 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:20.574985 544 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:18:20.576094 544 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:18:20.577260 544 hybrid_clock.cc:648] HybridClock initialized: now 1790183900577241 us; error 28 us; skew 500 ppm
Sep 23 17:18:20 dist-test-slave-1x1f krb5kdc[531](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183900, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:18:20.579973 544 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260923 17:18:20.580878 544 webserver.cc:460] Webserver started at http://127.0.0.1:39221/ using document root <none> and password file <none>
I20260923 17:18:20.581410 544 fs_manager.cc:359] Metadata directory not provided
I20260923 17:18:20.581468 544 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:18:20.581676 544 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:18:20.583662 544 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "3a53772f05914931974e7a5c426ac7b9"
format_stamp: "Formatted at 2026-09-23 17:18:20 on dist-test-slave-1x1f"
server_key: "a6dfeb3c061ac87ed20319dd4b2a9067"
server_key_iv: "c8d70b352ffb31448f23b3fc97169f6a"
server_key_version: "encryptionkey@0"
I20260923 17:18:20.584196 544 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "3a53772f05914931974e7a5c426ac7b9"
format_stamp: "Formatted at 2026-09-23 17:18:20 on dist-test-slave-1x1f"
server_key: "a6dfeb3c061ac87ed20319dd4b2a9067"
server_key_iv: "c8d70b352ffb31448f23b3fc97169f6a"
server_key_version: "encryptionkey@0"
I20260923 17:18:20.587673 544 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260923 17:18:20.590032 559 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:20.591284 544 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 17:18:20.591385 544 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "3a53772f05914931974e7a5c426ac7b9"
format_stamp: "Formatted at 2026-09-23 17:18:20 on dist-test-slave-1x1f"
server_key: "a6dfeb3c061ac87ed20319dd4b2a9067"
server_key_iv: "c8d70b352ffb31448f23b3fc97169f6a"
server_key_version: "encryptionkey@0"
I20260923 17:18:20.591518 544 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:18:20.595935 544 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:18:20.598750 544 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:18:20.598927 544 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:18:20.605676 544 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39177
I20260923 17:18:20.605703 611 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39177 every 8 connection(s)
I20260923 17:18:20.606611 544 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:18:20.609311 612 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:18:20.611274 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 544
I20260923 17:18:20.611419 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:18:20.611706 12182 external_mini_cluster.cc:1428] Setting key 8cf5c1162c30e254f82933f76100ba4d
I20260923 17:18:20.615922 612 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a53772f05914931974e7a5c426ac7b9: Bootstrap starting.
I20260923 17:18:20.616734 615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:20.613102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54359 (local address 127.0.0.1:39177)
0923 17:18:20.613528 (+ 426us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:20.613542 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:20.613575 (+ 33us) server_negotiation.cc:407] Connection header received
0923 17:18:20.614192 (+ 617us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:20.614207 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:20.614548 (+ 341us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:20.614875 (+ 327us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:20.615624 (+ 749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:20.615628 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:20.615639 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:18:20.615649 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:20.615696 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:18:20.615722 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:20.615866 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:20.615934 (+ 68us) server_negotiation.cc:299] Negotiation successful
0923 17:18:20.616078 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":127,"threads_started":1}
I20260923 17:18:20.618554 612 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3a53772f05914931974e7a5c426ac7b9: Neither blocks nor log segments found. Creating new log.
I20260923 17:18:20.619432 612 log.cc:824] T 00000000000000000000000000000000 P 3a53772f05914931974e7a5c426ac7b9: Log is configured to *not* fsync() on all Append() calls
I20260923 17:18:20.619522 12182 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 17:18:20.621408 612 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a53772f05914931974e7a5c426ac7b9: No bootstrap required, opened a new log
I20260923 17:18:20.623170 615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:20.621439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55705 (local address 127.0.0.1:39177)
0923 17:18:20.621553 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:20.621559 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:20.621827 (+ 268us) server_negotiation.cc:407] Connection header received
0923 17:18:20.621966 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:20.621969 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:20.621999 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:20.622085 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:20.622800 (+ 715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:20.622803 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:20.622806 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:18:20.622816 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:20.622840 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:18:20.622853 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:20.622942 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:20.623021 (+ 79us) server_negotiation.cc:299] Negotiation successful
0923 17:18:20.623058 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260923 17:18:20.625403 612 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3a53772f05914931974e7a5c426ac7b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a53772f05914931974e7a5c426ac7b9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39177 } }
I20260923 17:18:20.625629 612 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3a53772f05914931974e7a5c426ac7b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:18:20.625663 612 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3a53772f05914931974e7a5c426ac7b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a53772f05914931974e7a5c426ac7b9, State: Initialized, Role: FOLLOWER
I20260923 17:18:20.626009 612 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a53772f05914931974e7a5c426ac7b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a53772f05914931974e7a5c426ac7b9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39177 } }
I20260923 17:18:20.626116 612 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3a53772f05914931974e7a5c426ac7b9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:18:20.626155 612 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3a53772f05914931974e7a5c426ac7b9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:18:20.626274 612 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3a53772f05914931974e7a5c426ac7b9 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:18:20.627162 612 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3a53772f05914931974e7a5c426ac7b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a53772f05914931974e7a5c426ac7b9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39177 } }
I20260923 17:18:20.627532 612 leader_election.cc:302] T 00000000000000000000000000000000 P 3a53772f05914931974e7a5c426ac7b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3a53772f05914931974e7a5c426ac7b9; no voters:
I20260923 17:18:20.627905 612 leader_election.cc:288] T 00000000000000000000000000000000 P 3a53772f05914931974e7a5c426ac7b9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 17:18:20.627991 622 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3a53772f05914931974e7a5c426ac7b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:18:20.628264 622 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3a53772f05914931974e7a5c426ac7b9 [term 1 LEADER]: Becoming Leader. State: Replica: 3a53772f05914931974e7a5c426ac7b9, State: Running, Role: LEADER
I20260923 17:18:20.628579 622 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3a53772f05914931974e7a5c426ac7b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a53772f05914931974e7a5c426ac7b9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39177 } }
I20260923 17:18:20.629134 612 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3a53772f05914931974e7a5c426ac7b9 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:18:20.630352 623 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a53772f05914931974e7a5c426ac7b9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3a53772f05914931974e7a5c426ac7b9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a53772f05914931974e7a5c426ac7b9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39177 } } }
I20260923 17:18:20.630362 624 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a53772f05914931974e7a5c426ac7b9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a53772f05914931974e7a5c426ac7b9. Latest consensus state: current_term: 1 leader_uuid: "3a53772f05914931974e7a5c426ac7b9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a53772f05914931974e7a5c426ac7b9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39177 } } }
I20260923 17:18:20.630558 624 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a53772f05914931974e7a5c426ac7b9 [sys.catalog]: This master's current role is: LEADER
I20260923 17:18:20.630774 623 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a53772f05914931974e7a5c426ac7b9 [sys.catalog]: This master's current role is: LEADER
I20260923 17:18:20.630914 631 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:18:20.633527 631 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:18:20.639026 631 catalog_manager.cc:1347] Generated new cluster ID: 9bf67eeab6344d35a10d33ff1614a0f4
I20260923 17:18:20.639087 631 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:18:20.662207 631 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:18:20.662621 631 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:18:20.671702 631 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3a53772f05914931974e7a5c426ac7b9: Generated new TSK 0
I20260923 17:18:20.672480 631 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 17:18:20.676254 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 544
2026-09-23T17:18:20Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1451 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790183633736342-12182-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 17:18:20 dist-test-slave-1x1f krb5kdc[643](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 17:18:20 dist-test-slave-1x1f krb5kdc[643](info): set up 2 sockets
Sep 23 17:18:20 dist-test-slave-1x1f krb5kdc[643](info): commencing operation
krb5kdc: starting...
W20260923 17:18:21.802846 12182 mini_kdc.cc:121] Time spent starting KDC: real 1.106s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Sep 23 17:18:21 dist-test-slave-1x1f krb5kdc[643](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183901, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T17:18:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:18:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790183633736342-12182-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790183633736342-12182-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260923 17:18:21.926494 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42755
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790183633736342-12182-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42755
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:18:22.036181 656 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:18:22.036499 656 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:18:22.036584 656 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:18:22.040618 656 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:18:22.040714 656 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:18:22.040755 656 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:18:22.040791 656 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:18:22.040824 656 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:18:22.046084 656 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42755
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790183633736342-12182-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42755
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.656
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:18:22.047222 656 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:18:22.048254 656 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:18:22.056841 664 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:22.056915 656 server_base.cc:1034] running on GCE node
W20260923 17:18:22.056936 662 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:22.056841 661 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:22.057601 656 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:18:22.058768 656 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:18:22.059959 656 hybrid_clock.cc:648] HybridClock initialized: now 1790183902059925 us; error 44 us; skew 500 ppm
Sep 23 17:18:22 dist-test-slave-1x1f krb5kdc[643](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183902, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:18:22.063220 656 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260923 17:18:22.064162 656 webserver.cc:460] Webserver started at http://127.0.0.1:42827/ using document root <none> and password file <none>
I20260923 17:18:22.064765 656 fs_manager.cc:359] Metadata directory not provided
I20260923 17:18:22.064857 656 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:18:22.065102 656 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:18:22.067340 656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "bdf29226d1ea48808f5c84790a566561"
format_stamp: "Formatted at 2026-09-23 17:18:22 on dist-test-slave-1x1f"
server_key: "68baaef2fb8bb75a55608c6b50d67d05"
server_key_iv: "0a0d48806317e480297377647ea10a37"
server_key_version: "encryptionkey@0"
I20260923 17:18:22.067916 656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "bdf29226d1ea48808f5c84790a566561"
format_stamp: "Formatted at 2026-09-23 17:18:22 on dist-test-slave-1x1f"
server_key: "68baaef2fb8bb75a55608c6b50d67d05"
server_key_iv: "0a0d48806317e480297377647ea10a37"
server_key_version: "encryptionkey@0"
I20260923 17:18:22.071674 656 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260923 17:18:22.074337 671 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:22.075707 656 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 17:18:22.075881 656 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "bdf29226d1ea48808f5c84790a566561"
format_stamp: "Formatted at 2026-09-23 17:18:22 on dist-test-slave-1x1f"
server_key: "68baaef2fb8bb75a55608c6b50d67d05"
server_key_iv: "0a0d48806317e480297377647ea10a37"
server_key_version: "encryptionkey@0"
I20260923 17:18:22.075999 656 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:18:22.101266 656 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:18:22.104883 656 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:18:22.105129 656 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:18:22.113152 656 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42755
I20260923 17:18:22.113183 723 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42755 every 8 connection(s)
I20260923 17:18:22.114197 656 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:18:22.117105 724 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:18:22.122834 724 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdf29226d1ea48808f5c84790a566561: Bootstrap starting.
I20260923 17:18:22.123202 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 656
I20260923 17:18:22.123350 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:18:22.123651 12182 external_mini_cluster.cc:1428] Setting key 429084d8d1a19d707f4aa6417afc572f
I20260923 17:18:22.125536 724 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bdf29226d1ea48808f5c84790a566561: Neither blocks nor log segments found. Creating new log.
I20260923 17:18:22.126430 724 log.cc:824] T 00000000000000000000000000000000 P bdf29226d1ea48808f5c84790a566561: Log is configured to *not* fsync() on all Append() calls
I20260923 17:18:22.128558 724 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdf29226d1ea48808f5c84790a566561: No bootstrap required, opened a new log
I20260923 17:18:22.132368 724 raft_consensus.cc:348] T 00000000000000000000000000000000 P bdf29226d1ea48808f5c84790a566561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdf29226d1ea48808f5c84790a566561" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42755 } }
Sep 23 17:18:22 dist-test-slave-1x1f krb5kdc[643](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183901, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260923 17:18:22.132632 724 raft_consensus.cc:374] T 00000000000000000000000000000000 P bdf29226d1ea48808f5c84790a566561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:18:22.132737 724 raft_consensus.cc:729] T 00000000000000000000000000000000 P bdf29226d1ea48808f5c84790a566561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdf29226d1ea48808f5c84790a566561, State: Initialized, Role: FOLLOWER
I20260923 17:18:22.133285 724 consensus_queue.cc:260] T 00000000000000000000000000000000 P bdf29226d1ea48808f5c84790a566561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdf29226d1ea48808f5c84790a566561" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42755 } }
I20260923 17:18:22.133481 724 raft_consensus.cc:388] T 00000000000000000000000000000000 P bdf29226d1ea48808f5c84790a566561 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:18:22.133579 724 raft_consensus.cc:482] T 00000000000000000000000000000000 P bdf29226d1ea48808f5c84790a566561 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:18:22.133724 724 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bdf29226d1ea48808f5c84790a566561 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:18:22.135002 724 raft_consensus.cc:504] T 00000000000000000000000000000000 P bdf29226d1ea48808f5c84790a566561 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdf29226d1ea48808f5c84790a566561" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42755 } }
I20260923 17:18:22.135383 724 leader_election.cc:302] T 00000000000000000000000000000000 P bdf29226d1ea48808f5c84790a566561 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bdf29226d1ea48808f5c84790a566561; no voters:
I20260923 17:18:22.135782 724 leader_election.cc:288] T 00000000000000000000000000000000 P bdf29226d1ea48808f5c84790a566561 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 17:18:22.135936 729 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bdf29226d1ea48808f5c84790a566561 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:18:22.136197 729 raft_consensus.cc:686] T 00000000000000000000000000000000 P bdf29226d1ea48808f5c84790a566561 [term 1 LEADER]: Becoming Leader. State: Replica: bdf29226d1ea48808f5c84790a566561, State: Running, Role: LEADER
I20260923 17:18:22.136555 729 consensus_queue.cc:237] T 00000000000000000000000000000000 P bdf29226d1ea48808f5c84790a566561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdf29226d1ea48808f5c84790a566561" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42755 } }
I20260923 17:18:22.137257 724 sys_catalog.cc:564] T 00000000000000000000000000000000 P bdf29226d1ea48808f5c84790a566561 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:18:22.138360 730 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdf29226d1ea48808f5c84790a566561 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bdf29226d1ea48808f5c84790a566561" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdf29226d1ea48808f5c84790a566561" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42755 } } }
I20260923 17:18:22.138490 730 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdf29226d1ea48808f5c84790a566561 [sys.catalog]: This master's current role is: LEADER
I20260923 17:18:22.138891 731 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdf29226d1ea48808f5c84790a566561 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bdf29226d1ea48808f5c84790a566561. Latest consensus state: current_term: 1 leader_uuid: "bdf29226d1ea48808f5c84790a566561" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdf29226d1ea48808f5c84790a566561" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42755 } } }
I20260923 17:18:22.139040 731 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdf29226d1ea48808f5c84790a566561 [sys.catalog]: This master's current role is: LEADER
I20260923 17:18:22.139353 738 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:18:22.139564 727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:22.125004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.1.8:59909 (local address 127.0.0.1:42755)
0923 17:18:22.125463 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:22.125483 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:22.125537 (+ 54us) server_negotiation.cc:407] Connection header received
0923 17:18:22.126437 (+ 900us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:22.126461 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:22.126899 (+ 438us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:22.127257 (+ 358us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:22.128051 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:22.129086 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:22.129958 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:22.130511 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:22.130698 (+ 187us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:22.133352 (+ 2654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:22.133357 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:22.133370 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:22.133394 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:22.135554 (+ 2160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:22.136267 (+ 713us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:22.136273 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:22.136279 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:22.136424 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:22.136898 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:22.136902 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:22.136904 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:22.137460 (+ 556us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:22.137704 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:22.138121 (+ 417us) server_negotiation.cc:299] Negotiation successful
0923 17:18:22.138443 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":133,"threads_started":1}
I20260923 17:18:22.142202 738 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:18:22.143555 12182 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 17:18:22.148043 738 catalog_manager.cc:1347] Generated new cluster ID: 125c4b29c4fa44c797121c57fa81aa43
I20260923 17:18:22.148102 738 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:18:22.155876 727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:22.145922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.1.8:35487 (local address 127.0.0.1:42755)
0923 17:18:22.146034 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:22.146039 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:22.146550 (+ 511us) server_negotiation.cc:407] Connection header received
0923 17:18:22.146719 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:22.146722 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:22.146769 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:22.146868 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:22.147564 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:22.148412 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:22.149694 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:22.150056 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:22.150157 (+ 101us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:22.151959 (+ 1802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:22.151963 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:22.151966 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:22.151991 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:22.153751 (+ 1760us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:22.154499 (+ 748us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:22.154503 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:22.154505 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:22.154587 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:22.154970 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:22.154973 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:22.154975 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:22.155170 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:22.155300 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:22.155627 (+ 327us) server_negotiation.cc:299] Negotiation successful
0923 17:18:22.155722 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260923 17:18:22.162050 738 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:18:22.163288 738 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:18:22.183343 738 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bdf29226d1ea48808f5c84790a566561: Generated new TSK 0
I20260923 17:18:22.184103 738 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 17:18:22.193115 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 656
W20260923 17:18:22.198627 641 connection.cc:535] client connection to 127.0.0.1:42755 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42755): Connection reset by peer (error 104)
2026-09-23T17:18:22Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1517 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790183633736342-12182-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 17:18:22 dist-test-slave-1x1f krb5kdc[755](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 17:18:22 dist-test-slave-1x1f krb5kdc[755](info): set up 2 sockets
Sep 23 17:18:22 dist-test-slave-1x1f krb5kdc[755](info): commencing operation
krb5kdc: starting...
W20260923 17:18:23.255122 12182 mini_kdc.cc:121] Time spent starting KDC: real 1.042s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Sep 23 17:18:23 dist-test-slave-1x1f krb5kdc[755](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183903, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T17:18:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:18:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790183633736342-12182-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790183633736342-12182-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260923 17:18:23.385983 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39559
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790183633736342-12182-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34379
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39559
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:18:23.497557 768 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:18:23.497846 768 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:18:23.497889 768 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:18:23.501855 768 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:18:23.501915 768 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:18:23.501935 768 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:18:23.501952 768 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:18:23.501967 768 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:18:23.507347 768 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34379
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39559
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790183633736342-12182-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39559
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.768
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:18:23.508432 768 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:18:23.509418 768 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:18:23.518321 776 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:23.518329 773 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:23.518561 768 server_base.cc:1034] running on GCE node
W20260923 17:18:23.518332 774 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:23.519328 768 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:18:23.520527 768 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:18:23.521732 768 hybrid_clock.cc:648] HybridClock initialized: now 1790183903521697 us; error 54 us; skew 500 ppm
Sep 23 17:18:23 dist-test-slave-1x1f krb5kdc[755](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183903, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:18:23.524645 768 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260923 17:18:23.525658 768 webserver.cc:460] Webserver started at http://127.0.0.1:45651/ using document root <none> and password file <none>
I20260923 17:18:23.526460 768 fs_manager.cc:359] Metadata directory not provided
I20260923 17:18:23.526554 768 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:18:23.526803 768 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:18:23.529868 768 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "1dca587af9ea404c9f37dec87171edf4"
format_stamp: "Formatted at 2026-09-23 17:18:23 on dist-test-slave-1x1f"
server_key: "da86a0eba60bbcc7dfa9841df5f98f82"
server_key_iv: "6bf129d0e89ec4986a0d714409fde390"
server_key_version: "encryptionkey@0"
I20260923 17:18:23.530685 768 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "1dca587af9ea404c9f37dec87171edf4"
format_stamp: "Formatted at 2026-09-23 17:18:23 on dist-test-slave-1x1f"
server_key: "da86a0eba60bbcc7dfa9841df5f98f82"
server_key_iv: "6bf129d0e89ec4986a0d714409fde390"
server_key_version: "encryptionkey@0"
I20260923 17:18:23.535507 768 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260923 17:18:23.538883 783 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:23.540347 768 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260923 17:18:23.540506 768 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "1dca587af9ea404c9f37dec87171edf4"
format_stamp: "Formatted at 2026-09-23 17:18:23 on dist-test-slave-1x1f"
server_key: "da86a0eba60bbcc7dfa9841df5f98f82"
server_key_iv: "6bf129d0e89ec4986a0d714409fde390"
server_key_version: "encryptionkey@0"
I20260923 17:18:23.540644 768 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:18:23.554900 768 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:18:23.558302 768 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:18:23.558524 768 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:18:23.565796 768 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39559
I20260923 17:18:23.565822 835 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39559 every 8 connection(s)
I20260923 17:18:23.566804 768 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:18:23.569638 836 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:18:23.572835 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 768
I20260923 17:18:23.572990 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:18:23.573293 12182 external_mini_cluster.cc:1428] Setting key f0ac8ac18c2196edf583ae37dfd3a5a8
I20260923 17:18:23.575999 836 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1dca587af9ea404c9f37dec87171edf4: Bootstrap starting.
I20260923 17:18:23.578195 836 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1dca587af9ea404c9f37dec87171edf4: Neither blocks nor log segments found. Creating new log.
I20260923 17:18:23.578955 836 log.cc:824] T 00000000000000000000000000000000 P 1dca587af9ea404c9f37dec87171edf4: Log is configured to *not* fsync() on all Append() calls
I20260923 17:18:23.581055 836 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1dca587af9ea404c9f37dec87171edf4: No bootstrap required, opened a new log
I20260923 17:18:23.582643 839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:23.574826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.1.8:34379 (local address 127.0.0.1:39559)
0923 17:18:23.575276 (+ 450us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:23.575292 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:23.575326 (+ 34us) server_negotiation.cc:407] Connection header received
0923 17:18:23.575948 (+ 622us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:23.575965 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:23.576415 (+ 450us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:23.576739 (+ 324us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:23.577151 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:23.578116 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:23.579064 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:23.579698 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:23.579884 (+ 186us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:23.580813 (+ 929us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:23.580818 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:23.580830 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:18:23.581341 (+ 511us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:23.581398 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:18:23.581420 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:23.581559 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:23.581751 (+ 192us) server_negotiation.cc:299] Negotiation successful
0923 17:18:23.581888 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":309,"thread_start_us":141,"threads_started":1}
I20260923 17:18:23.585136 836 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1dca587af9ea404c9f37dec87171edf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1dca587af9ea404c9f37dec87171edf4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39559 } }
I20260923 17:18:23.585440 836 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1dca587af9ea404c9f37dec87171edf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:18:23.585500 836 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1dca587af9ea404c9f37dec87171edf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dca587af9ea404c9f37dec87171edf4, State: Initialized, Role: FOLLOWER
I20260923 17:18:23.585695 12182 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 17:18:23.585984 836 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1dca587af9ea404c9f37dec87171edf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1dca587af9ea404c9f37dec87171edf4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39559 } }
I20260923 17:18:23.586139 836 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1dca587af9ea404c9f37dec87171edf4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:18:23.586252 836 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1dca587af9ea404c9f37dec87171edf4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:18:23.586357 836 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1dca587af9ea404c9f37dec87171edf4 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:18:23.587423 836 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1dca587af9ea404c9f37dec87171edf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1dca587af9ea404c9f37dec87171edf4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39559 } }
I20260923 17:18:23.587798 836 leader_election.cc:302] T 00000000000000000000000000000000 P 1dca587af9ea404c9f37dec87171edf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1dca587af9ea404c9f37dec87171edf4; no voters:
I20260923 17:18:23.588124 836 leader_election.cc:288] T 00000000000000000000000000000000 P 1dca587af9ea404c9f37dec87171edf4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 17:18:23.588230 846 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1dca587af9ea404c9f37dec87171edf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:18:23.588449 846 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1dca587af9ea404c9f37dec87171edf4 [term 1 LEADER]: Becoming Leader. State: Replica: 1dca587af9ea404c9f37dec87171edf4, State: Running, Role: LEADER
I20260923 17:18:23.588771 846 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1dca587af9ea404c9f37dec87171edf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1dca587af9ea404c9f37dec87171edf4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39559 } }
I20260923 17:18:23.589576 836 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1dca587af9ea404c9f37dec87171edf4 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:18:23.589991 846 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1dca587af9ea404c9f37dec87171edf4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1dca587af9ea404c9f37dec87171edf4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1dca587af9ea404c9f37dec87171edf4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39559 } } }
I20260923 17:18:23.590135 846 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1dca587af9ea404c9f37dec87171edf4 [sys.catalog]: This master's current role is: LEADER
I20260923 17:18:23.590369 846 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1dca587af9ea404c9f37dec87171edf4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1dca587af9ea404c9f37dec87171edf4. Latest consensus state: current_term: 1 leader_uuid: "1dca587af9ea404c9f37dec87171edf4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1dca587af9ea404c9f37dec87171edf4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39559 } } }
I20260923 17:18:23.590451 846 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1dca587af9ea404c9f37dec87171edf4 [sys.catalog]: This master's current role is: LEADER
I20260923 17:18:23.590723 850 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:18:23.592947 839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:23.587845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.1.8:59333 (local address 127.0.0.1:39559)
0923 17:18:23.587981 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:23.587986 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:23.588225 (+ 239us) server_negotiation.cc:407] Connection header received
0923 17:18:23.588425 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:23.588432 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:23.588484 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:23.588554 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:23.588976 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:23.589737 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:23.590954 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:23.591272 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:23.591346 (+ 74us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:23.592494 (+ 1148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:23.592498 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:23.592500 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:18:23.592513 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:23.592541 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:18:23.592554 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:23.592649 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:23.592775 (+ 126us) server_negotiation.cc:299] Negotiation successful
0923 17:18:23.592813 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260923 17:18:23.594175 850 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:18:23.599900 850 catalog_manager.cc:1347] Generated new cluster ID: bed69cc4db4042759c5292b399b76ab0
I20260923 17:18:23.599982 850 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:18:23.606475 850 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:18:23.607649 850 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:18:23.614908 850 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1dca587af9ea404c9f37dec87171edf4: Generated new TSK 0
I20260923 17:18:23.615762 850 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 17:18:23.624382 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 768
W20260923 17:18:23.630033 753 connection.cc:535] client connection to 127.0.0.1:39559 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39559): Connection reset by peer (error 104)
2026-09-23T17:18:23Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1431 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790183633736342-12182-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 17:18:23 dist-test-slave-1x1f krb5kdc[867](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 17:18:23 dist-test-slave-1x1f krb5kdc[867](info): set up 2 sockets
Sep 23 17:18:23 dist-test-slave-1x1f krb5kdc[867](info): commencing operation
krb5kdc: starting...
W20260923 17:18:24.687878 12182 mini_kdc.cc:121] Time spent starting KDC: real 1.043s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Sep 23 17:18:24 dist-test-slave-1x1f krb5kdc[867](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183904, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T17:18:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:18:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790183633736342-12182-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790183633736342-12182-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260923 17:18:24.813941 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44163
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790183633736342-12182-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41309
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44163
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:18:24.924544 880 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:18:24.924819 880 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:18:24.924862 880 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:18:24.928882 880 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:18:24.928956 880 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:18:24.928974 880 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:18:24.928992 880 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:18:24.929006 880 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:18:24.934484 880 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41309
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44163
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790183633736342-12182-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44163
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.880
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:18:24.935547 880 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:18:24.936506 880 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:18:24.945263 885 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:24.945263 888 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:24.945354 886 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:24.945393 880 server_base.cc:1034] running on GCE node
I20260923 17:18:24.946076 880 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:18:24.947225 880 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:18:24.948401 880 hybrid_clock.cc:648] HybridClock initialized: now 1790183904948383 us; error 31 us; skew 500 ppm
Sep 23 17:18:24 dist-test-slave-1x1f krb5kdc[867](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183904, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:18:24.958179 880 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260923 17:18:24.959291 880 webserver.cc:460] Webserver started at http://127.0.0.1:37425/ using document root <none> and password file <none>
I20260923 17:18:24.959908 880 fs_manager.cc:359] Metadata directory not provided
I20260923 17:18:24.959973 880 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:18:24.960202 880 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:18:24.962352 880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "f12ea32324bd462bbbad7bd1502b1d70"
format_stamp: "Formatted at 2026-09-23 17:18:24 on dist-test-slave-1x1f"
server_key: "34f02d0bd0e7c98164cc6938b860d975"
server_key_iv: "fe07b7299241c4857d47bae8881bf1e4"
server_key_version: "encryptionkey@0"
I20260923 17:18:24.962911 880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "f12ea32324bd462bbbad7bd1502b1d70"
format_stamp: "Formatted at 2026-09-23 17:18:24 on dist-test-slave-1x1f"
server_key: "34f02d0bd0e7c98164cc6938b860d975"
server_key_iv: "fe07b7299241c4857d47bae8881bf1e4"
server_key_version: "encryptionkey@0"
I20260923 17:18:24.966723 880 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260923 17:18:24.969177 895 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:24.970697 880 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 17:18:24.970850 880 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "f12ea32324bd462bbbad7bd1502b1d70"
format_stamp: "Formatted at 2026-09-23 17:18:24 on dist-test-slave-1x1f"
server_key: "34f02d0bd0e7c98164cc6938b860d975"
server_key_iv: "fe07b7299241c4857d47bae8881bf1e4"
server_key_version: "encryptionkey@0"
I20260923 17:18:24.970963 880 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:18:24.975701 880 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:18:24.979067 880 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:18:24.979276 880 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:18:24.986490 880 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44163
I20260923 17:18:24.986500 947 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44163 every 8 connection(s)
I20260923 17:18:24.987475 880 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:18:24.990280 948 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:18:24.990520 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 880
I20260923 17:18:24.990689 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:18:24.990990 12182 external_mini_cluster.cc:1428] Setting key 1eda0721facde3ab4ee64312924af35f
I20260923 17:18:24.996898 951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:24.992393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.1.8:35997 (local address 127.0.0.1:44163)
0923 17:18:24.992860 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:24.992884 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:24.993068 (+ 184us) server_negotiation.cc:407] Connection header received
0923 17:18:24.993901 (+ 833us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:24.993926 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:24.994322 (+ 396us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:24.994704 (+ 382us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:24.995463 (+ 759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:24.995468 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:24.995482 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:18:24.995495 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:24.995558 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:18:24.995584 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:24.995739 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:24.995841 (+ 102us) server_negotiation.cc:299] Negotiation successful
0923 17:18:24.995999 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":133,"threads_started":1}
I20260923 17:18:24.997805 948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f12ea32324bd462bbbad7bd1502b1d70: Bootstrap starting.
I20260923 17:18:24.999934 12182 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 17:18:25.000311 948 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f12ea32324bd462bbbad7bd1502b1d70: Neither blocks nor log segments found. Creating new log.
I20260923 17:18:25.001019 948 log.cc:824] T 00000000000000000000000000000000 P f12ea32324bd462bbbad7bd1502b1d70: Log is configured to *not* fsync() on all Append() calls
I20260923 17:18:25.003244 948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f12ea32324bd462bbbad7bd1502b1d70: No bootstrap required, opened a new log
I20260923 17:18:25.004055 951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:25.002380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.1.8:33245 (local address 127.0.0.1:44163)
0923 17:18:25.002508 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:25.002513 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:25.002676 (+ 163us) server_negotiation.cc:407] Connection header received
0923 17:18:25.002784 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:25.002787 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:25.002828 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:25.002914 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:25.003659 (+ 745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:25.003663 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:25.003666 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:18:25.003678 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:25.003705 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:18:25.003718 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:25.003807 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:25.003891 (+ 84us) server_negotiation.cc:299] Negotiation successful
0923 17:18:25.003931 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260923 17:18:25.008132 948 raft_consensus.cc:348] T 00000000000000000000000000000000 P f12ea32324bd462bbbad7bd1502b1d70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f12ea32324bd462bbbad7bd1502b1d70" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44163 } }
I20260923 17:18:25.008494 948 raft_consensus.cc:374] T 00000000000000000000000000000000 P f12ea32324bd462bbbad7bd1502b1d70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:18:25.008548 948 raft_consensus.cc:729] T 00000000000000000000000000000000 P f12ea32324bd462bbbad7bd1502b1d70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f12ea32324bd462bbbad7bd1502b1d70, State: Initialized, Role: FOLLOWER
I20260923 17:18:25.009102 948 consensus_queue.cc:260] T 00000000000000000000000000000000 P f12ea32324bd462bbbad7bd1502b1d70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f12ea32324bd462bbbad7bd1502b1d70" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44163 } }
I20260923 17:18:25.009290 948 raft_consensus.cc:388] T 00000000000000000000000000000000 P f12ea32324bd462bbbad7bd1502b1d70 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:18:25.009347 948 raft_consensus.cc:482] T 00000000000000000000000000000000 P f12ea32324bd462bbbad7bd1502b1d70 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:18:25.009423 948 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f12ea32324bd462bbbad7bd1502b1d70 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:18:25.010449 948 raft_consensus.cc:504] T 00000000000000000000000000000000 P f12ea32324bd462bbbad7bd1502b1d70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f12ea32324bd462bbbad7bd1502b1d70" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44163 } }
I20260923 17:18:25.010805 948 leader_election.cc:302] T 00000000000000000000000000000000 P f12ea32324bd462bbbad7bd1502b1d70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f12ea32324bd462bbbad7bd1502b1d70; no voters:
I20260923 17:18:25.011168 948 leader_election.cc:288] T 00000000000000000000000000000000 P f12ea32324bd462bbbad7bd1502b1d70 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 17:18:25.011329 958 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f12ea32324bd462bbbad7bd1502b1d70 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:18:25.011629 958 raft_consensus.cc:686] T 00000000000000000000000000000000 P f12ea32324bd462bbbad7bd1502b1d70 [term 1 LEADER]: Becoming Leader. State: Replica: f12ea32324bd462bbbad7bd1502b1d70, State: Running, Role: LEADER
I20260923 17:18:25.011965 958 consensus_queue.cc:237] T 00000000000000000000000000000000 P f12ea32324bd462bbbad7bd1502b1d70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f12ea32324bd462bbbad7bd1502b1d70" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44163 } }
I20260923 17:18:25.012459 948 sys_catalog.cc:564] T 00000000000000000000000000000000 P f12ea32324bd462bbbad7bd1502b1d70 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:18:25.013742 959 sys_catalog.cc:455] T 00000000000000000000000000000000 P f12ea32324bd462bbbad7bd1502b1d70 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f12ea32324bd462bbbad7bd1502b1d70" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f12ea32324bd462bbbad7bd1502b1d70" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44163 } } }
I20260923 17:18:25.013895 959 sys_catalog.cc:458] T 00000000000000000000000000000000 P f12ea32324bd462bbbad7bd1502b1d70 [sys.catalog]: This master's current role is: LEADER
I20260923 17:18:25.014477 967 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:18:25.014458 960 sys_catalog.cc:455] T 00000000000000000000000000000000 P f12ea32324bd462bbbad7bd1502b1d70 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f12ea32324bd462bbbad7bd1502b1d70. Latest consensus state: current_term: 1 leader_uuid: "f12ea32324bd462bbbad7bd1502b1d70" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f12ea32324bd462bbbad7bd1502b1d70" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44163 } } }
I20260923 17:18:25.014631 960 sys_catalog.cc:458] T 00000000000000000000000000000000 P f12ea32324bd462bbbad7bd1502b1d70 [sys.catalog]: This master's current role is: LEADER
I20260923 17:18:25.017447 967 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:18:25.024022 967 catalog_manager.cc:1347] Generated new cluster ID: af582ad867b64941b0c6d6d55023f8ea
I20260923 17:18:25.024140 967 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:18:25.034785 967 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:18:25.035145 967 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:18:25.042266 967 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f12ea32324bd462bbbad7bd1502b1d70: Generated new TSK 0
I20260923 17:18:25.043123 967 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 17:18:25.053108 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 880
2026-09-23T17:18:25Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1428 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790183633736342-12182-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 17:18:25 dist-test-slave-1x1f krb5kdc[979](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 17:18:25 dist-test-slave-1x1f krb5kdc[979](info): set up 2 sockets
Sep 23 17:18:25 dist-test-slave-1x1f krb5kdc[979](info): commencing operation
krb5kdc: starting...
W20260923 17:18:26.138885 12182 mini_kdc.cc:121] Time spent starting KDC: real 1.066s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Sep 23 17:18:26 dist-test-slave-1x1f krb5kdc[979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183906, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T17:18:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:18:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790183633736342-12182-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790183633736342-12182-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260923 17:18:26.264935 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43449
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790183633736342-12182-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43449
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:18:26.377327 992 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:18:26.377578 992 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:18:26.377617 992 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:18:26.381667 992 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:18:26.381728 992 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:18:26.381749 992 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:18:26.381765 992 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:18:26.381780 992 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:18:26.386965 992 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43449
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790183633736342-12182-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43449
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.992
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:18:26.387907 992 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:18:26.388828 992 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:18:26.397120 1000 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:26.397229 992 server_base.cc:1034] running on GCE node
W20260923 17:18:26.397122 998 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:26.397130 997 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:26.397866 992 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:18:26.398988 992 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:18:26.400168 992 hybrid_clock.cc:648] HybridClock initialized: now 1790183906400152 us; error 26 us; skew 500 ppm
Sep 23 17:18:26 dist-test-slave-1x1f krb5kdc[979](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183906, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:18:26.403020 992 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260923 17:18:26.403895 992 webserver.cc:460] Webserver started at http://127.0.0.1:44027/ using document root <none> and password file <none>
I20260923 17:18:26.404395 992 fs_manager.cc:359] Metadata directory not provided
I20260923 17:18:26.404451 992 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:18:26.404619 992 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:18:26.406648 992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "4aa58763bdd941b2b8d9719e2ae1cb1e"
format_stamp: "Formatted at 2026-09-23 17:18:26 on dist-test-slave-1x1f"
server_key: "abfbafe2e4dc47772745bf4f95f47eb6"
server_key_iv: "06b251aea5481f654a35ebaa2f81932a"
server_key_version: "encryptionkey@0"
I20260923 17:18:26.407156 992 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "4aa58763bdd941b2b8d9719e2ae1cb1e"
format_stamp: "Formatted at 2026-09-23 17:18:26 on dist-test-slave-1x1f"
server_key: "abfbafe2e4dc47772745bf4f95f47eb6"
server_key_iv: "06b251aea5481f654a35ebaa2f81932a"
server_key_version: "encryptionkey@0"
I20260923 17:18:26.410820 992 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260923 17:18:26.413256 1007 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:26.414680 992 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 17:18:26.414814 992 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "4aa58763bdd941b2b8d9719e2ae1cb1e"
format_stamp: "Formatted at 2026-09-23 17:18:26 on dist-test-slave-1x1f"
server_key: "abfbafe2e4dc47772745bf4f95f47eb6"
server_key_iv: "06b251aea5481f654a35ebaa2f81932a"
server_key_version: "encryptionkey@0"
I20260923 17:18:26.414927 992 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:18:26.430022 992 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:18:26.433424 992 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:18:26.433642 992 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:18:26.440892 992 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43449
I20260923 17:18:26.440982 1059 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43449 every 8 connection(s)
I20260923 17:18:26.441915 992 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:18:26.444785 1060 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:18:26.450126 1060 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4aa58763bdd941b2b8d9719e2ae1cb1e: Bootstrap starting.
I20260923 17:18:26.451207 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 992
I20260923 17:18:26.451359 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:18:26.451658 12182 external_mini_cluster.cc:1428] Setting key 81d185c8cef66d5d0d6f9565bfde549c
I20260923 17:18:26.452883 1060 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4aa58763bdd941b2b8d9719e2ae1cb1e: Neither blocks nor log segments found. Creating new log.
I20260923 17:18:26.453581 1060 log.cc:824] T 00000000000000000000000000000000 P 4aa58763bdd941b2b8d9719e2ae1cb1e: Log is configured to *not* fsync() on all Append() calls
I20260923 17:18:26.455736 1060 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4aa58763bdd941b2b8d9719e2ae1cb1e: No bootstrap required, opened a new log
I20260923 17:18:26.460019 1060 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4aa58763bdd941b2b8d9719e2ae1cb1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aa58763bdd941b2b8d9719e2ae1cb1e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43449 } }
I20260923 17:18:26.460301 1060 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4aa58763bdd941b2b8d9719e2ae1cb1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:18:26.460372 1060 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4aa58763bdd941b2b8d9719e2ae1cb1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4aa58763bdd941b2b8d9719e2ae1cb1e, State: Initialized, Role: FOLLOWER
Sep 23 17:18:26 dist-test-slave-1x1f krb5kdc[979](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183906, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260923 17:18:26.460870 1060 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4aa58763bdd941b2b8d9719e2ae1cb1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aa58763bdd941b2b8d9719e2ae1cb1e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43449 } }
I20260923 17:18:26.461021 1060 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4aa58763bdd941b2b8d9719e2ae1cb1e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:18:26.461093 1060 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4aa58763bdd941b2b8d9719e2ae1cb1e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:18:26.461193 1060 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4aa58763bdd941b2b8d9719e2ae1cb1e [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:18:26.462252 1060 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4aa58763bdd941b2b8d9719e2ae1cb1e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aa58763bdd941b2b8d9719e2ae1cb1e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43449 } }
I20260923 17:18:26.462630 1060 leader_election.cc:302] T 00000000000000000000000000000000 P 4aa58763bdd941b2b8d9719e2ae1cb1e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4aa58763bdd941b2b8d9719e2ae1cb1e; no voters:
I20260923 17:18:26.462984 1060 leader_election.cc:288] T 00000000000000000000000000000000 P 4aa58763bdd941b2b8d9719e2ae1cb1e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 17:18:26.463173 1065 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4aa58763bdd941b2b8d9719e2ae1cb1e [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:18:26.463389 1065 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4aa58763bdd941b2b8d9719e2ae1cb1e [term 1 LEADER]: Becoming Leader. State: Replica: 4aa58763bdd941b2b8d9719e2ae1cb1e, State: Running, Role: LEADER
I20260923 17:18:26.463685 1065 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4aa58763bdd941b2b8d9719e2ae1cb1e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aa58763bdd941b2b8d9719e2ae1cb1e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43449 } }
I20260923 17:18:26.464344 1060 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4aa58763bdd941b2b8d9719e2ae1cb1e [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:18:26.465548 1066 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4aa58763bdd941b2b8d9719e2ae1cb1e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4aa58763bdd941b2b8d9719e2ae1cb1e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aa58763bdd941b2b8d9719e2ae1cb1e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43449 } } }
I20260923 17:18:26.465667 1066 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4aa58763bdd941b2b8d9719e2ae1cb1e [sys.catalog]: This master's current role is: LEADER
I20260923 17:18:26.466563 1067 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4aa58763bdd941b2b8d9719e2ae1cb1e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4aa58763bdd941b2b8d9719e2ae1cb1e. Latest consensus state: current_term: 1 leader_uuid: "4aa58763bdd941b2b8d9719e2ae1cb1e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aa58763bdd941b2b8d9719e2ae1cb1e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43449 } } }
I20260923 17:18:26.466777 1067 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4aa58763bdd941b2b8d9719e2ae1cb1e [sys.catalog]: This master's current role is: LEADER
I20260923 17:18:26.467710 1063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:26.452811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.1.8:37525 (local address 127.0.0.1:43449)
0923 17:18:26.453281 (+ 470us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:26.453299 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:26.453333 (+ 34us) server_negotiation.cc:407] Connection header received
0923 17:18:26.454127 (+ 794us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:26.454149 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:26.454568 (+ 419us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:26.454838 (+ 270us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:26.455768 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:26.456825 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:26.457990 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:26.458524 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:26.458642 (+ 118us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:26.461609 (+ 2967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:26.461614 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:26.461626 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:26.461653 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:26.463782 (+ 2129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:26.464417 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:26.464423 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:26.464428 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:26.464556 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:26.465047 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:26.465051 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:26.465052 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:26.465615 (+ 563us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:26.465831 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:26.466664 (+ 833us) server_negotiation.cc:299] Negotiation successful
0923 17:18:26.466891 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":325,"thread_start_us":177,"threads_started":1}
W20260923 17:18:26.469287 1081 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4aa58763bdd941b2b8d9719e2ae1cb1e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 17:18:26.469360 1081 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 17:18:26.469641 1074 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:18:26.470417 1074 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:18:26.470988 12182 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 17:18:26.476055 1074 catalog_manager.cc:1347] Generated new cluster ID: 588dd458c7624a7598edd916a38e8bbb
I20260923 17:18:26.476115 1074 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:18:26.482033 1063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:26.473392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.1.8:48047 (local address 127.0.0.1:43449)
0923 17:18:26.473504 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:26.473508 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:26.473521 (+ 13us) server_negotiation.cc:407] Connection header received
0923 17:18:26.473557 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:26.473559 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:26.473599 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:26.473681 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:26.474582 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:26.475139 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:26.476076 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:26.476378 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:26.476482 (+ 104us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:26.478422 (+ 1940us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:26.478426 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:26.478428 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:26.478453 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:26.480112 (+ 1659us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:26.480676 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:26.480679 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:26.480681 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:26.480757 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:26.481107 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:26.481110 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:26.481112 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:26.481325 (+ 213us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:26.481466 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:26.481786 (+ 320us) server_negotiation.cc:299] Negotiation successful
0923 17:18:26.481882 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":54}
I20260923 17:18:26.483798 1074 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:18:26.484589 1074 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:18:26.490959 1074 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4aa58763bdd941b2b8d9719e2ae1cb1e: Generated new TSK 0
I20260923 17:18:26.491675 1074 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 17:18:26.499454 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 992
W20260923 17:18:26.505105 977 connection.cc:535] client connection to 127.0.0.1:43449 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43449): Connection reset by peer (error 104)
2026-09-23T17:18:26Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1446 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790183633736342-12182-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 17:18:26 dist-test-slave-1x1f krb5kdc[1091](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 17:18:26 dist-test-slave-1x1f krb5kdc[1091](info): set up 2 sockets
Sep 23 17:18:26 dist-test-slave-1x1f krb5kdc[1091](info): commencing operation
krb5kdc: starting...
W20260923 17:18:27.554940 12182 mini_kdc.cc:121] Time spent starting KDC: real 1.035s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Sep 23 17:18:27 dist-test-slave-1x1f krb5kdc[1091](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183907, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T17:18:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:18:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790183633736342-12182-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790183633736342-12182-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260923 17:18:27.702692 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42667
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790183633736342-12182-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42147
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42667
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:18:27.818070 1104 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:18:27.818397 1104 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:18:27.818444 1104 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:18:27.823184 1104 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:18:27.823266 1104 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:18:27.823288 1104 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:18:27.823307 1104 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:18:27.823324 1104 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:18:27.829152 1104 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42147
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42667
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790183633736342-12182-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42667
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1104
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:18:27.830205 1104 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:18:27.831202 1104 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:18:27.839687 1109 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:27.839718 1110 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:27.839977 1104 server_base.cc:1034] running on GCE node
W20260923 17:18:27.839656 1112 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:27.840728 1104 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:18:27.841800 1104 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:18:27.843003 1104 hybrid_clock.cc:648] HybridClock initialized: now 1790183907842976 us; error 37 us; skew 500 ppm
Sep 23 17:18:27 dist-test-slave-1x1f krb5kdc[1091](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183907, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:18:27.845836 1104 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260923 17:18:27.846769 1104 webserver.cc:460] Webserver started at http://127.0.0.1:45549/ using document root <none> and password file <none>
I20260923 17:18:27.847290 1104 fs_manager.cc:359] Metadata directory not provided
I20260923 17:18:27.847348 1104 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:18:27.847514 1104 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:18:27.849571 1104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "ea9c1a51874743a38469d07668b61573"
format_stamp: "Formatted at 2026-09-23 17:18:27 on dist-test-slave-1x1f"
server_key: "1bc0cd8573e299460e78c436b5f51410"
server_key_iv: "bfbe4f4b21475d4c5e1d9ad177cdf2b8"
server_key_version: "encryptionkey@0"
I20260923 17:18:27.850073 1104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "ea9c1a51874743a38469d07668b61573"
format_stamp: "Formatted at 2026-09-23 17:18:27 on dist-test-slave-1x1f"
server_key: "1bc0cd8573e299460e78c436b5f51410"
server_key_iv: "bfbe4f4b21475d4c5e1d9ad177cdf2b8"
server_key_version: "encryptionkey@0"
I20260923 17:18:27.853703 1104 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s
I20260923 17:18:27.856168 1119 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:27.857492 1104 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 17:18:27.857662 1104 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "ea9c1a51874743a38469d07668b61573"
format_stamp: "Formatted at 2026-09-23 17:18:27 on dist-test-slave-1x1f"
server_key: "1bc0cd8573e299460e78c436b5f51410"
server_key_iv: "bfbe4f4b21475d4c5e1d9ad177cdf2b8"
server_key_version: "encryptionkey@0"
I20260923 17:18:27.857805 1104 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:18:27.883342 1104 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:18:27.886735 1104 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:18:27.886947 1104 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:18:27.893661 1104 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42667
I20260923 17:18:27.893726 1171 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42667 every 8 connection(s)
I20260923 17:18:27.894647 1104 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:18:27.897354 1172 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:18:27.899454 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 1104
I20260923 17:18:27.899694 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:18:27.900002 12182 external_mini_cluster.cc:1428] Setting key 31eae7af59c8b36c2452ee1c9fdf3e3a
I20260923 17:18:27.903370 1172 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea9c1a51874743a38469d07668b61573: Bootstrap starting.
I20260923 17:18:27.905874 1172 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ea9c1a51874743a38469d07668b61573: Neither blocks nor log segments found. Creating new log.
I20260923 17:18:27.906718 1172 log.cc:824] T 00000000000000000000000000000000 P ea9c1a51874743a38469d07668b61573: Log is configured to *not* fsync() on all Append() calls
I20260923 17:18:27.908726 1172 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea9c1a51874743a38469d07668b61573: No bootstrap required, opened a new log
I20260923 17:18:27.910333 1175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:27.901462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.1.8:60399 (local address 127.0.0.1:42667)
0923 17:18:27.901880 (+ 418us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:27.901897 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:27.901939 (+ 42us) server_negotiation.cc:407] Connection header received
0923 17:18:27.902747 (+ 808us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:27.902769 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:27.903171 (+ 402us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:27.903517 (+ 346us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:27.903921 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:27.905368 (+ 1447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:27.906508 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:27.907212 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:27.907325 (+ 113us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:27.908311 (+ 986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:27.908317 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:27.908331 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:18:27.908811 (+ 480us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:27.908874 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:18:27.908902 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:27.909029 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:27.909294 (+ 265us) server_negotiation.cc:299] Negotiation successful
0923 17:18:27.909422 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":276,"thread_start_us":109,"threads_started":1}
I20260923 17:18:27.913254 12182 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 17:18:27.913107 1172 raft_consensus.cc:348] T 00000000000000000000000000000000 P ea9c1a51874743a38469d07668b61573 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea9c1a51874743a38469d07668b61573" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42667 } }
I20260923 17:18:27.913332 1172 raft_consensus.cc:374] T 00000000000000000000000000000000 P ea9c1a51874743a38469d07668b61573 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:18:27.913409 1172 raft_consensus.cc:729] T 00000000000000000000000000000000 P ea9c1a51874743a38469d07668b61573 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea9c1a51874743a38469d07668b61573, State: Initialized, Role: FOLLOWER
I20260923 17:18:27.913841 1172 consensus_queue.cc:260] T 00000000000000000000000000000000 P ea9c1a51874743a38469d07668b61573 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea9c1a51874743a38469d07668b61573" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42667 } }
I20260923 17:18:27.913959 1172 raft_consensus.cc:388] T 00000000000000000000000000000000 P ea9c1a51874743a38469d07668b61573 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:18:27.914040 1172 raft_consensus.cc:482] T 00000000000000000000000000000000 P ea9c1a51874743a38469d07668b61573 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:18:27.914171 1172 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ea9c1a51874743a38469d07668b61573 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:18:27.915330 1172 raft_consensus.cc:504] T 00000000000000000000000000000000 P ea9c1a51874743a38469d07668b61573 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea9c1a51874743a38469d07668b61573" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42667 } }
I20260923 17:18:27.915696 1172 leader_election.cc:302] T 00000000000000000000000000000000 P ea9c1a51874743a38469d07668b61573 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ea9c1a51874743a38469d07668b61573; no voters:
I20260923 17:18:27.916074 1172 leader_election.cc:288] T 00000000000000000000000000000000 P ea9c1a51874743a38469d07668b61573 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 17:18:27.916440 1183 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ea9c1a51874743a38469d07668b61573 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:18:27.916671 1183 raft_consensus.cc:686] T 00000000000000000000000000000000 P ea9c1a51874743a38469d07668b61573 [term 1 LEADER]: Becoming Leader. State: Replica: ea9c1a51874743a38469d07668b61573, State: Running, Role: LEADER
I20260923 17:18:27.916996 1183 consensus_queue.cc:237] T 00000000000000000000000000000000 P ea9c1a51874743a38469d07668b61573 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea9c1a51874743a38469d07668b61573" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42667 } }
I20260923 17:18:27.917339 1172 sys_catalog.cc:564] T 00000000000000000000000000000000 P ea9c1a51874743a38469d07668b61573 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:18:27.918993 1182 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea9c1a51874743a38469d07668b61573 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ea9c1a51874743a38469d07668b61573" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea9c1a51874743a38469d07668b61573" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42667 } } }
I20260923 17:18:27.919138 1182 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea9c1a51874743a38469d07668b61573 [sys.catalog]: This master's current role is: LEADER
I20260923 17:18:27.919025 1184 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea9c1a51874743a38469d07668b61573 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ea9c1a51874743a38469d07668b61573. Latest consensus state: current_term: 1 leader_uuid: "ea9c1a51874743a38469d07668b61573" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea9c1a51874743a38469d07668b61573" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42667 } } }
I20260923 17:18:27.919548 1184 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea9c1a51874743a38469d07668b61573 [sys.catalog]: This master's current role is: LEADER
I20260923 17:18:27.921162 1175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:27.915452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.1.8:44597 (local address 127.0.0.1:42667)
0923 17:18:27.915564 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:27.915567 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:27.915771 (+ 204us) server_negotiation.cc:407] Connection header received
0923 17:18:27.915924 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:27.915926 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:27.915968 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:27.916058 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:27.916348 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:27.917117 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:27.919461 (+ 2344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:27.919797 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:27.919911 (+ 114us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:27.920706 (+ 795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:27.920709 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:27.920711 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:18:27.920723 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:27.920747 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:18:27.920758 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:27.920825 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:27.920980 (+ 155us) server_negotiation.cc:299] Negotiation successful
0923 17:18:27.921009 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
W20260923 17:18:27.922533 1197 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ea9c1a51874743a38469d07668b61573: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 17:18:27.922618 1197 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 17:18:27.922878 1194 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:18:27.923556 1194 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:18:27.929390 1194 catalog_manager.cc:1347] Generated new cluster ID: 5ece55027856414984d326cdb3d0b829
I20260923 17:18:27.929492 1194 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:18:27.950517 1194 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:18:27.951624 1194 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:18:27.960860 1194 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ea9c1a51874743a38469d07668b61573: Generated new TSK 0
I20260923 17:18:27.961671 1194 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 17:18:27.966156 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 1104
W20260923 17:18:27.971313 1089 connection.cc:535] client connection to 127.0.0.1:42667 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42667): Connection reset by peer (error 104)
2026-09-23T17:18:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1466 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790183633736342-12182-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 17:18:28 dist-test-slave-1x1f krb5kdc[1203](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 17:18:28 dist-test-slave-1x1f krb5kdc[1203](info): set up 2 sockets
Sep 23 17:18:28 dist-test-slave-1x1f krb5kdc[1203](info): commencing operation
krb5kdc: starting...
W20260923 17:18:29.067201 12182 mini_kdc.cc:121] Time spent starting KDC: real 1.081s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Sep 23 17:18:29 dist-test-slave-1x1f krb5kdc[1203](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183909, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T17:18:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:18:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790183633736342-12182-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790183633736342-12182-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260923 17:18:29.202551 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45777
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790183633736342-12182-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45777
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:18:29.314714 1216 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:18:29.315109 1216 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:18:29.315155 1216 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:18:29.319365 1216 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:18:29.319427 1216 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:18:29.319446 1216 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:18:29.319463 1216 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:18:29.319479 1216 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:18:29.324844 1216 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45777
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790183633736342-12182-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45777
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1216
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:18:29.325920 1216 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:18:29.326954 1216 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:18:29.336081 1221 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:29.336148 1222 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:29.336275 1216 server_base.cc:1034] running on GCE node
W20260923 17:18:29.336315 1224 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:29.337126 1216 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:18:29.338421 1216 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:18:29.339617 1216 hybrid_clock.cc:648] HybridClock initialized: now 1790183909339589 us; error 43 us; skew 500 ppm
Sep 23 17:18:29 dist-test-slave-1x1f krb5kdc[1203](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183909, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:18:29.342772 1216 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260923 17:18:29.343751 1216 webserver.cc:460] Webserver started at http://127.0.0.1:46135/ using document root <none> and password file <none>
I20260923 17:18:29.344384 1216 fs_manager.cc:359] Metadata directory not provided
I20260923 17:18:29.344486 1216 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:18:29.344713 1216 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:18:29.346832 1216 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "17e45525019a44508c60f45929df0896"
format_stamp: "Formatted at 2026-09-23 17:18:29 on dist-test-slave-1x1f"
server_key: "8b4b2ff11c0f532c8ba7796482a6fee3"
server_key_iv: "0158560cd3408924cfb174bd8f84e815"
server_key_version: "encryptionkey@0"
I20260923 17:18:29.347427 1216 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "17e45525019a44508c60f45929df0896"
format_stamp: "Formatted at 2026-09-23 17:18:29 on dist-test-slave-1x1f"
server_key: "8b4b2ff11c0f532c8ba7796482a6fee3"
server_key_iv: "0158560cd3408924cfb174bd8f84e815"
server_key_version: "encryptionkey@0"
I20260923 17:18:29.351145 1216 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260923 17:18:29.353711 1231 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:29.355108 1216 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 17:18:29.355306 1216 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "17e45525019a44508c60f45929df0896"
format_stamp: "Formatted at 2026-09-23 17:18:29 on dist-test-slave-1x1f"
server_key: "8b4b2ff11c0f532c8ba7796482a6fee3"
server_key_iv: "0158560cd3408924cfb174bd8f84e815"
server_key_version: "encryptionkey@0"
I20260923 17:18:29.355429 1216 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:18:29.360076 1216 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:18:29.363541 1216 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:18:29.363790 1216 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:18:29.372264 1216 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45777
I20260923 17:18:29.372285 1283 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45777 every 8 connection(s)
I20260923 17:18:29.373286 1216 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:18:29.376300 1284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:18:29.379346 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 1216
I20260923 17:18:29.379694 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:18:29.380093 12182 external_mini_cluster.cc:1428] Setting key a16105db36257906a18d534ea88cd4c9
I20260923 17:18:29.382851 1284 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17e45525019a44508c60f45929df0896: Bootstrap starting.
I20260923 17:18:29.385509 1284 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 17e45525019a44508c60f45929df0896: Neither blocks nor log segments found. Creating new log.
I20260923 17:18:29.386516 1284 log.cc:824] T 00000000000000000000000000000000 P 17e45525019a44508c60f45929df0896: Log is configured to *not* fsync() on all Append() calls
I20260923 17:18:29.387017 1287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:29.382546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.1.8:46495 (local address 127.0.0.1:45777)
0923 17:18:29.383033 (+ 487us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:29.383047 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:29.383083 (+ 36us) server_negotiation.cc:407] Connection header received
0923 17:18:29.383707 (+ 624us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:29.383725 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:29.384005 (+ 280us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:29.384340 (+ 335us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:29.385491 (+ 1151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:29.385497 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:29.385509 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:18:29.385523 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:29.385578 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:18:29.385599 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:29.385755 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:29.385933 (+ 178us) server_negotiation.cc:299] Negotiation successful
0923 17:18:29.386132 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":321,"thread_start_us":178,"threads_started":1}
I20260923 17:18:29.388652 1284 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17e45525019a44508c60f45929df0896: No bootstrap required, opened a new log
I20260923 17:18:29.389992 12182 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 17:18:29.393543 1284 raft_consensus.cc:348] T 00000000000000000000000000000000 P 17e45525019a44508c60f45929df0896 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17e45525019a44508c60f45929df0896" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45777 } }
I20260923 17:18:29.393849 1284 raft_consensus.cc:374] T 00000000000000000000000000000000 P 17e45525019a44508c60f45929df0896 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:18:29.393922 1284 raft_consensus.cc:729] T 00000000000000000000000000000000 P 17e45525019a44508c60f45929df0896 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17e45525019a44508c60f45929df0896, State: Initialized, Role: FOLLOWER
I20260923 17:18:29.393980 1287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:29.392394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.1.8:42281 (local address 127.0.0.1:45777)
0923 17:18:29.392523 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:29.392527 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:29.392663 (+ 136us) server_negotiation.cc:407] Connection header received
0923 17:18:29.392778 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:29.392780 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:29.392807 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:29.392870 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:29.393535 (+ 665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:29.393538 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:29.393540 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:18:29.393550 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:29.393573 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:18:29.393583 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:29.393649 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:29.393766 (+ 117us) server_negotiation.cc:299] Negotiation successful
0923 17:18:29.393798 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260923 17:18:29.394444 1284 consensus_queue.cc:260] T 00000000000000000000000000000000 P 17e45525019a44508c60f45929df0896 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17e45525019a44508c60f45929df0896" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45777 } }
I20260923 17:18:29.394604 1284 raft_consensus.cc:388] T 00000000000000000000000000000000 P 17e45525019a44508c60f45929df0896 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:18:29.394661 1284 raft_consensus.cc:482] T 00000000000000000000000000000000 P 17e45525019a44508c60f45929df0896 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:18:29.394745 1284 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 17e45525019a44508c60f45929df0896 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:18:29.395648 1284 raft_consensus.cc:504] T 00000000000000000000000000000000 P 17e45525019a44508c60f45929df0896 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17e45525019a44508c60f45929df0896" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45777 } }
I20260923 17:18:29.395987 1284 leader_election.cc:302] T 00000000000000000000000000000000 P 17e45525019a44508c60f45929df0896 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 17e45525019a44508c60f45929df0896; no voters:
I20260923 17:18:29.396277 1284 leader_election.cc:288] T 00000000000000000000000000000000 P 17e45525019a44508c60f45929df0896 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 17:18:29.396404 1294 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 17e45525019a44508c60f45929df0896 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:18:29.396679 1294 raft_consensus.cc:686] T 00000000000000000000000000000000 P 17e45525019a44508c60f45929df0896 [term 1 LEADER]: Becoming Leader. State: Replica: 17e45525019a44508c60f45929df0896, State: Running, Role: LEADER
I20260923 17:18:29.397022 1294 consensus_queue.cc:237] T 00000000000000000000000000000000 P 17e45525019a44508c60f45929df0896 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17e45525019a44508c60f45929df0896" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45777 } }
I20260923 17:18:29.397574 1284 sys_catalog.cc:564] T 00000000000000000000000000000000 P 17e45525019a44508c60f45929df0896 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:18:29.398837 1296 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17e45525019a44508c60f45929df0896 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 17e45525019a44508c60f45929df0896. Latest consensus state: current_term: 1 leader_uuid: "17e45525019a44508c60f45929df0896" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17e45525019a44508c60f45929df0896" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45777 } } }
I20260923 17:18:29.398859 1295 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17e45525019a44508c60f45929df0896 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "17e45525019a44508c60f45929df0896" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17e45525019a44508c60f45929df0896" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45777 } } }
I20260923 17:18:29.399204 1295 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17e45525019a44508c60f45929df0896 [sys.catalog]: This master's current role is: LEADER
I20260923 17:18:29.399039 1296 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17e45525019a44508c60f45929df0896 [sys.catalog]: This master's current role is: LEADER
W20260923 17:18:29.402355 1309 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 17e45525019a44508c60f45929df0896: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 17:18:29.402437 1309 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 17:18:29.402503 1305 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:18:29.403239 1305 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:18:29.408813 1305 catalog_manager.cc:1347] Generated new cluster ID: 3ecce52c1e084620b6d8f67bcb1423ae
I20260923 17:18:29.408892 1305 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:18:29.441540 1305 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:18:29.441923 1305 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:18:29.451460 1305 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 17e45525019a44508c60f45929df0896: Generated new TSK 0
I20260923 17:18:29.452442 1305 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 17:18:29.461916 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 1216
2026-09-23T17:18:29Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1497 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790183633736342-12182-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 17:18:29 dist-test-slave-1x1f krb5kdc[1315](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 17:18:29 dist-test-slave-1x1f krb5kdc[1315](info): set up 2 sockets
Sep 23 17:18:29 dist-test-slave-1x1f krb5kdc[1315](info): commencing operation
krb5kdc: starting...
W20260923 17:18:30.519052 12182 mini_kdc.cc:121] Time spent starting KDC: real 1.036s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Sep 23 17:18:30 dist-test-slave-1x1f krb5kdc[1315](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183910, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T17:18:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:18:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.229.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
I20260923 17:18:30.645891 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:32937
--webserver_interface=127.11.229.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:44163
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:32937
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:18:30.756274 1328 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:18:30.756587 1328 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:18:30.756664 1328 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:18:30.760840 1328 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:18:30.760946 1328 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:18:30.760986 1328 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:18:30.761042 1328 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:18:30.761081 1328 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:18:30.766499 1328 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:44163
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:32937
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:32937
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.229.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1328
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:18:30.767673 1328 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:18:30.768723 1328 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:18:30.777725 1334 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:30.777796 1336 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:30.777720 1333 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:30.778280 1328 server_base.cc:1034] running on GCE node
I20260923 17:18:30.778827 1328 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:18:30.779994 1328 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:18:30.781241 1328 hybrid_clock.cc:648] HybridClock initialized: now 1790183910781209 us; error 45 us; skew 500 ppm
Sep 23 17:18:30 dist-test-slave-1x1f krb5kdc[1315](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183910, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:18:30.790091 1328 init.cc:377] Logged in from keytab as kudu/127.11.229.190@KRBTEST.COM (short username kudu)
I20260923 17:18:30.791256 1328 webserver.cc:460] Webserver started at http://127.11.229.190:43215/ using document root <none> and password file <none>
I20260923 17:18:30.791857 1328 fs_manager.cc:359] Metadata directory not provided
I20260923 17:18:30.791920 1328 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:18:30.792091 1328 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:18:30.794138 1328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "6720da77bd004b7481c92355d2f1df31"
format_stamp: "Formatted at 2026-09-23 17:18:30 on dist-test-slave-1x1f"
server_key: "3d5ea55ce03419956099a48a6c446b9c"
server_key_iv: "f9f8c26fe2d089811e05f2b6f566991d"
server_key_version: "encryptionkey@0"
I20260923 17:18:30.794727 1328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "6720da77bd004b7481c92355d2f1df31"
format_stamp: "Formatted at 2026-09-23 17:18:30 on dist-test-slave-1x1f"
server_key: "3d5ea55ce03419956099a48a6c446b9c"
server_key_iv: "f9f8c26fe2d089811e05f2b6f566991d"
server_key_version: "encryptionkey@0"
I20260923 17:18:30.798451 1328 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260923 17:18:30.800851 1343 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:30.802194 1328 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260923 17:18:30.802376 1328 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "6720da77bd004b7481c92355d2f1df31"
format_stamp: "Formatted at 2026-09-23 17:18:30 on dist-test-slave-1x1f"
server_key: "3d5ea55ce03419956099a48a6c446b9c"
server_key_iv: "f9f8c26fe2d089811e05f2b6f566991d"
server_key_version: "encryptionkey@0"
I20260923 17:18:30.802480 1328 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:18:30.830071 1328 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:18:30.833425 1328 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:18:30.833652 1328 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:18:30.841648 1328 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.190:32937
I20260923 17:18:30.841665 1395 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.190:32937 every 8 connection(s)
I20260923 17:18:30.842685 1328 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:18:30.845474 1396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:18:30.851138 1396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6720da77bd004b7481c92355d2f1df31: Bootstrap starting.
I20260923 17:18:30.852468 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 1328
I20260923 17:18:30.852623 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:18:30.852934 12182 external_mini_cluster.cc:1428] Setting key 17748f76ca1e33bf4ab38ea0466e41b6
I20260923 17:18:30.853832 1396 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6720da77bd004b7481c92355d2f1df31: Neither blocks nor log segments found. Creating new log.
I20260923 17:18:30.854796 1396 log.cc:824] T 00000000000000000000000000000000 P 6720da77bd004b7481c92355d2f1df31: Log is configured to *not* fsync() on all Append() calls
I20260923 17:18:30.856990 1396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6720da77bd004b7481c92355d2f1df31: No bootstrap required, opened a new log
I20260923 17:18:30.861214 1396 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6720da77bd004b7481c92355d2f1df31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6720da77bd004b7481c92355d2f1df31" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 32937 } }
I20260923 17:18:30.861428 1396 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6720da77bd004b7481c92355d2f1df31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:18:30.861493 1396 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6720da77bd004b7481c92355d2f1df31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6720da77bd004b7481c92355d2f1df31, State: Initialized, Role: FOLLOWER
I20260923 17:18:30.861928 1396 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6720da77bd004b7481c92355d2f1df31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6720da77bd004b7481c92355d2f1df31" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 32937 } }
I20260923 17:18:30.862056 1396 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6720da77bd004b7481c92355d2f1df31 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:18:30.862143 1396 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6720da77bd004b7481c92355d2f1df31 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:18:30.862294 1396 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6720da77bd004b7481c92355d2f1df31 [term 0 FOLLOWER]: Advancing to term 1
Sep 23 17:18:30 dist-test-slave-1x1f krb5kdc[1315](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183910, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:18:30.863320 1396 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6720da77bd004b7481c92355d2f1df31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6720da77bd004b7481c92355d2f1df31" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 32937 } }
I20260923 17:18:30.863698 1396 leader_election.cc:302] T 00000000000000000000000000000000 P 6720da77bd004b7481c92355d2f1df31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6720da77bd004b7481c92355d2f1df31; no voters:
I20260923 17:18:30.864094 1396 leader_election.cc:288] T 00000000000000000000000000000000 P 6720da77bd004b7481c92355d2f1df31 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 17:18:30.864216 1401 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6720da77bd004b7481c92355d2f1df31 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:18:30.864462 1401 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6720da77bd004b7481c92355d2f1df31 [term 1 LEADER]: Becoming Leader. State: Replica: 6720da77bd004b7481c92355d2f1df31, State: Running, Role: LEADER
I20260923 17:18:30.864864 1401 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6720da77bd004b7481c92355d2f1df31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6720da77bd004b7481c92355d2f1df31" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 32937 } }
I20260923 17:18:30.865545 1396 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6720da77bd004b7481c92355d2f1df31 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:18:30.866219 1403 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6720da77bd004b7481c92355d2f1df31 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6720da77bd004b7481c92355d2f1df31" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6720da77bd004b7481c92355d2f1df31" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 32937 } } }
I20260923 17:18:30.866441 1403 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6720da77bd004b7481c92355d2f1df31 [sys.catalog]: This master's current role is: LEADER
I20260923 17:18:30.866415 1402 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6720da77bd004b7481c92355d2f1df31 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6720da77bd004b7481c92355d2f1df31. Latest consensus state: current_term: 1 leader_uuid: "6720da77bd004b7481c92355d2f1df31" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6720da77bd004b7481c92355d2f1df31" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 32937 } } }
I20260923 17:18:30.866567 1402 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6720da77bd004b7481c92355d2f1df31 [sys.catalog]: This master's current role is: LEADER
I20260923 17:18:30.867112 1410 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:18:30.869656 1399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:30.854101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36091 (local address 127.11.229.190:32937)
0923 17:18:30.854702 (+ 601us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:30.854720 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:30.854761 (+ 41us) server_negotiation.cc:407] Connection header received
0923 17:18:30.855516 (+ 755us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:30.855534 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:30.855971 (+ 437us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:30.856318 (+ 347us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:30.857046 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:30.858546 (+ 1500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:30.859485 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:30.860271 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:30.860460 (+ 189us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:30.863348 (+ 2888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:30.863355 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:30.863372 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:30.863405 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:30.865573 (+ 2168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:30.866286 (+ 713us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:30.866296 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:30.866303 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:30.866467 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:30.866896 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:30.866899 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:30.866901 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:30.867476 (+ 575us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:30.867695 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:30.868457 (+ 762us) server_negotiation.cc:299] Negotiation successful
0923 17:18:30.868676 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":436,"thread_start_us":243,"threads_started":1}
I20260923 17:18:30.871043 1410 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:18:30.872819 12182 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 17:18:30.877358 1410 catalog_manager.cc:1347] Generated new cluster ID: 1cddd5bfb0ee4096a7d3363305e07034
I20260923 17:18:30.877417 1410 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:18:30.883177 1399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:30.875361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58345 (local address 127.11.229.190:32937)
0923 17:18:30.875463 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:30.875467 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:30.875481 (+ 14us) server_negotiation.cc:407] Connection header received
0923 17:18:30.875517 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:30.875519 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:30.875560 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:30.875639 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:30.876501 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:30.877251 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:30.878091 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:30.878429 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:30.878538 (+ 109us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:30.879874 (+ 1336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:30.879878 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:30.879880 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:30.879903 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:30.881322 (+ 1419us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:30.881788 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:30.881791 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:30.881793 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:30.881873 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:30.882198 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:30.882201 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:30.882203 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:30.882435 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:30.882610 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:30.882908 (+ 298us) server_negotiation.cc:299] Negotiation successful
0923 17:18:30.883004 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260923 17:18:30.890661 1410 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:18:30.891860 1410 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:18:30.902875 1410 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6720da77bd004b7481c92355d2f1df31: Generated new TSK 0
I20260923 17:18:30.903689 1410 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 17:18:30.912262 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 1328
W20260923 17:18:30.917893 1313 connection.cc:535] client connection to 127.11.229.190:32937 recv error: Network error: failed to read from TLS socket (remote: 127.11.229.190:32937): Connection reset by peer (error 104)
2026-09-23T17:18:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1449 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790183633736342-12182-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 17:18:30 dist-test-slave-1x1f krb5kdc[1427](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 17:18:30 dist-test-slave-1x1f krb5kdc[1427](info): set up 2 sockets
Sep 23 17:18:30 dist-test-slave-1x1f krb5kdc[1427](info): commencing operation
krb5kdc: starting...
W20260923 17:18:31.963073 12182 mini_kdc.cc:121] Time spent starting KDC: real 1.030s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Sep 23 17:18:32 dist-test-slave-1x1f krb5kdc[1427](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183912, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T17:18:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:18:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.229.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
I20260923 17:18:32.093039 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:34569
--webserver_interface=127.11.229.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:41171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:34569
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:18:32.202279 1440 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:18:32.202598 1440 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:18:32.202689 1440 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:18:32.206735 1440 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:18:32.206833 1440 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:18:32.206871 1440 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:18:32.206907 1440 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:18:32.206939 1440 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:18:32.212272 1440 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:41171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:34569
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:34569
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.229.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1440
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:18:32.213366 1440 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:18:32.214411 1440 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:18:32.223069 1445 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:32.223067 1446 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:32.223177 1448 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:32.223196 1440 server_base.cc:1034] running on GCE node
I20260923 17:18:32.223927 1440 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:18:32.225005 1440 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:18:32.226193 1440 hybrid_clock.cc:648] HybridClock initialized: now 1790183912226176 us; error 33 us; skew 500 ppm
Sep 23 17:18:32 dist-test-slave-1x1f krb5kdc[1427](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183912, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:18:32.229072 1440 init.cc:377] Logged in from keytab as kudu/127.11.229.190@KRBTEST.COM (short username kudu)
I20260923 17:18:32.229956 1440 webserver.cc:460] Webserver started at http://127.11.229.190:37585/ using document root <none> and password file <none>
I20260923 17:18:32.230566 1440 fs_manager.cc:359] Metadata directory not provided
I20260923 17:18:32.230635 1440 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:18:32.230813 1440 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:18:32.232852 1440 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "974fec1dfe6844c2a0980006adf96392"
format_stamp: "Formatted at 2026-09-23 17:18:32 on dist-test-slave-1x1f"
server_key: "79f2bb3b7ea03f90724362a51f22268b"
server_key_iv: "27f229454c39151381228772b451b006"
server_key_version: "encryptionkey@0"
I20260923 17:18:32.233351 1440 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "974fec1dfe6844c2a0980006adf96392"
format_stamp: "Formatted at 2026-09-23 17:18:32 on dist-test-slave-1x1f"
server_key: "79f2bb3b7ea03f90724362a51f22268b"
server_key_iv: "27f229454c39151381228772b451b006"
server_key_version: "encryptionkey@0"
I20260923 17:18:32.237092 1440 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260923 17:18:32.239799 1455 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:32.241231 1440 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260923 17:18:32.241400 1440 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "974fec1dfe6844c2a0980006adf96392"
format_stamp: "Formatted at 2026-09-23 17:18:32 on dist-test-slave-1x1f"
server_key: "79f2bb3b7ea03f90724362a51f22268b"
server_key_iv: "27f229454c39151381228772b451b006"
server_key_version: "encryptionkey@0"
I20260923 17:18:32.241523 1440 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:18:32.255743 1440 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:18:32.259262 1440 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:18:32.259506 1440 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:18:32.267127 1440 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.190:34569
I20260923 17:18:32.267148 1507 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.190:34569 every 8 connection(s)
I20260923 17:18:32.268143 1440 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:18:32.269503 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 1440
I20260923 17:18:32.269649 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:18:32.269949 12182 external_mini_cluster.cc:1428] Setting key 53d89111548a15ba5869488f35080ca1
I20260923 17:18:32.271291 1508 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:18:32.276592 1508 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 974fec1dfe6844c2a0980006adf96392: Bootstrap starting.
I20260923 17:18:32.278822 1508 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 974fec1dfe6844c2a0980006adf96392: Neither blocks nor log segments found. Creating new log.
I20260923 17:18:32.279450 1511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:32.271421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40217 (local address 127.11.229.190:34569)
0923 17:18:32.271872 (+ 451us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:32.271888 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:32.271926 (+ 38us) server_negotiation.cc:407] Connection header received
0923 17:18:32.272644 (+ 718us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:32.272660 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:32.272995 (+ 335us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:32.273353 (+ 358us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:32.273768 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:32.274923 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:32.275910 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:32.276416 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:32.276603 (+ 187us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:32.277607 (+ 1004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:32.277612 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:32.277625 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:18:32.278029 (+ 404us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:32.278085 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:18:32.278109 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:32.278284 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:32.278501 (+ 217us) server_negotiation.cc:299] Negotiation successful
0923 17:18:32.278647 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":154,"threads_started":1}
I20260923 17:18:32.279557 1508 log.cc:824] T 00000000000000000000000000000000 P 974fec1dfe6844c2a0980006adf96392: Log is configured to *not* fsync() on all Append() calls
I20260923 17:18:32.281548 1508 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 974fec1dfe6844c2a0980006adf96392: No bootstrap required, opened a new log
I20260923 17:18:32.282737 12182 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 17:18:32.285605 1508 raft_consensus.cc:348] T 00000000000000000000000000000000 P 974fec1dfe6844c2a0980006adf96392 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "974fec1dfe6844c2a0980006adf96392" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 34569 } }
I20260923 17:18:32.285861 1508 raft_consensus.cc:374] T 00000000000000000000000000000000 P 974fec1dfe6844c2a0980006adf96392 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:18:32.285936 1508 raft_consensus.cc:729] T 00000000000000000000000000000000 P 974fec1dfe6844c2a0980006adf96392 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 974fec1dfe6844c2a0980006adf96392, State: Initialized, Role: FOLLOWER
I20260923 17:18:32.286417 1508 consensus_queue.cc:260] T 00000000000000000000000000000000 P 974fec1dfe6844c2a0980006adf96392 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "974fec1dfe6844c2a0980006adf96392" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 34569 } }
I20260923 17:18:32.286573 1508 raft_consensus.cc:388] T 00000000000000000000000000000000 P 974fec1dfe6844c2a0980006adf96392 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:18:32.286640 1508 raft_consensus.cc:482] T 00000000000000000000000000000000 P 974fec1dfe6844c2a0980006adf96392 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:18:32.286743 1508 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 974fec1dfe6844c2a0980006adf96392 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:18:32.287636 1508 raft_consensus.cc:504] T 00000000000000000000000000000000 P 974fec1dfe6844c2a0980006adf96392 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "974fec1dfe6844c2a0980006adf96392" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 34569 } }
I20260923 17:18:32.288005 1508 leader_election.cc:302] T 00000000000000000000000000000000 P 974fec1dfe6844c2a0980006adf96392 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 974fec1dfe6844c2a0980006adf96392; no voters:
I20260923 17:18:32.288367 1508 leader_election.cc:288] T 00000000000000000000000000000000 P 974fec1dfe6844c2a0980006adf96392 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 17:18:32.288431 1518 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 974fec1dfe6844c2a0980006adf96392 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:18:32.288635 1518 raft_consensus.cc:686] T 00000000000000000000000000000000 P 974fec1dfe6844c2a0980006adf96392 [term 1 LEADER]: Becoming Leader. State: Replica: 974fec1dfe6844c2a0980006adf96392, State: Running, Role: LEADER
I20260923 17:18:32.288939 1511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:32.284727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49653 (local address 127.11.229.190:34569)
0923 17:18:32.284866 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:32.284870 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:32.285043 (+ 173us) server_negotiation.cc:407] Connection header received
0923 17:18:32.285160 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:32.285162 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:32.285199 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:32.285262 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:32.285534 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:32.286148 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:32.287160 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:32.287394 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:32.287499 (+ 105us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:32.288385 (+ 886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:32.288389 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:32.288392 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:18:32.288404 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:32.288432 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:18:32.288448 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:32.288529 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:32.288767 (+ 238us) server_negotiation.cc:299] Negotiation successful
0923 17:18:32.288802 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260923 17:18:32.288965 1518 consensus_queue.cc:237] T 00000000000000000000000000000000 P 974fec1dfe6844c2a0980006adf96392 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "974fec1dfe6844c2a0980006adf96392" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 34569 } }
I20260923 17:18:32.289634 1508 sys_catalog.cc:564] T 00000000000000000000000000000000 P 974fec1dfe6844c2a0980006adf96392 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:18:32.290822 1520 sys_catalog.cc:455] T 00000000000000000000000000000000 P 974fec1dfe6844c2a0980006adf96392 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "974fec1dfe6844c2a0980006adf96392" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "974fec1dfe6844c2a0980006adf96392" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 34569 } } }
I20260923 17:18:32.290947 1520 sys_catalog.cc:458] T 00000000000000000000000000000000 P 974fec1dfe6844c2a0980006adf96392 [sys.catalog]: This master's current role is: LEADER
I20260923 17:18:32.291085 1519 sys_catalog.cc:455] T 00000000000000000000000000000000 P 974fec1dfe6844c2a0980006adf96392 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 974fec1dfe6844c2a0980006adf96392. Latest consensus state: current_term: 1 leader_uuid: "974fec1dfe6844c2a0980006adf96392" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "974fec1dfe6844c2a0980006adf96392" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 34569 } } }
I20260923 17:18:32.291254 1519 sys_catalog.cc:458] T 00000000000000000000000000000000 P 974fec1dfe6844c2a0980006adf96392 [sys.catalog]: This master's current role is: LEADER
W20260923 17:18:32.294138 1533 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 974fec1dfe6844c2a0980006adf96392: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 17:18:32.294202 1533 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 17:18:32.294335 1529 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:18:32.295497 1529 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:18:32.300598 1529 catalog_manager.cc:1347] Generated new cluster ID: 7b168a1fb83546a6bdd4c778d5cc1c83
I20260923 17:18:32.300665 1529 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:18:32.311772 1529 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:18:32.312747 1529 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:18:32.332593 1529 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 974fec1dfe6844c2a0980006adf96392: Generated new TSK 0
I20260923 17:18:32.333431 1529 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 17:18:32.339943 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 1440
W20260923 17:18:32.344920 1425 connection.cc:535] client connection to 127.11.229.190:34569 recv error: Network error: failed to read from TLS socket (remote: 127.11.229.190:34569): Connection reset by peer (error 104)
2026-09-23T17:18:32Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1426 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790183633736342-12182-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 17:18:32 dist-test-slave-1x1f krb5kdc[1539](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 17:18:32 dist-test-slave-1x1f krb5kdc[1539](info): set up 2 sockets
Sep 23 17:18:32 dist-test-slave-1x1f krb5kdc[1539](info): commencing operation
krb5kdc: starting...
W20260923 17:18:33.463153 12182 mini_kdc.cc:121] Time spent starting KDC: real 1.104s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Sep 23 17:18:33 dist-test-slave-1x1f krb5kdc[1539](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183913, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T17:18:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:18:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.229.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
I20260923 17:18:33.601202 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:39999
--webserver_interface=127.11.229.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:46481
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:39999
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:18:33.714483 1552 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:18:33.714738 1552 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:18:33.714781 1552 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:18:33.718806 1552 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:18:33.718866 1552 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:18:33.718885 1552 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:18:33.718902 1552 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:18:33.718917 1552 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:18:33.724252 1552 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:46481
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:39999
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:39999
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.229.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1552
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:18:33.725319 1552 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:18:33.726377 1552 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:18:33.735550 1558 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:33.735482 1560 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:33.735523 1552 server_base.cc:1034] running on GCE node
W20260923 17:18:33.735680 1557 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:33.736368 1552 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:18:33.737506 1552 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:18:33.738724 1552 hybrid_clock.cc:648] HybridClock initialized: now 1790183913738706 us; error 32 us; skew 500 ppm
Sep 23 17:18:33 dist-test-slave-1x1f krb5kdc[1539](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183913, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:18:33.741887 1552 init.cc:377] Logged in from keytab as kudu/127.11.229.190@KRBTEST.COM (short username kudu)
I20260923 17:18:33.742892 1552 webserver.cc:460] Webserver started at http://127.11.229.190:36213/ using document root <none> and password file <none>
I20260923 17:18:33.743475 1552 fs_manager.cc:359] Metadata directory not provided
I20260923 17:18:33.743577 1552 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:18:33.743813 1552 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:18:33.745883 1552 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "62bd64313e844caa81dc87e5407f1ab6"
format_stamp: "Formatted at 2026-09-23 17:18:33 on dist-test-slave-1x1f"
server_key: "2380eb874a0ee8cd152c6e768a4fe0c4"
server_key_iv: "913770b11c423278435563510bf0d84f"
server_key_version: "encryptionkey@0"
I20260923 17:18:33.746496 1552 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "62bd64313e844caa81dc87e5407f1ab6"
format_stamp: "Formatted at 2026-09-23 17:18:33 on dist-test-slave-1x1f"
server_key: "2380eb874a0ee8cd152c6e768a4fe0c4"
server_key_iv: "913770b11c423278435563510bf0d84f"
server_key_version: "encryptionkey@0"
I20260923 17:18:33.750263 1552 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260923 17:18:33.753125 1567 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:33.754554 1552 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 17:18:33.754696 1552 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "62bd64313e844caa81dc87e5407f1ab6"
format_stamp: "Formatted at 2026-09-23 17:18:33 on dist-test-slave-1x1f"
server_key: "2380eb874a0ee8cd152c6e768a4fe0c4"
server_key_iv: "913770b11c423278435563510bf0d84f"
server_key_version: "encryptionkey@0"
I20260923 17:18:33.754815 1552 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:18:33.759688 1552 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:18:33.763296 1552 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:18:33.763605 1552 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:18:33.771287 1552 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.190:39999
I20260923 17:18:33.771337 1619 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.190:39999 every 8 connection(s)
I20260923 17:18:33.772269 1552 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:18:33.775188 1620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:18:33.778506 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 1552
I20260923 17:18:33.778650 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:18:33.778949 12182 external_mini_cluster.cc:1428] Setting key 09aac1ad6024c2e73f06445ca065caee
I20260923 17:18:33.781183 1620 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62bd64313e844caa81dc87e5407f1ab6: Bootstrap starting.
I20260923 17:18:33.783589 1620 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 62bd64313e844caa81dc87e5407f1ab6: Neither blocks nor log segments found. Creating new log.
I20260923 17:18:33.784328 1623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:33.780406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51495 (local address 127.11.229.190:39999)
0923 17:18:33.780864 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:33.780878 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:33.780914 (+ 36us) server_negotiation.cc:407] Connection header received
0923 17:18:33.781589 (+ 675us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:33.781608 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:33.781898 (+ 290us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:33.782232 (+ 334us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:33.783100 (+ 868us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:33.783104 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:33.783116 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:18:33.783126 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:33.783177 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:18:33.783196 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:33.783313 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:33.783442 (+ 129us) server_negotiation.cc:299] Negotiation successful
0923 17:18:33.783601 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":133,"threads_started":1}
I20260923 17:18:33.784363 1620 log.cc:824] T 00000000000000000000000000000000 P 62bd64313e844caa81dc87e5407f1ab6: Log is configured to *not* fsync() on all Append() calls
I20260923 17:18:33.786605 1620 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62bd64313e844caa81dc87e5407f1ab6: No bootstrap required, opened a new log
I20260923 17:18:33.787375 12182 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 17:18:33.790711 1620 raft_consensus.cc:348] T 00000000000000000000000000000000 P 62bd64313e844caa81dc87e5407f1ab6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62bd64313e844caa81dc87e5407f1ab6" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 39999 } }
I20260923 17:18:33.790959 1620 raft_consensus.cc:374] T 00000000000000000000000000000000 P 62bd64313e844caa81dc87e5407f1ab6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:18:33.791035 1620 raft_consensus.cc:729] T 00000000000000000000000000000000 P 62bd64313e844caa81dc87e5407f1ab6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62bd64313e844caa81dc87e5407f1ab6, State: Initialized, Role: FOLLOWER
I20260923 17:18:33.791080 1623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:33.789411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49025 (local address 127.11.229.190:39999)
0923 17:18:33.789545 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:33.789549 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:33.789673 (+ 124us) server_negotiation.cc:407] Connection header received
0923 17:18:33.789817 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:33.789820 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:33.789860 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:33.789944 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:33.790652 (+ 708us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:33.790655 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:33.790658 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:18:33.790669 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:33.790693 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:18:33.790712 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:33.790810 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:33.790882 (+ 72us) server_negotiation.cc:299] Negotiation successful
0923 17:18:33.790921 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260923 17:18:33.791509 1620 consensus_queue.cc:260] T 00000000000000000000000000000000 P 62bd64313e844caa81dc87e5407f1ab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62bd64313e844caa81dc87e5407f1ab6" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 39999 } }
I20260923 17:18:33.791640 1620 raft_consensus.cc:388] T 00000000000000000000000000000000 P 62bd64313e844caa81dc87e5407f1ab6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:18:33.791729 1620 raft_consensus.cc:482] T 00000000000000000000000000000000 P 62bd64313e844caa81dc87e5407f1ab6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:18:33.791864 1620 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 62bd64313e844caa81dc87e5407f1ab6 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:18:33.792800 1620 raft_consensus.cc:504] T 00000000000000000000000000000000 P 62bd64313e844caa81dc87e5407f1ab6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62bd64313e844caa81dc87e5407f1ab6" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 39999 } }
I20260923 17:18:33.793162 1620 leader_election.cc:302] T 00000000000000000000000000000000 P 62bd64313e844caa81dc87e5407f1ab6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 62bd64313e844caa81dc87e5407f1ab6; no voters:
I20260923 17:18:33.793460 1620 leader_election.cc:288] T 00000000000000000000000000000000 P 62bd64313e844caa81dc87e5407f1ab6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 17:18:33.793604 1630 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 62bd64313e844caa81dc87e5407f1ab6 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:18:33.793835 1630 raft_consensus.cc:686] T 00000000000000000000000000000000 P 62bd64313e844caa81dc87e5407f1ab6 [term 1 LEADER]: Becoming Leader. State: Replica: 62bd64313e844caa81dc87e5407f1ab6, State: Running, Role: LEADER
I20260923 17:18:33.794178 1630 consensus_queue.cc:237] T 00000000000000000000000000000000 P 62bd64313e844caa81dc87e5407f1ab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62bd64313e844caa81dc87e5407f1ab6" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 39999 } }
I20260923 17:18:33.795217 1620 sys_catalog.cc:564] T 00000000000000000000000000000000 P 62bd64313e844caa81dc87e5407f1ab6 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:18:33.796150 1631 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62bd64313e844caa81dc87e5407f1ab6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "62bd64313e844caa81dc87e5407f1ab6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62bd64313e844caa81dc87e5407f1ab6" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 39999 } } }
I20260923 17:18:33.796128 1632 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62bd64313e844caa81dc87e5407f1ab6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 62bd64313e844caa81dc87e5407f1ab6. Latest consensus state: current_term: 1 leader_uuid: "62bd64313e844caa81dc87e5407f1ab6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "62bd64313e844caa81dc87e5407f1ab6" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 39999 } } }
I20260923 17:18:33.796277 1631 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62bd64313e844caa81dc87e5407f1ab6 [sys.catalog]: This master's current role is: LEADER
I20260923 17:18:33.796277 1632 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62bd64313e844caa81dc87e5407f1ab6 [sys.catalog]: This master's current role is: LEADER
I20260923 17:18:33.796799 1639 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:18:33.799551 1639 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:18:33.805225 1639 catalog_manager.cc:1347] Generated new cluster ID: 3abf7dc1ff1a4650925fd5d008ff3fc0
I20260923 17:18:33.805318 1639 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:18:33.812427 1639 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:18:33.812835 1639 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:18:33.818734 1639 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 62bd64313e844caa81dc87e5407f1ab6: Generated new TSK 0
I20260923 17:18:33.819466 1639 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 17:18:33.828188 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 1552
2026-09-23T17:18:33Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1488 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790183633736342-12182-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 17:18:33 dist-test-slave-1x1f krb5kdc[1651](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 17:18:33 dist-test-slave-1x1f krb5kdc[1651](info): set up 2 sockets
Sep 23 17:18:33 dist-test-slave-1x1f krb5kdc[1651](info): commencing operation
krb5kdc: starting...
W20260923 17:18:34.903599 12182 mini_kdc.cc:121] Time spent starting KDC: real 1.055s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Sep 23 17:18:34 dist-test-slave-1x1f krb5kdc[1651](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183914, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T17:18:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:18:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.229.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
I20260923 17:18:35.034564 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:41355
--webserver_interface=127.11.229.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:45391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:41355
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:18:35.149323 1664 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:18:35.149616 1664 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:18:35.149660 1664 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:18:35.153791 1664 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:18:35.153867 1664 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:18:35.153888 1664 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:18:35.153904 1664 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:18:35.153920 1664 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:18:35.159646 1664 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:45391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:41355
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:41355
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.229.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1664
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:18:35.160936 1664 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:18:35.162031 1664 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:18:35.171268 1669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:35.171296 1672 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:35.171355 1664 server_base.cc:1034] running on GCE node
W20260923 17:18:35.171296 1670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:35.172086 1664 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:18:35.173209 1664 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:18:35.174356 1664 hybrid_clock.cc:648] HybridClock initialized: now 1790183915174327 us; error 44 us; skew 500 ppm
Sep 23 17:18:35 dist-test-slave-1x1f krb5kdc[1651](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183915, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:18:35.177682 1664 init.cc:377] Logged in from keytab as kudu/127.11.229.190@KRBTEST.COM (short username kudu)
I20260923 17:18:35.179226 1664 webserver.cc:460] Webserver started at http://127.11.229.190:33131/ using document root <none> and password file <none>
I20260923 17:18:35.180014 1664 fs_manager.cc:359] Metadata directory not provided
I20260923 17:18:35.180104 1664 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:18:35.180326 1664 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:18:35.182811 1664 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "217d8f2f2cb64e07aa82121c8ee7503e"
format_stamp: "Formatted at 2026-09-23 17:18:35 on dist-test-slave-1x1f"
server_key: "e7afd76d3b970eae61ca6a2a3d08ae6a"
server_key_iv: "66a4685f7a4d51ae594371d9c560aaac"
server_key_version: "encryptionkey@0"
I20260923 17:18:35.183483 1664 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "217d8f2f2cb64e07aa82121c8ee7503e"
format_stamp: "Formatted at 2026-09-23 17:18:35 on dist-test-slave-1x1f"
server_key: "e7afd76d3b970eae61ca6a2a3d08ae6a"
server_key_iv: "66a4685f7a4d51ae594371d9c560aaac"
server_key_version: "encryptionkey@0"
I20260923 17:18:35.187856 1664 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260923 17:18:35.190773 1679 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:35.192155 1664 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 17:18:35.192317 1664 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "217d8f2f2cb64e07aa82121c8ee7503e"
format_stamp: "Formatted at 2026-09-23 17:18:35 on dist-test-slave-1x1f"
server_key: "e7afd76d3b970eae61ca6a2a3d08ae6a"
server_key_iv: "66a4685f7a4d51ae594371d9c560aaac"
server_key_version: "encryptionkey@0"
I20260923 17:18:35.192451 1664 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:18:35.211974 1664 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:18:35.215696 1664 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:18:35.215925 1664 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:18:35.223732 1664 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.190:41355
I20260923 17:18:35.223980 1731 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.190:41355 every 8 connection(s)
I20260923 17:18:35.224946 1664 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:18:35.227993 1732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:18:35.231628 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 1664
I20260923 17:18:35.231787 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:18:35.232117 12182 external_mini_cluster.cc:1428] Setting key cd85fd4711bd24844be0400017228440
I20260923 17:18:35.234674 1732 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 217d8f2f2cb64e07aa82121c8ee7503e: Bootstrap starting.
I20260923 17:18:35.237037 1732 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 217d8f2f2cb64e07aa82121c8ee7503e: Neither blocks nor log segments found. Creating new log.
I20260923 17:18:35.237861 1732 log.cc:824] T 00000000000000000000000000000000 P 217d8f2f2cb64e07aa82121c8ee7503e: Log is configured to *not* fsync() on all Append() calls
I20260923 17:18:35.240043 1732 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 217d8f2f2cb64e07aa82121c8ee7503e: No bootstrap required, opened a new log
Sep 23 17:18:35 dist-test-slave-1x1f krb5kdc[1651](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183914, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:18:35.243877 1732 raft_consensus.cc:348] T 00000000000000000000000000000000 P 217d8f2f2cb64e07aa82121c8ee7503e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "217d8f2f2cb64e07aa82121c8ee7503e" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 41355 } }
I20260923 17:18:35.244091 1732 raft_consensus.cc:374] T 00000000000000000000000000000000 P 217d8f2f2cb64e07aa82121c8ee7503e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:18:35.244123 1732 raft_consensus.cc:729] T 00000000000000000000000000000000 P 217d8f2f2cb64e07aa82121c8ee7503e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 217d8f2f2cb64e07aa82121c8ee7503e, State: Initialized, Role: FOLLOWER
I20260923 17:18:35.244578 1732 consensus_queue.cc:260] T 00000000000000000000000000000000 P 217d8f2f2cb64e07aa82121c8ee7503e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "217d8f2f2cb64e07aa82121c8ee7503e" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 41355 } }
I20260923 17:18:35.244730 1732 raft_consensus.cc:388] T 00000000000000000000000000000000 P 217d8f2f2cb64e07aa82121c8ee7503e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:18:35.244822 1732 raft_consensus.cc:482] T 00000000000000000000000000000000 P 217d8f2f2cb64e07aa82121c8ee7503e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:18:35.244933 1732 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 217d8f2f2cb64e07aa82121c8ee7503e [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:18:35.245836 1732 raft_consensus.cc:504] T 00000000000000000000000000000000 P 217d8f2f2cb64e07aa82121c8ee7503e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "217d8f2f2cb64e07aa82121c8ee7503e" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 41355 } }
I20260923 17:18:35.246167 1732 leader_election.cc:302] T 00000000000000000000000000000000 P 217d8f2f2cb64e07aa82121c8ee7503e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 217d8f2f2cb64e07aa82121c8ee7503e; no voters:
I20260923 17:18:35.246543 1732 leader_election.cc:288] T 00000000000000000000000000000000 P 217d8f2f2cb64e07aa82121c8ee7503e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 17:18:35.246611 1737 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 217d8f2f2cb64e07aa82121c8ee7503e [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:18:35.246865 1737 raft_consensus.cc:686] T 00000000000000000000000000000000 P 217d8f2f2cb64e07aa82121c8ee7503e [term 1 LEADER]: Becoming Leader. State: Replica: 217d8f2f2cb64e07aa82121c8ee7503e, State: Running, Role: LEADER
I20260923 17:18:35.247215 1737 consensus_queue.cc:237] T 00000000000000000000000000000000 P 217d8f2f2cb64e07aa82121c8ee7503e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "217d8f2f2cb64e07aa82121c8ee7503e" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 41355 } }
I20260923 17:18:35.247887 1732 sys_catalog.cc:564] T 00000000000000000000000000000000 P 217d8f2f2cb64e07aa82121c8ee7503e [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:18:35.247898 1735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:35.233744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33755 (local address 127.11.229.190:41355)
0923 17:18:35.234329 (+ 585us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:35.234347 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:35.234386 (+ 39us) server_negotiation.cc:407] Connection header received
0923 17:18:35.235277 (+ 891us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:35.235296 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:35.235644 (+ 348us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:35.236000 (+ 356us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:35.236830 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:35.237888 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:35.239064 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:35.239530 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:35.239710 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:35.242645 (+ 2935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:35.242650 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:35.242663 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:35.242690 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:35.244603 (+ 1913us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:35.245127 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:35.245133 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:35.245145 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:35.245253 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:35.245547 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:35.245550 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:35.245552 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:35.245992 (+ 440us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:35.246204 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:35.246482 (+ 278us) server_negotiation.cc:299] Negotiation successful
0923 17:18:35.246979 (+ 497us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":143,"threads_started":1}
I20260923 17:18:35.249704 1739 sys_catalog.cc:455] T 00000000000000000000000000000000 P 217d8f2f2cb64e07aa82121c8ee7503e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 217d8f2f2cb64e07aa82121c8ee7503e. Latest consensus state: current_term: 1 leader_uuid: "217d8f2f2cb64e07aa82121c8ee7503e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "217d8f2f2cb64e07aa82121c8ee7503e" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 41355 } } }
I20260923 17:18:35.249819 1739 sys_catalog.cc:458] T 00000000000000000000000000000000 P 217d8f2f2cb64e07aa82121c8ee7503e [sys.catalog]: This master's current role is: LEADER
I20260923 17:18:35.250044 1738 sys_catalog.cc:455] T 00000000000000000000000000000000 P 217d8f2f2cb64e07aa82121c8ee7503e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "217d8f2f2cb64e07aa82121c8ee7503e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "217d8f2f2cb64e07aa82121c8ee7503e" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 41355 } } }
I20260923 17:18:35.250141 1738 sys_catalog.cc:458] T 00000000000000000000000000000000 P 217d8f2f2cb64e07aa82121c8ee7503e [sys.catalog]: This master's current role is: LEADER
I20260923 17:18:35.250371 1746 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:18:35.250792 12182 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 17:18:35.253561 1746 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:18:35.260177 1746 catalog_manager.cc:1347] Generated new cluster ID: 0c490ca07c114fde9547062c5467fac0
I20260923 17:18:35.260236 1746 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:18:35.261777 1735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:35.252854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48107 (local address 127.11.229.190:41355)
0923 17:18:35.252960 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:35.252964 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:35.253347 (+ 383us) server_negotiation.cc:407] Connection header received
0923 17:18:35.253473 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:35.253476 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:35.253517 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:35.253619 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:35.254541 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:35.255091 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:35.255964 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:35.256277 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:35.256350 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:35.258019 (+ 1669us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:35.258023 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:35.258026 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:35.258051 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:35.260055 (+ 2004us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:35.260547 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:35.260550 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:35.260552 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:35.260649 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:35.260952 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:35.260956 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:35.260957 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:35.261146 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:35.261262 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:35.261528 (+ 266us) server_negotiation.cc:299] Negotiation successful
0923 17:18:35.261639 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260923 17:18:35.279790 1746 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:18:35.281097 1746 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:18:35.296794 1746 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 217d8f2f2cb64e07aa82121c8ee7503e: Generated new TSK 0
I20260923 17:18:35.297695 1746 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 17:18:35.308020 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 1664
2026-09-23T17:18:35Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1480 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790183633736342-12182-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 17:18:35 dist-test-slave-1x1f krb5kdc[1763](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 17:18:35 dist-test-slave-1x1f krb5kdc[1763](info): set up 2 sockets
Sep 23 17:18:35 dist-test-slave-1x1f krb5kdc[1763](info): commencing operation
krb5kdc: starting...
W20260923 17:18:36.399168 12182 mini_kdc.cc:121] Time spent starting KDC: real 1.070s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Sep 23 17:18:36 dist-test-slave-1x1f krb5kdc[1763](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183916, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T17:18:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:18:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.229.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
I20260923 17:18:36.530021 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:43401
--webserver_interface=127.11.229.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:36933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:43401
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:18:36.640995 1776 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:18:36.641346 1776 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:18:36.641435 1776 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:18:36.645623 1776 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:18:36.645746 1776 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:18:36.645787 1776 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:18:36.645823 1776 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:18:36.645854 1776 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:18:36.651298 1776 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:36933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:43401
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:43401
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.229.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1776
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:18:36.652417 1776 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:18:36.653463 1776 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:18:36.662523 1781 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:36.662523 1782 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:36.662544 1784 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:36.663169 1776 server_base.cc:1034] running on GCE node
I20260923 17:18:36.663856 1776 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:18:36.664933 1776 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:18:36.666100 1776 hybrid_clock.cc:648] HybridClock initialized: now 1790183916666089 us; error 26 us; skew 500 ppm
Sep 23 17:18:36 dist-test-slave-1x1f krb5kdc[1763](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183916, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:18:36.674966 1776 init.cc:377] Logged in from keytab as kudu/127.11.229.190@KRBTEST.COM (short username kudu)
I20260923 17:18:36.675961 1776 webserver.cc:460] Webserver started at http://127.11.229.190:40975/ using document root <none> and password file <none>
I20260923 17:18:36.676501 1776 fs_manager.cc:359] Metadata directory not provided
I20260923 17:18:36.676563 1776 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:18:36.676728 1776 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:18:36.678845 1776 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "6e7ed5e95f7f44e09b9ffd234db4e6d1"
format_stamp: "Formatted at 2026-09-23 17:18:36 on dist-test-slave-1x1f"
server_key: "49fc33daa1a3c23a3b8925d148e6a909"
server_key_iv: "00e90b86863199b7ef62f2a94d5f80e4"
server_key_version: "encryptionkey@0"
I20260923 17:18:36.679390 1776 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "6e7ed5e95f7f44e09b9ffd234db4e6d1"
format_stamp: "Formatted at 2026-09-23 17:18:36 on dist-test-slave-1x1f"
server_key: "49fc33daa1a3c23a3b8925d148e6a909"
server_key_iv: "00e90b86863199b7ef62f2a94d5f80e4"
server_key_version: "encryptionkey@0"
I20260923 17:18:36.683135 1776 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260923 17:18:36.685456 1791 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:36.686839 1776 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 17:18:36.686978 1776 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "6e7ed5e95f7f44e09b9ffd234db4e6d1"
format_stamp: "Formatted at 2026-09-23 17:18:36 on dist-test-slave-1x1f"
server_key: "49fc33daa1a3c23a3b8925d148e6a909"
server_key_iv: "00e90b86863199b7ef62f2a94d5f80e4"
server_key_version: "encryptionkey@0"
I20260923 17:18:36.687111 1776 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:18:36.725690 1776 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:18:36.729156 1776 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:18:36.729370 1776 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:18:36.736696 1776 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.190:43401
I20260923 17:18:36.736756 1843 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.190:43401 every 8 connection(s)
I20260923 17:18:36.737733 1776 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:18:36.740557 1844 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:18:36.746686 1844 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e7ed5e95f7f44e09b9ffd234db4e6d1: Bootstrap starting.
I20260923 17:18:36.747180 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 1776
I20260923 17:18:36.747318 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:18:36.747629 12182 external_mini_cluster.cc:1428] Setting key 63d619f08b89e81011a30ffb62cc8323
I20260923 17:18:36.749716 1844 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6e7ed5e95f7f44e09b9ffd234db4e6d1: Neither blocks nor log segments found. Creating new log.
I20260923 17:18:36.750613 1844 log.cc:824] T 00000000000000000000000000000000 P 6e7ed5e95f7f44e09b9ffd234db4e6d1: Log is configured to *not* fsync() on all Append() calls
I20260923 17:18:36.752466 1844 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e7ed5e95f7f44e09b9ffd234db4e6d1: No bootstrap required, opened a new log
I20260923 17:18:36.756044 1844 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6e7ed5e95f7f44e09b9ffd234db4e6d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e7ed5e95f7f44e09b9ffd234db4e6d1" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43401 } }
I20260923 17:18:36.756292 1844 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6e7ed5e95f7f44e09b9ffd234db4e6d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:18:36.756371 1844 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6e7ed5e95f7f44e09b9ffd234db4e6d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e7ed5e95f7f44e09b9ffd234db4e6d1, State: Initialized, Role: FOLLOWER
I20260923 17:18:36.756484 1847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:36.748959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57145 (local address 127.11.229.190:43401)
0923 17:18:36.749384 (+ 425us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:36.749400 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:36.749434 (+ 34us) server_negotiation.cc:407] Connection header received
0923 17:18:36.750122 (+ 688us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:36.750139 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:36.750543 (+ 404us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:36.750881 (+ 338us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:36.751290 (+ 409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:36.752261 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:36.753201 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:36.753661 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:36.753835 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:36.754765 (+ 930us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:36.754770 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:36.754783 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:18:36.755165 (+ 382us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:36.755219 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:18:36.755242 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:36.755358 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:36.755470 (+ 112us) server_negotiation.cc:299] Negotiation successful
0923 17:18:36.755681 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":281,"thread_start_us":150,"threads_started":1}
I20260923 17:18:36.756954 1844 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6e7ed5e95f7f44e09b9ffd234db4e6d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e7ed5e95f7f44e09b9ffd234db4e6d1" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43401 } }
I20260923 17:18:36.757140 1844 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6e7ed5e95f7f44e09b9ffd234db4e6d1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:18:36.757200 1844 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6e7ed5e95f7f44e09b9ffd234db4e6d1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:18:36.757283 1844 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6e7ed5e95f7f44e09b9ffd234db4e6d1 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:18:36.758383 1844 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6e7ed5e95f7f44e09b9ffd234db4e6d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e7ed5e95f7f44e09b9ffd234db4e6d1" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43401 } }
I20260923 17:18:36.758771 1844 leader_election.cc:302] T 00000000000000000000000000000000 P 6e7ed5e95f7f44e09b9ffd234db4e6d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6e7ed5e95f7f44e09b9ffd234db4e6d1; no voters:
I20260923 17:18:36.759138 1844 leader_election.cc:288] T 00000000000000000000000000000000 P 6e7ed5e95f7f44e09b9ffd234db4e6d1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 17:18:36.759224 1849 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6e7ed5e95f7f44e09b9ffd234db4e6d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:18:36.759392 1849 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6e7ed5e95f7f44e09b9ffd234db4e6d1 [term 1 LEADER]: Becoming Leader. State: Replica: 6e7ed5e95f7f44e09b9ffd234db4e6d1, State: Running, Role: LEADER
I20260923 17:18:36.759713 1849 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6e7ed5e95f7f44e09b9ffd234db4e6d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e7ed5e95f7f44e09b9ffd234db4e6d1" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43401 } }
I20260923 17:18:36.759881 12182 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 17:18:36.760426 1844 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6e7ed5e95f7f44e09b9ffd234db4e6d1 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:18:36.760900 1850 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e7ed5e95f7f44e09b9ffd234db4e6d1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6e7ed5e95f7f44e09b9ffd234db4e6d1. Latest consensus state: current_term: 1 leader_uuid: "6e7ed5e95f7f44e09b9ffd234db4e6d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e7ed5e95f7f44e09b9ffd234db4e6d1" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43401 } } }
I20260923 17:18:36.761030 1850 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e7ed5e95f7f44e09b9ffd234db4e6d1 [sys.catalog]: This master's current role is: LEADER
I20260923 17:18:36.761447 1851 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e7ed5e95f7f44e09b9ffd234db4e6d1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6e7ed5e95f7f44e09b9ffd234db4e6d1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e7ed5e95f7f44e09b9ffd234db4e6d1" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43401 } } }
I20260923 17:18:36.761566 1851 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e7ed5e95f7f44e09b9ffd234db4e6d1 [sys.catalog]: This master's current role is: LEADER
I20260923 17:18:36.761931 1855 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:18:36.765311 1855 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:18:36.769857 1847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:36.763232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38423 (local address 127.11.229.190:43401)
0923 17:18:36.763370 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:36.763375 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:36.763619 (+ 244us) server_negotiation.cc:407] Connection header received
0923 17:18:36.763739 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:36.763742 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:36.763790 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:36.763874 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:36.764216 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:36.764744 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:36.766116 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:36.766694 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:36.767099 (+ 405us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:36.769399 (+ 2300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:36.769403 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:36.769406 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:18:36.769420 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:36.769453 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:18:36.769465 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:36.769547 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:36.769640 (+ 93us) server_negotiation.cc:299] Negotiation successful
0923 17:18:36.769699 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260923 17:18:36.771483 1855 catalog_manager.cc:1347] Generated new cluster ID: adc2953b183d4956823bacbb9b423a47
I20260923 17:18:36.771577 1855 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:18:36.785496 1855 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:18:36.786835 1855 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:18:36.794983 1855 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6e7ed5e95f7f44e09b9ffd234db4e6d1: Generated new TSK 0
I20260923 17:18:36.795794 1855 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 17:18:36.802451 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 1776
2026-09-23T17:18:36Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1493 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790183633736342-12182-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 17:18:36 dist-test-slave-1x1f krb5kdc[1875](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 17:18:36 dist-test-slave-1x1f krb5kdc[1875](info): set up 2 sockets
Sep 23 17:18:36 dist-test-slave-1x1f krb5kdc[1875](info): commencing operation
krb5kdc: starting...
W20260923 17:18:37.879443 12182 mini_kdc.cc:121] Time spent starting KDC: real 1.057s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Sep 23 17:18:37 dist-test-slave-1x1f krb5kdc[1875](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183917, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T17:18:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:18:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.229.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
I20260923 17:18:38.014835 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:33035
--webserver_interface=127.11.229.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:39941
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:33035
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:18:38.131592 1888 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:18:38.131865 1888 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:18:38.131907 1888 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:18:38.136042 1888 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:18:38.136111 1888 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:18:38.136129 1888 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:18:38.136147 1888 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:18:38.136162 1888 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:18:38.141717 1888 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:39941
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:33035
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:33035
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.229.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1888
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:18:38.142895 1888 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:18:38.143913 1888 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:18:38.153118 1894 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:38.153103 1893 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:38.153097 1888 server_base.cc:1034] running on GCE node
W20260923 17:18:38.153090 1896 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:38.153865 1888 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:18:38.155066 1888 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:18:38.156313 1888 hybrid_clock.cc:648] HybridClock initialized: now 1790183918156285 us; error 42 us; skew 500 ppm
Sep 23 17:18:38 dist-test-slave-1x1f krb5kdc[1875](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183918, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:18:38.159262 1888 init.cc:377] Logged in from keytab as kudu/127.11.229.190@KRBTEST.COM (short username kudu)
I20260923 17:18:38.160214 1888 webserver.cc:460] Webserver started at http://127.11.229.190:42381/ using document root <none> and password file <none>
I20260923 17:18:38.160835 1888 fs_manager.cc:359] Metadata directory not provided
I20260923 17:18:38.160938 1888 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:18:38.161177 1888 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:18:38.163367 1888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "b611fce7e02345b0bb59ca6c230477f3"
format_stamp: "Formatted at 2026-09-23 17:18:38 on dist-test-slave-1x1f"
server_key: "2054eb95a6ac9da61ff9eadd7860ff42"
server_key_iv: "74e30e6e6ecf854668a457911cc14962"
server_key_version: "encryptionkey@0"
I20260923 17:18:38.163952 1888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "b611fce7e02345b0bb59ca6c230477f3"
format_stamp: "Formatted at 2026-09-23 17:18:38 on dist-test-slave-1x1f"
server_key: "2054eb95a6ac9da61ff9eadd7860ff42"
server_key_iv: "74e30e6e6ecf854668a457911cc14962"
server_key_version: "encryptionkey@0"
I20260923 17:18:38.167868 1888 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260923 17:18:38.170470 1903 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:38.171859 1888 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 17:18:38.172009 1888 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "b611fce7e02345b0bb59ca6c230477f3"
format_stamp: "Formatted at 2026-09-23 17:18:38 on dist-test-slave-1x1f"
server_key: "2054eb95a6ac9da61ff9eadd7860ff42"
server_key_iv: "74e30e6e6ecf854668a457911cc14962"
server_key_version: "encryptionkey@0"
I20260923 17:18:38.172135 1888 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:18:38.176780 1888 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:18:38.181157 1888 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:18:38.181332 1888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:18:38.189059 1888 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.190:33035
I20260923 17:18:38.189106 1955 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.190:33035 every 8 connection(s)
I20260923 17:18:38.190048 1888 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:18:38.191517 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 1888
I20260923 17:18:38.191679 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:18:38.192013 12182 external_mini_cluster.cc:1428] Setting key 0a7ec1bf8c86b78c35d3c0f7524ad568
I20260923 17:18:38.194898 1956 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:18:38.199038 1959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:38.193772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51809 (local address 127.11.229.190:33035)
0923 17:18:38.194597 (+ 825us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:38.194624 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:38.194671 (+ 47us) server_negotiation.cc:407] Connection header received
0923 17:18:38.195545 (+ 874us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:38.195570 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:38.195939 (+ 369us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:38.196336 (+ 397us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:38.197459 (+ 1123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:38.197465 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:38.197482 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:18:38.197504 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:38.197573 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:18:38.197602 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:38.197755 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:38.197881 (+ 126us) server_negotiation.cc:299] Negotiation successful
0923 17:18:38.198042 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":614,"thread_start_us":188,"threads_started":1}
I20260923 17:18:38.201717 1956 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b611fce7e02345b0bb59ca6c230477f3: Bootstrap starting.
I20260923 17:18:38.202178 12182 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 17:18:38.204556 1956 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b611fce7e02345b0bb59ca6c230477f3: Neither blocks nor log segments found. Creating new log.
I20260923 17:18:38.205562 1956 log.cc:824] T 00000000000000000000000000000000 P b611fce7e02345b0bb59ca6c230477f3: Log is configured to *not* fsync() on all Append() calls
I20260923 17:18:38.206753 1959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:38.204737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41747 (local address 127.11.229.190:33035)
0923 17:18:38.204901 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:38.204907 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:38.205083 (+ 176us) server_negotiation.cc:407] Connection header received
0923 17:18:38.205237 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:38.205240 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:38.205277 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:38.205377 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:38.206304 (+ 927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:38.206308 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:38.206311 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0923 17:18:38.206324 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:38.206360 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0923 17:18:38.206372 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:38.206480 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:38.206573 (+ 93us) server_negotiation.cc:299] Negotiation successful
0923 17:18:38.206619 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260923 17:18:38.207703 1956 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b611fce7e02345b0bb59ca6c230477f3: No bootstrap required, opened a new log
I20260923 17:18:38.211746 1956 raft_consensus.cc:348] T 00000000000000000000000000000000 P b611fce7e02345b0bb59ca6c230477f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b611fce7e02345b0bb59ca6c230477f3" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33035 } }
I20260923 17:18:38.212049 1956 raft_consensus.cc:374] T 00000000000000000000000000000000 P b611fce7e02345b0bb59ca6c230477f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260923 17:18:38.212113 1956 raft_consensus.cc:729] T 00000000000000000000000000000000 P b611fce7e02345b0bb59ca6c230477f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b611fce7e02345b0bb59ca6c230477f3, State: Initialized, Role: FOLLOWER
I20260923 17:18:38.212627 1956 consensus_queue.cc:260] T 00000000000000000000000000000000 P b611fce7e02345b0bb59ca6c230477f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b611fce7e02345b0bb59ca6c230477f3" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33035 } }
I20260923 17:18:38.212769 1956 raft_consensus.cc:388] T 00000000000000000000000000000000 P b611fce7e02345b0bb59ca6c230477f3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260923 17:18:38.212860 1956 raft_consensus.cc:482] T 00000000000000000000000000000000 P b611fce7e02345b0bb59ca6c230477f3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260923 17:18:38.212970 1956 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b611fce7e02345b0bb59ca6c230477f3 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:18:38.213959 1956 raft_consensus.cc:504] T 00000000000000000000000000000000 P b611fce7e02345b0bb59ca6c230477f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b611fce7e02345b0bb59ca6c230477f3" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33035 } }
I20260923 17:18:38.214353 1956 leader_election.cc:302] T 00000000000000000000000000000000 P b611fce7e02345b0bb59ca6c230477f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b611fce7e02345b0bb59ca6c230477f3; no voters:
I20260923 17:18:38.214643 1956 leader_election.cc:288] T 00000000000000000000000000000000 P b611fce7e02345b0bb59ca6c230477f3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260923 17:18:38.214757 1966 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b611fce7e02345b0bb59ca6c230477f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:18:38.214982 1966 raft_consensus.cc:686] T 00000000000000000000000000000000 P b611fce7e02345b0bb59ca6c230477f3 [term 1 LEADER]: Becoming Leader. State: Replica: b611fce7e02345b0bb59ca6c230477f3, State: Running, Role: LEADER
I20260923 17:18:38.215406 1966 consensus_queue.cc:237] T 00000000000000000000000000000000 P b611fce7e02345b0bb59ca6c230477f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b611fce7e02345b0bb59ca6c230477f3" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33035 } }
I20260923 17:18:38.215939 1956 sys_catalog.cc:564] T 00000000000000000000000000000000 P b611fce7e02345b0bb59ca6c230477f3 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:18:38.217100 1967 sys_catalog.cc:455] T 00000000000000000000000000000000 P b611fce7e02345b0bb59ca6c230477f3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b611fce7e02345b0bb59ca6c230477f3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b611fce7e02345b0bb59ca6c230477f3" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33035 } } }
I20260923 17:18:38.217253 1967 sys_catalog.cc:458] T 00000000000000000000000000000000 P b611fce7e02345b0bb59ca6c230477f3 [sys.catalog]: This master's current role is: LEADER
I20260923 17:18:38.217636 1975 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:18:38.218088 1968 sys_catalog.cc:455] T 00000000000000000000000000000000 P b611fce7e02345b0bb59ca6c230477f3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b611fce7e02345b0bb59ca6c230477f3. Latest consensus state: current_term: 1 leader_uuid: "b611fce7e02345b0bb59ca6c230477f3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b611fce7e02345b0bb59ca6c230477f3" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 33035 } } }
I20260923 17:18:38.218279 1968 sys_catalog.cc:458] T 00000000000000000000000000000000 P b611fce7e02345b0bb59ca6c230477f3 [sys.catalog]: This master's current role is: LEADER
I20260923 17:18:38.220885 1975 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:18:38.227512 1975 catalog_manager.cc:1347] Generated new cluster ID: d8799d0f42b34494a13abe94f99dc8a7
I20260923 17:18:38.227620 1975 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:18:38.263610 1975 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:18:38.264019 1975 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:18:38.271891 1975 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b611fce7e02345b0bb59ca6c230477f3: Generated new TSK 0
I20260923 17:18:38.272722 1975 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260923 17:18:38.278193 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 1888
2026-09-23T17:18:38Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1476 ms)
[----------] 18 tests from AuthTokenIssuingTest (26347 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 17:18:38 dist-test-slave-1x1f krb5kdc[1987](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 17:18:38 dist-test-slave-1x1f krb5kdc[1987](info): set up 2 sockets
Sep 23 17:18:38 dist-test-slave-1x1f krb5kdc[1987](info): commencing operation
krb5kdc: starting...
W20260923 17:18:39.395084 12182 mini_kdc.cc:121] Time spent starting KDC: real 1.096s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Sep 23 17:18:39 dist-test-slave-1x1f krb5kdc[1987](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183919, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T17:18:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:18:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.229.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
I20260923 17:18:39.526495 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:46377
--webserver_interface=127.11.229.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:37671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:46377,127.11.229.189:37007,127.11.229.188:42327
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:18:39.641762 2000 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260923 17:18:39.642052 2000 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:18:39.642076 2000 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:18:39.642122 2000 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:18:39.646131 2000 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:18:39.646193 2000 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:18:39.646212 2000 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:18:39.646286 2000 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:18:39.646314 2000 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:18:39.651854 2000 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:37671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:46377,127.11.229.189:37007,127.11.229.188:42327
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:46377
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.229.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2000
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:18:39.652866 2000 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:18:39.653822 2000 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:18:39.662439 2005 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:39.662405 2008 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:39.662408 2006 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:39.662689 2000 server_base.cc:1034] running on GCE node
I20260923 17:18:39.663276 2000 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:18:39.664393 2000 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:18:39.665565 2000 hybrid_clock.cc:648] HybridClock initialized: now 1790183919665532 us; error 46 us; skew 500 ppm
Sep 23 17:18:39 dist-test-slave-1x1f krb5kdc[1987](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183919, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:18:39.668465 2000 init.cc:377] Logged in from keytab as kudu/127.11.229.190@KRBTEST.COM (short username kudu)
I20260923 17:18:39.669406 2000 webserver.cc:460] Webserver started at http://127.11.229.190:36147/ using document root <none> and password file <none>
I20260923 17:18:39.669972 2000 fs_manager.cc:359] Metadata directory not provided
I20260923 17:18:39.670063 2000 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:18:39.670351 2000 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:18:39.672544 2000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "95952d9755eb4eecb26f3c5ec979a337"
format_stamp: "Formatted at 2026-09-23 17:18:39 on dist-test-slave-1x1f"
server_key: "f8ab118cbccc630837483e3b41b22e37"
server_key_iv: "484f1a5dc537ecac99e4259038380f88"
server_key_version: "encryptionkey@0"
I20260923 17:18:39.673101 2000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "95952d9755eb4eecb26f3c5ec979a337"
format_stamp: "Formatted at 2026-09-23 17:18:39 on dist-test-slave-1x1f"
server_key: "f8ab118cbccc630837483e3b41b22e37"
server_key_iv: "484f1a5dc537ecac99e4259038380f88"
server_key_version: "encryptionkey@0"
I20260923 17:18:39.676930 2000 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260923 17:18:39.679378 2015 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:39.680591 2000 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260923 17:18:39.680753 2000 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "95952d9755eb4eecb26f3c5ec979a337"
format_stamp: "Formatted at 2026-09-23 17:18:39 on dist-test-slave-1x1f"
server_key: "f8ab118cbccc630837483e3b41b22e37"
server_key_iv: "484f1a5dc537ecac99e4259038380f88"
server_key_version: "encryptionkey@0"
I20260923 17:18:39.680869 2000 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:18:39.703187 2000 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:18:39.706571 2000 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:18:39.706810 2000 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:18:39.713673 2000 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.190:46377
I20260923 17:18:39.713968 2067 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.190:46377 every 8 connection(s)
I20260923 17:18:39.714751 2000 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:18:39.717641 2068 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:18:39.721355 2068 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.229.190" port: 46377 } has no permanent_uuid. Determining permanent_uuid...
I20260923 17:18:39.725061 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 2000
I20260923 17:18:39.725193 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:18:39.725499 12182 external_mini_cluster.cc:1428] Setting key d2813ba696e649221d6214116b98041d
Sep 23 17:18:39 dist-test-slave-1x1f krb5kdc[1987](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183919, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.229.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.189@KRBTEST.COM" created.
I20260923 17:18:39.739305 2070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:39.723664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:46377 (local address 127.0.0.1:56074)
0923 17:18:39.724155 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:39.724194 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:39.725155 (+ 961us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:39.725919 (+ 764us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:39.725927 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:39.726459 (+ 532us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:18:39.726851 (+ 392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:39.726871 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:39.728854 (+ 1983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:39.728857 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:39.729615 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:39.729624 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:39.730714 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:39.730717 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:39.730895 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:39.731574 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:18:39.731590 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:18:39.733084 (+ 1494us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:18:39.735633 (+ 2549us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:39.735646 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:39.735660 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:39.736104 (+ 444us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:39.736582 (+ 478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:39.736588 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:39.736593 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:39.736781 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:39.737642 (+ 861us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:18:39.737649 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:18:39.737833 (+ 184us) client_negotiation.cc:769] Sending connection context
0923 17:18:39.738030 (+ 197us) client_negotiation.cc:240] Negotiation successful
0923 17:18:39.738531 (+ 501us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"mutex_wait_us":156,"thread_start_us":111,"threads_started":1}
I20260923 17:18:39.739310 2071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:39.723664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56074 (local address 127.11.229.190:46377)
0923 17:18:39.724122 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:39.724139 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:39.724298 (+ 159us) server_negotiation.cc:407] Connection header received
0923 17:18:39.725481 (+ 1183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:39.725486 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:39.725714 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:39.725858 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:39.727054 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:39.728705 (+ 1651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:39.729748 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:39.730519 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:39.730725 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:39.733251 (+ 2526us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:39.733258 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:39.733274 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:39.733304 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:39.735474 (+ 2170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:39.736288 (+ 814us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:39.736292 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:39.736294 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:39.736406 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:39.736905 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:39.736908 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:39.736910 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:39.737493 (+ 583us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:39.737648 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:39.738161 (+ 513us) server_negotiation.cc:299] Negotiation successful
0923 17:18:39.738422 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":335,"spinlock_wait_cycles":33024,"thread_start_us":176,"threads_started":1}
I20260923 17:18:39.742085 2068 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.229.189" port: 37007 } has no permanent_uuid. Determining permanent_uuid...
I20260923 17:18:39.742938 2070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:39.742673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.189:37007 (local address 127.0.0.1:50318)
0923 17:18:39.742801 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:39.742879 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.189:37007: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260923 17:18:39.743230 2016 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.229.189:37007: connect: Connection refused (error 111)
I20260923 17:18:39.744216 2070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:39.743964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.189:37007 (local address 127.0.0.1:50332)
0923 17:18:39.744113 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:39.744166 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.189:37007: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
W20260923 17:18:39.744427 2068 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.229.189:37007: Network error: Client connection negotiation failed: client connection to 127.11.229.189:37007: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.189.keytab.
Entry for principal kudu/127.11.229.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.189.keytab.
I20260923 17:18:39.758211 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.189:37007
--webserver_interface=127.11.229.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.189.keytab
--principal=kudu/127.11.229.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:37671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:46377,127.11.229.189:37007,127.11.229.188:42327
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 17:18:39.793721 2068 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.229.189" port: 37007 } attempt: 1
I20260923 17:18:39.794764 2070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:39.794440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.189:37007 (local address 127.0.0.1:50348)
0923 17:18:39.794606 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:39.794674 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.189:37007: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260923 17:18:39.795666 2070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:39.795400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.189:37007 (local address 127.0.0.1:50354)
0923 17:18:39.795537 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:39.795596 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.189:37007: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
W20260923 17:18:39.795837 2068 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.229.189:37007: Network error: Client connection negotiation failed: client connection to 127.11.229.189:37007: connect: Connection refused (error 111)
I20260923 17:18:39.864037 2068 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.229.189" port: 37007 } attempt: 2
I20260923 17:18:39.864933 2070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:39.864627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.189:37007 (local address 127.0.0.1:50366)
0923 17:18:39.864780 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:39.864856 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.189:37007: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260923 17:18:39.865736 2070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:39.865514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.189:37007 (local address 127.0.0.1:50382)
0923 17:18:39.865629 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:39.865673 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.189:37007: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260923 17:18:39.865885 2068 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.229.189:37007: Network error: Client connection negotiation failed: client connection to 127.11.229.189:37007: connect: Connection refused (error 111)
W20260923 17:18:39.878753 2075 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260923 17:18:39.879029 2075 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:18:39.879096 2075 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:18:39.879172 2075 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:18:39.883183 2075 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:18:39.883239 2075 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:18:39.883258 2075 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:18:39.883276 2075 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:18:39.883291 2075 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:18:39.888972 2075 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:37671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:46377,127.11.229.189:37007,127.11.229.188:42327
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.189.keytab
--principal=kudu/127.11.229.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.189:37007
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.229.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2075
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:18:39.890062 2075 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:18:39.891090 2075 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:18:39.899897 2083 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:39.899896 2081 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:39.899951 2080 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:39.900354 2075 server_base.cc:1034] running on GCE node
I20260923 17:18:39.901039 2075 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:18:39.902324 2075 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:18:39.903515 2075 hybrid_clock.cc:648] HybridClock initialized: now 1790183919903496 us; error 33 us; skew 500 ppm
Sep 23 17:18:39 dist-test-slave-1x1f krb5kdc[1987](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183919, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:18:39.906450 2075 init.cc:377] Logged in from keytab as kudu/127.11.229.189@KRBTEST.COM (short username kudu)
I20260923 17:18:39.907390 2075 webserver.cc:460] Webserver started at http://127.11.229.189:40947/ using document root <none> and password file <none>
I20260923 17:18:39.907955 2075 fs_manager.cc:359] Metadata directory not provided
I20260923 17:18:39.908049 2075 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:18:39.908299 2075 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:18:39.910519 2075 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/minicluster-data/master-1/data/instance:
uuid: "6586a1c966954b849d2974547167c1cb"
format_stamp: "Formatted at 2026-09-23 17:18:39 on dist-test-slave-1x1f"
server_key: "77daa3c7a692f0a17ec68b313dda989b"
server_key_iv: "fe5e7fd94789bfd537d87cd63ab3cb0a"
server_key_version: "encryptionkey@0"
I20260923 17:18:39.911120 2075 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/minicluster-data/master-1/wal/instance:
uuid: "6586a1c966954b849d2974547167c1cb"
format_stamp: "Formatted at 2026-09-23 17:18:39 on dist-test-slave-1x1f"
server_key: "77daa3c7a692f0a17ec68b313dda989b"
server_key_iv: "fe5e7fd94789bfd537d87cd63ab3cb0a"
server_key_version: "encryptionkey@0"
I20260923 17:18:39.915112 2075 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260923 17:18:39.917663 2090 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:39.919859 2075 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260923 17:18:39.920130 2075 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/minicluster-data/master-1/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/minicluster-data/master-1/wal
uuid: "6586a1c966954b849d2974547167c1cb"
format_stamp: "Formatted at 2026-09-23 17:18:39 on dist-test-slave-1x1f"
server_key: "77daa3c7a692f0a17ec68b313dda989b"
server_key_iv: "fe5e7fd94789bfd537d87cd63ab3cb0a"
server_key_version: "encryptionkey@0"
I20260923 17:18:39.920305 2075 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:18:39.938361 2075 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:18:39.941777 2075 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:18:39.941991 2075 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:18:39.949252 2075 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.189:37007
I20260923 17:18:39.949584 2142 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.189:37007 every 8 connection(s)
I20260923 17:18:39.950268 2075 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/minicluster-data/master-1/data/info.pb
I20260923 17:18:39.953063 2143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:18:39.955529 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 2075
I20260923 17:18:39.955814 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/minicluster-data/master-1/wal/instance
I20260923 17:18:39.956187 12182 external_mini_cluster.cc:1428] Setting key 5df089ed8cb8da8b54eca11b17f0b2b1
I20260923 17:18:39.957085 2068 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.229.189" port: 37007 } attempt: 3
I20260923 17:18:39.957131 2143 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.229.190" port: 46377 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 17:18:39 dist-test-slave-1x1f krb5kdc[1987](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183919, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for kudu/127.11.229.189@KRBTEST.COM
Sep 23 17:18:39 dist-test-slave-1x1f krb5kdc[1987](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183919, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.189@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.229.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.188@KRBTEST.COM" created.
I20260923 17:18:39.970726 2070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:39.957848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.189:37007 (local address 127.0.0.1:50386)
0923 17:18:39.958097 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:39.958162 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:39.958309 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:39.960525 (+ 2216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:39.960528 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:39.960754 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:18:39.960889 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:39.960897 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:39.962374 (+ 1477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:39.962379 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:39.963112 (+ 733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:39.963122 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:39.963852 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:39.963856 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:39.963956 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:39.964526 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:18:39.964539 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:18:39.965953 (+ 1414us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:18:39.968185 (+ 2232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:39.968188 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:39.968191 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:39.968463 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:39.968867 (+ 404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:39.968870 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:39.968871 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:39.968952 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:39.969915 (+ 963us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:18:39.969920 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:18:39.970102 (+ 182us) client_negotiation.cc:769] Sending connection context
0923 17:18:39.970259 (+ 157us) client_negotiation.cc:240] Negotiation successful
0923 17:18:39.970433 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"mutex_wait_us":25,"spinlock_wait_cycles":1280}
I20260923 17:18:39.971840 2146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:39.958578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50386 (local address 127.11.229.189:37007)
0923 17:18:39.959054 (+ 476us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:39.959072 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:39.959156 (+ 84us) server_negotiation.cc:407] Connection header received
0923 17:18:39.960035 (+ 879us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:39.960053 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:39.960307 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:39.960551 (+ 244us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:39.961011 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:39.962265 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:39.963237 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:39.963714 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:39.963896 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:39.966103 (+ 2207us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:39.966109 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:39.966120 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:39.966141 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:39.968029 (+ 1888us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:39.968597 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:39.968606 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:39.968613 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:39.968755 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:39.969091 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:39.969094 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:39.969096 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:39.969789 (+ 693us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:39.969933 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:39.970421 (+ 488us) server_negotiation.cc:299] Negotiation successful
0923 17:18:39.970752 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":330,"spinlock_wait_cycles":6400,"thread_start_us":131,"threads_started":1}
I20260923 17:18:39.971896 2071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:39.959384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56084 (local address 127.11.229.190:46377)
0923 17:18:39.959514 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:39.959520 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:39.959969 (+ 449us) server_negotiation.cc:407] Connection header received
0923 17:18:39.960576 (+ 607us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:39.960582 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:39.960644 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:39.960718 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:39.961858 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:39.962560 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:39.964055 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:39.964480 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:39.964571 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:39.967618 (+ 3047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:39.967624 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:39.967631 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:39.967653 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:39.969985 (+ 2332us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:39.970542 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:39.970545 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:39.970547 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:39.970645 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:39.970939 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:39.970942 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:39.970944 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:39.971146 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:39.971214 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:39.971633 (+ 419us) server_negotiation.cc:299] Negotiation successful
0923 17:18:39.971745 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":49,"spinlock_wait_cycles":3456}
I20260923 17:18:39.972584 2147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:39.959272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:46377 (local address 127.0.0.1:56084)
0923 17:18:39.959815 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:39.959870 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:39.960322 (+ 452us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:39.960917 (+ 595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:39.960925 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:39.961441 (+ 516us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:18:39.961688 (+ 247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:39.961705 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:39.962684 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:39.962687 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:39.963895 (+ 1208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:39.963910 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:39.964774 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:39.964779 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:39.964910 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:39.965514 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:18:39.965540 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:18:39.967463 (+ 1923us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:18:39.970079 (+ 2616us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:39.970086 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:39.970092 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:39.970428 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:39.970762 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:39.970765 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:39.970766 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:39.970843 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:39.971291 (+ 448us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:18:39.971296 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:18:39.971405 (+ 109us) client_negotiation.cc:769] Sending connection context
0923 17:18:39.972160 (+ 755us) client_negotiation.cc:240] Negotiation successful
0923 17:18:39.972373 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":128,"threads_started":1}
I20260923 17:18:39.974175 2143 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.229.189" port: 37007 } has no permanent_uuid. Determining permanent_uuid...
I20260923 17:18:39.974706 2068 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.229.188" port: 42327 } has no permanent_uuid. Determining permanent_uuid...
I20260923 17:18:39.975606 2070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:39.975267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:42327 (local address 127.0.0.1:47614)
0923 17:18:39.975450 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:39.975499 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.188:42327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119}
I20260923 17:18:39.976382 2070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:39.976122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:42327 (local address 127.0.0.1:47624)
0923 17:18:39.976271 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:39.976324 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.188:42327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
W20260923 17:18:39.976570 2068 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.229.188:42327: Network error: Client connection negotiation failed: client connection to 127.11.229.188:42327: connect: Connection refused (error 111)
Sep 23 17:18:39 dist-test-slave-1x1f krb5kdc[1987](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183919, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.189@KRBTEST.COM for kudu/127.11.229.189@KRBTEST.COM
I20260923 17:18:39.986735 2146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:39.975144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50394 (local address 127.11.229.189:37007)
0923 17:18:39.975347 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:39.975351 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:39.975426 (+ 75us) server_negotiation.cc:407] Connection header received
0923 17:18:39.975571 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:39.975575 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:39.975619 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:39.975828 (+ 209us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:39.976338 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:39.977134 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:39.978385 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:39.978659 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:39.978756 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:39.983117 (+ 4361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:39.983120 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:39.983122 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:39.983145 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:39.984830 (+ 1685us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:39.985321 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:39.985327 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:39.985329 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:39.985415 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:39.985739 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:39.985743 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:39.985745 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:39.985937 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:39.986073 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:39.986386 (+ 313us) server_negotiation.cc:299] Negotiation successful
0923 17:18:39.986541 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116}
I20260923 17:18:39.986766 2147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:39.974715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.189:37007 (local address 127.0.0.1:50394)
0923 17:18:39.975357 (+ 642us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:39.975374 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:39.975473 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:39.975862 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:39.975866 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:39.976077 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:18:39.976215 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:39.976227 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:39.977280 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:39.977283 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:39.978197 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:39.978207 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:39.978791 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:39.978797 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:39.978913 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:39.979439 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:18:39.979453 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:18:39.982939 (+ 3486us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:18:39.984997 (+ 2058us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:39.985000 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:39.985011 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:39.985216 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:39.985520 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:39.985523 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:39.985525 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:39.985614 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:39.986057 (+ 443us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:18:39.986060 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:18:39.986147 (+ 87us) client_negotiation.cc:769] Sending connection context
0923 17:18:39.986337 (+ 190us) client_negotiation.cc:240] Negotiation successful
0923 17:18:39.986620 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"mutex_wait_us":91}
I20260923 17:18:39.987658 2143 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.229.188" port: 42327 } has no permanent_uuid. Determining permanent_uuid...
I20260923 17:18:39.988410 2147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:39.988164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:42327 (local address 127.0.0.1:47638)
0923 17:18:39.988276 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:39.988354 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.188:42327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260923 17:18:39.989095 2091 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.229.188:42327: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.188.keytab.
Entry for principal kudu/127.11.229.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.188.keytab.
I20260923 17:18:39.990154 2147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:39.989940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:42327 (local address 127.0.0.1:47640)
0923 17:18:39.990055 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:39.990099 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.188:42327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260923 17:18:39.990358 2143 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.229.188:42327: Network error: Client connection negotiation failed: client connection to 127.11.229.188:42327: connect: Connection refused (error 111)
I20260923 17:18:39.990706 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.188:42327
--webserver_interface=127.11.229.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.188.keytab
--principal=kudu/127.11.229.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:37671
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:46377,127.11.229.189:37007,127.11.229.188:42327
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 17:18:40.007776 2068 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.229.188" port: 42327 } attempt: 1
I20260923 17:18:40.008675 2070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:40.008324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:42327 (local address 127.0.0.1:47654)
0923 17:18:40.008499 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:40.008573 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.188:42327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260923 17:18:40.009439 2070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:40.009214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:42327 (local address 127.0.0.1:47670)
0923 17:18:40.009327 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:40.009375 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.188:42327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260923 17:18:40.009655 2068 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.229.188:42327: Network error: Client connection negotiation failed: client connection to 127.11.229.188:42327: connect: Connection refused (error 111)
I20260923 17:18:40.039654 2143 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.229.188" port: 42327 } attempt: 1
I20260923 17:18:40.040587 2147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:40.040255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:42327 (local address 127.0.0.1:47674)
0923 17:18:40.040428 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:40.040500 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.188:42327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260923 17:18:40.041364 2147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:40.041149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:42327 (local address 127.0.0.1:47682)
0923 17:18:40.041254 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:40.041303 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.188:42327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260923 17:18:40.041512 2143 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.229.188:42327: Network error: Client connection negotiation failed: client connection to 127.11.229.188:42327: connect: Connection refused (error 111)
I20260923 17:18:40.084823 2068 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.229.188" port: 42327 } attempt: 2
I20260923 17:18:40.085822 2070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:40.085407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:42327 (local address 127.0.0.1:47692)
0923 17:18:40.085598 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:40.085722 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.188:42327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260923 17:18:40.086707 2070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:40.086446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:42327 (local address 127.0.0.1:47708)
0923 17:18:40.086583 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:40.086643 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.188:42327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260923 17:18:40.086966 2068 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.229.188:42327: Network error: Client connection negotiation failed: client connection to 127.11.229.188:42327: connect: Connection refused (error 111)
I20260923 17:18:40.109707 2143 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.229.188" port: 42327 } attempt: 2
I20260923 17:18:40.110685 2147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:40.110353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:42327 (local address 127.0.0.1:47720)
0923 17:18:40.110518 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:40.110589 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.188:42327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260923 17:18:40.111722 2147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:40.111413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:42327 (local address 127.0.0.1:47730)
0923 17:18:40.111565 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:40.111649 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.188:42327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
W20260923 17:18:40.111901 2143 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.229.188:42327: Network error: Client connection negotiation failed: client connection to 127.11.229.188:42327: connect: Connection refused (error 111)
W20260923 17:18:40.111943 2150 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260923 17:18:40.112355 2150 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:18:40.112411 2150 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:18:40.112522 2150 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:18:40.117550 2150 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:18:40.117619 2150 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:18:40.117640 2150 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:18:40.117659 2150 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:18:40.117710 2150 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:18:40.124032 2150 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:37671
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:46377,127.11.229.189:37007,127.11.229.188:42327
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.188.keytab
--principal=kudu/127.11.229.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.188:42327
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.229.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2150
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:18:40.125314 2150 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:18:40.126513 2150 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:18:40.135636 2156 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:40.135636 2158 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:40.135636 2155 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:40.135914 2150 server_base.cc:1034] running on GCE node
I20260923 17:18:40.136654 2150 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:18:40.137825 2150 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:18:40.139007 2150 hybrid_clock.cc:648] HybridClock initialized: now 1790183920138952 us; error 66 us; skew 500 ppm
Sep 23 17:18:40 dist-test-slave-1x1f krb5kdc[1987](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183920, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:18:40.143028 2150 init.cc:377] Logged in from keytab as kudu/127.11.229.188@KRBTEST.COM (short username kudu)
I20260923 17:18:40.144012 2150 webserver.cc:460] Webserver started at http://127.11.229.188:34217/ using document root <none> and password file <none>
I20260923 17:18:40.144586 2150 fs_manager.cc:359] Metadata directory not provided
I20260923 17:18:40.144657 2150 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:18:40.144876 2150 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:18:40.147521 2150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/minicluster-data/master-2/data/instance:
uuid: "151cc712441e407db5efed7abb479ebe"
format_stamp: "Formatted at 2026-09-23 17:18:40 on dist-test-slave-1x1f"
server_key: "3cdd45f3ae7a5c13181c567e37701006"
server_key_iv: "46c6f77f7fae460b11d81de37bcdfe5d"
server_key_version: "encryptionkey@0"
I20260923 17:18:40.148108 2150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/minicluster-data/master-2/wal/instance:
uuid: "151cc712441e407db5efed7abb479ebe"
format_stamp: "Formatted at 2026-09-23 17:18:40 on dist-test-slave-1x1f"
server_key: "3cdd45f3ae7a5c13181c567e37701006"
server_key_iv: "46c6f77f7fae460b11d81de37bcdfe5d"
server_key_version: "encryptionkey@0"
I20260923 17:18:40.152396 2150 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260923 17:18:40.154999 2165 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:40.156458 2150 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260923 17:18:40.156644 2150 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/minicluster-data/master-2/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/minicluster-data/master-2/wal
uuid: "151cc712441e407db5efed7abb479ebe"
format_stamp: "Formatted at 2026-09-23 17:18:40 on dist-test-slave-1x1f"
server_key: "3cdd45f3ae7a5c13181c567e37701006"
server_key_iv: "46c6f77f7fae460b11d81de37bcdfe5d"
server_key_version: "encryptionkey@0"
I20260923 17:18:40.156780 2150 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:18:40.167364 2150 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:18:40.171046 2150 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:18:40.171279 2150 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:18:40.179141 2150 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.188:42327
I20260923 17:18:40.179564 2217 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.188:42327 every 8 connection(s)
I20260923 17:18:40.180178 2150 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/minicluster-data/master-2/data/info.pb
I20260923 17:18:40.183243 2218 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:18:40.186174 2068 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.229.188" port: 42327 } attempt: 3
I20260923 17:18:40.187897 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 2150
I20260923 17:18:40.188045 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790183633736342-12182-0/minicluster-data/master-2/wal/instance
I20260923 17:18:40.188400 12182 external_mini_cluster.cc:1428] Setting key 16f76fd98450763932367c541d5a3a2c
I20260923 17:18:40.188431 2218 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.229.190" port: 46377 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 17:18:40 dist-test-slave-1x1f krb5kdc[1987](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183919, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for kudu/127.11.229.188@KRBTEST.COM
Sep 23 17:18:40 dist-test-slave-1x1f krb5kdc[1987](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183919, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.229.188@KRBTEST.COM
Sep 23 17:18:40 dist-test-slave-1x1f krb5kdc[1987](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183920, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.188@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:18:40.201771 2070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:40.187031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:42327 (local address 127.0.0.1:47736)
0923 17:18:40.187264 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:40.187279 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:40.187457 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:40.190099 (+ 2642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:40.190102 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:40.190369 (+ 267us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:18:40.190490 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:40.190497 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:40.192368 (+ 1871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:40.192374 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:40.193225 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:40.193236 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:40.194183 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:40.194187 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:40.194308 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:40.194911 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:18:40.194924 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:18:40.196630 (+ 1706us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:18:40.199447 (+ 2817us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:40.199453 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:40.199456 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:40.199853 (+ 397us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:40.200248 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:40.200252 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:40.200254 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:40.200360 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:40.201185 (+ 825us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:18:40.201192 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:18:40.201304 (+ 112us) client_negotiation.cc:769] Sending connection context
0923 17:18:40.201403 (+ 99us) client_negotiation.cc:240] Negotiation successful
0923 17:18:40.201528 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":93}
I20260923 17:18:40.202316 2071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:40.191301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56088 (local address 127.11.229.190:46377)
0923 17:18:40.191426 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:40.191431 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:40.191770 (+ 339us) server_negotiation.cc:407] Connection header received
0923 17:18:40.191967 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:40.191971 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:40.192016 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:40.192095 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:40.192894 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:40.193565 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:40.194712 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:40.195133 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:40.195273 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:40.197996 (+ 2723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:40.197999 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:40.198002 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:40.198026 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:40.199632 (+ 1606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:40.200296 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:40.200299 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:40.200301 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:40.200387 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:40.200717 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:40.200722 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:40.200733 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:40.201058 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:40.201152 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:40.201741 (+ 589us) server_negotiation.cc:299] Negotiation successful
0923 17:18:40.202141 (+ 400us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260923 17:18:40.203087 2143 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.229.188" port: 42327 } attempt: 3
I20260923 17:18:40.203225 2222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:40.189145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47750 (local address 127.11.229.188:42327)
0923 17:18:40.189699 (+ 554us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:40.189708 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:40.189724 (+ 16us) server_negotiation.cc:407] Connection header received
0923 17:18:40.189763 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:40.189766 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:40.189821 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:40.190150 (+ 329us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:40.191549 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:40.192418 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:40.193601 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:40.194046 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:40.194200 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:40.197526 (+ 3326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:40.197532 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:40.197536 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:40.197572 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:40.200669 (+ 3097us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:40.201132 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:40.201139 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:40.201145 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:40.201234 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:40.201613 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:40.201617 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:40.201619 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:40.201841 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:40.202881 (+ 1040us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:40.202954 (+ 73us) server_negotiation.cc:299] Negotiation successful
0923 17:18:40.203056 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":405,"server-negotiator.queue_time_us":482,"spinlock_wait_cycles":768,"thread_start_us":160,"threads_started":1}
I20260923 17:18:40.203229 2223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:40.191232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:46377 (local address 127.0.0.1:56088)
0923 17:18:40.191634 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:40.191699 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:40.191857 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:40.192171 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:40.192177 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:40.192645 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:18:40.192764 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:40.192770 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:40.193669 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:40.193672 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:40.194582 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:40.194596 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:40.195313 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:40.195318 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:40.195446 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:40.195982 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:18:40.196000 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:18:40.197852 (+ 1852us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:18:40.199759 (+ 1907us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:40.199771 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:40.199785 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:40.200200 (+ 415us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:40.200481 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:40.200485 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:40.200487 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:40.200611 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:40.201261 (+ 650us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:18:40.201267 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:18:40.201486 (+ 219us) client_negotiation.cc:769] Sending connection context
0923 17:18:40.201679 (+ 193us) client_negotiation.cc:240] Negotiation successful
0923 17:18:40.202020 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":94,"threads_started":1}
I20260923 17:18:40.203262 2220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:40.187903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47736 (local address 127.11.229.188:42327)
0923 17:18:40.188414 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:40.188437 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:40.188498 (+ 61us) server_negotiation.cc:407] Connection header received
0923 17:18:40.189376 (+ 878us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:40.189403 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:40.189823 (+ 420us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:40.190150 (+ 327us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:40.190660 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:40.192252 (+ 1592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:40.193361 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:40.194040 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:40.194203 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:40.196757 (+ 2554us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:40.196763 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:40.196775 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:40.196798 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:40.199299 (+ 2501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:40.199986 (+ 687us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:40.199993 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:40.199994 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:40.200134 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:40.200490 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:40.200497 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:40.200503 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:40.201021 (+ 518us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:40.202572 (+ 1551us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:40.202715 (+ 143us) server_negotiation.cc:299] Negotiation successful
0923 17:18:40.202875 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":9,"server-negotiator.queue_time_us":337,"spinlock_wait_cycles":3328,"thread_start_us":139,"threads_started":1}
I20260923 17:18:40.205327 2218 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.229.189" port: 37007 } has no permanent_uuid. Determining permanent_uuid...
I20260923 17:18:40.208107 2068 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95952d9755eb4eecb26f3c5ec979a337: Bootstrap starting.
Sep 23 17:18:40 dist-test-slave-1x1f krb5kdc[1987](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183919, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.189@KRBTEST.COM for kudu/127.11.229.188@KRBTEST.COM
I20260923 17:18:40.210995 2068 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 95952d9755eb4eecb26f3c5ec979a337: Neither blocks nor log segments found. Creating new log.
Sep 23 17:18:40 dist-test-slave-1x1f krb5kdc[1987](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183920, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.188@KRBTEST.COM for kudu/127.11.229.189@KRBTEST.COM
I20260923 17:18:40.211853 2068 log.cc:824] T 00000000000000000000000000000000 P 95952d9755eb4eecb26f3c5ec979a337: Log is configured to *not* fsync() on all Append() calls
I20260923 17:18:40.214668 2068 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95952d9755eb4eecb26f3c5ec979a337: No bootstrap required, opened a new log
I20260923 17:18:40.215076 2147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:40.203536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:42327 (local address 127.0.0.1:47754)
0923 17:18:40.203787 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:40.203802 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:40.203880 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:40.204942 (+ 1062us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:40.204946 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:40.205151 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:18:40.205269 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:40.205277 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:40.206423 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:40.206426 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:40.207304 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:40.207313 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:40.207873 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:40.207876 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:40.207965 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:40.208452 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:18:40.208464 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:18:40.209982 (+ 1518us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:18:40.213032 (+ 3050us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:40.213039 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:40.213041 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:40.213275 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:40.213810 (+ 535us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:40.213816 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:40.213818 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:40.213919 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:40.214447 (+ 528us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:18:40.214450 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:18:40.214567 (+ 117us) client_negotiation.cc:769] Sending connection context
0923 17:18:40.214726 (+ 159us) client_negotiation.cc:240] Negotiation successful
0923 17:18:40.214884 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174}
I20260923 17:18:40.215991 2220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:40.204437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47754 (local address 127.11.229.188:42327)
0923 17:18:40.204704 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:40.204708 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:40.204723 (+ 15us) server_negotiation.cc:407] Connection header received
0923 17:18:40.204761 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:40.204764 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:40.204806 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:40.205387 (+ 581us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:40.205480 (+ 93us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:40.206296 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:40.207431 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:40.207742 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:40.207873 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:40.210142 (+ 2269us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:40.210147 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:40.210150 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:40.210175 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:40.212908 (+ 2733us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:40.213397 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:40.213403 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:40.213407 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:40.213642 (+ 235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:40.214057 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:40.214060 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:40.214062 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:40.214332 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:40.215585 (+ 1253us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:40.215692 (+ 107us) server_negotiation.cc:299] Negotiation successful
0923 17:18:40.215829 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":27,"server-negotiator.queue_time_us":166,"spinlock_wait_cycles":60032}
I20260923 17:18:40.216305 2146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:40.205949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50410 (local address 127.11.229.189:37007)
0923 17:18:40.206053 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:40.206057 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:40.206070 (+ 13us) server_negotiation.cc:407] Connection header received
0923 17:18:40.206119 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:40.206121 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:40.206159 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:40.206267 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:40.206714 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:40.207423 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:40.208741 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:40.209123 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:40.209249 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:40.211926 (+ 2677us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:40.211931 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:40.211934 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:40.212010 (+ 76us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:40.214311 (+ 2301us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:40.214821 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:40.214825 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:40.214826 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:40.214900 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:40.215207 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:40.215213 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:40.215214 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:40.215426 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:40.215492 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:40.215875 (+ 383us) server_negotiation.cc:299] Negotiation successful
0923 17:18:40.215978 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260923 17:18:40.217060 2223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:40.205846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.189:37007 (local address 127.0.0.1:50410)
0923 17:18:40.205979 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:40.205992 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:40.206053 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:40.206302 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:40.206305 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:40.206468 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:18:40.206580 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:40.206589 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:40.207559 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:40.207562 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:40.208614 (+ 1052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:40.208624 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:40.209251 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:40.209255 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:40.209358 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:40.209864 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:18:40.209879 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:18:40.211712 (+ 1833us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:18:40.214451 (+ 2739us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:40.214453 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:40.214455 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:40.214714 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:40.215006 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:40.215009 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:40.215011 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:40.215103 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:40.215564 (+ 461us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:18:40.215566 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:18:40.215670 (+ 104us) client_negotiation.cc:769] Sending connection context
0923 17:18:40.216498 (+ 828us) client_negotiation.cc:240] Negotiation successful
0923 17:18:40.216885 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":79,"mutex_wait_us":2,"spinlock_wait_cycles":4736}
I20260923 17:18:40.217669 2218 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.229.188" port: 42327 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 17:18:40 dist-test-slave-1x1f krb5kdc[1987](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183919, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:18:40.220125 2143 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6586a1c966954b849d2974547167c1cb: Bootstrap starting.
I20260923 17:18:40.221109 2068 raft_consensus.cc:348] T 00000000000000000000000000000000 P 95952d9755eb4eecb26f3c5ec979a337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95952d9755eb4eecb26f3c5ec979a337" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 46377 } } peers { permanent_uuid: "6586a1c966954b849d2974547167c1cb" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 37007 } } peers { permanent_uuid: "151cc712441e407db5efed7abb479ebe" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 42327 } }
I20260923 17:18:40.221405 2068 raft_consensus.cc:729] T 00000000000000000000000000000000 P 95952d9755eb4eecb26f3c5ec979a337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95952d9755eb4eecb26f3c5ec979a337, State: Initialized, Role: FOLLOWER
I20260923 17:18:40.221796 2068 consensus_queue.cc:260] T 00000000000000000000000000000000 P 95952d9755eb4eecb26f3c5ec979a337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95952d9755eb4eecb26f3c5ec979a337" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 46377 } } peers { permanent_uuid: "6586a1c966954b849d2974547167c1cb" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 37007 } } peers { permanent_uuid: "151cc712441e407db5efed7abb479ebe" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 42327 } }
I20260923 17:18:40.222534 2226 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95952d9755eb4eecb26f3c5ec979a337 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95952d9755eb4eecb26f3c5ec979a337" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 46377 } } peers { permanent_uuid: "6586a1c966954b849d2974547167c1cb" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 37007 } } peers { permanent_uuid: "151cc712441e407db5efed7abb479ebe" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 42327 } } }
I20260923 17:18:40.222694 2226 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95952d9755eb4eecb26f3c5ec979a337 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 17:18:40.223069 2143 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6586a1c966954b849d2974547167c1cb: Neither blocks nor log segments found. Creating new log.
I20260923 17:18:40.223872 2143 log.cc:824] T 00000000000000000000000000000000 P 6586a1c966954b849d2974547167c1cb: Log is configured to *not* fsync() on all Append() calls
I20260923 17:18:40.224448 2068 sys_catalog.cc:564] T 00000000000000000000000000000000 P 95952d9755eb4eecb26f3c5ec979a337 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:18:40.226270 2071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:40.212332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56102 (local address 127.11.229.190:46377)
0923 17:18:40.212457 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:40.212463 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:40.212479 (+ 16us) server_negotiation.cc:407] Connection header received
0923 17:18:40.212522 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:40.212527 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:40.212575 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:40.212674 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:40.213591 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:40.214321 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:40.215529 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:40.215835 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:40.215930 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:40.220645 (+ 4715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:40.220650 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:40.220653 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:40.220683 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:40.222871 (+ 2188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:40.223815 (+ 944us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:40.223821 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:40.223823 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:40.223950 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:40.224430 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:40.224434 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:40.224436 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:40.224835 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:40.225042 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:40.225773 (+ 731us) server_negotiation.cc:299] Negotiation successful
0923 17:18:40.225957 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
Sep 23 17:18:40 dist-test-slave-1x1f krb5kdc[1987](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183920, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.188@KRBTEST.COM for kudu/127.11.229.188@KRBTEST.COM
W20260923 17:18:40.232031 2238 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 95952d9755eb4eecb26f3c5ec979a337: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 17:18:40.232106 2238 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 17:18:40.233104 2223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:40.218140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:42327 (local address 127.0.0.1:47762)
0923 17:18:40.218562 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:40.218579 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:40.218656 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:40.224579 (+ 5923us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:40.224582 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:40.224804 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:18:40.224908 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:40.224914 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:40.225695 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:40.225701 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:40.226561 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:40.226572 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:40.227229 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:40.227233 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:40.227301 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:40.227896 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:18:40.227910 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:18:40.229489 (+ 1579us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:18:40.231494 (+ 2005us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:40.231496 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:40.231498 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:40.231749 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:40.232003 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:40.232006 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:40.232007 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:40.232082 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:40.232505 (+ 423us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:18:40.232508 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:18:40.232615 (+ 107us) client_negotiation.cc:769] Sending connection context
0923 17:18:40.232737 (+ 122us) client_negotiation.cc:240] Negotiation successful
0923 17:18:40.232889 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":142,"threads_started":1}
I20260923 17:18:40.233735 2220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:40.218449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47762 (local address 127.11.229.188:42327)
0923 17:18:40.224375 (+ 5926us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:40.224379 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:40.224392 (+ 13us) server_negotiation.cc:407] Connection header received
0923 17:18:40.224426 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:40.224429 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:40.224466 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:40.224569 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:40.225026 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:40.225594 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:40.226662 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:40.226937 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:40.227087 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:40.229625 (+ 2538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:40.229629 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:40.229631 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:40.229651 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:40.231379 (+ 1728us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:40.231848 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:40.231850 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:40.231852 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:40.231922 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:40.232229 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:40.232233 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:40.232234 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:40.232404 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:40.232516 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:40.233419 (+ 903us) server_negotiation.cc:299] Negotiation successful
0923 17:18:40.233537 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5847}
I20260923 17:18:40.234766 2143 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6586a1c966954b849d2974547167c1cb: No bootstrap required, opened a new log
I20260923 17:18:40.230611 2000 master_runner.cc:186] Error getting master registration for 127.11.229.189:37007: OK, instance_id { permanent_uuid: "6586a1c966954b849d2974547167c1cb" instance_seqno: 1790183919947272 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
Sep 23 17:18:40 dist-test-slave-1x1f krb5kdc[1987](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183919, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.229.189@KRBTEST.COM
I20260923 17:18:40.235260 2000 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260923 17:18:40.237208 2218 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 151cc712441e407db5efed7abb479ebe: Bootstrap starting.
I20260923 17:18:40.239132 2143 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6586a1c966954b849d2974547167c1cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95952d9755eb4eecb26f3c5ec979a337" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 46377 } } peers { permanent_uuid: "6586a1c966954b849d2974547167c1cb" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 37007 } } peers { permanent_uuid: "151cc712441e407db5efed7abb479ebe" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 42327 } }
I20260923 17:18:40.239364 2143 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6586a1c966954b849d2974547167c1cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6586a1c966954b849d2974547167c1cb, State: Initialized, Role: FOLLOWER
I20260923 17:18:40.239732 2143 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6586a1c966954b849d2974547167c1cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95952d9755eb4eecb26f3c5ec979a337" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 46377 } } peers { permanent_uuid: "6586a1c966954b849d2974547167c1cb" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 37007 } } peers { permanent_uuid: "151cc712441e407db5efed7abb479ebe" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 42327 } }
I20260923 17:18:40.240618 2218 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 151cc712441e407db5efed7abb479ebe: Neither blocks nor log segments found. Creating new log.
I20260923 17:18:40.240854 2146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:40.228096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50416 (local address 127.11.229.189:37007)
0923 17:18:40.228203 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:40.228207 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:40.228307 (+ 100us) server_negotiation.cc:407] Connection header received
0923 17:18:40.228512 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:40.228516 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:40.228569 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:40.228626 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:40.229582 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:40.230413 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:40.231593 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:40.232014 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:40.232127 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:40.236004 (+ 3877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:40.236008 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:40.236011 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:40.236036 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:40.238099 (+ 2063us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:40.238889 (+ 790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:40.238893 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:40.238895 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:40.238994 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:40.239530 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:40.239534 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:40.239536 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:40.239785 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:40.239938 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:40.240444 (+ 506us) server_negotiation.cc:299] Negotiation successful
0923 17:18:40.240589 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260923 17:18:40.241452 2143 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6586a1c966954b849d2974547167c1cb [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:18:40.241623 2218 log.cc:824] T 00000000000000000000000000000000 P 151cc712441e407db5efed7abb479ebe: Log is configured to *not* fsync() on all Append() calls
I20260923 17:18:40.244521 2240 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6586a1c966954b849d2974547167c1cb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95952d9755eb4eecb26f3c5ec979a337" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 46377 } } peers { permanent_uuid: "6586a1c966954b849d2974547167c1cb" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 37007 } } peers { permanent_uuid: "151cc712441e407db5efed7abb479ebe" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 42327 } } }
I20260923 17:18:40.244673 2240 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6586a1c966954b849d2974547167c1cb [sys.catalog]: This master's current role is: FOLLOWER
I20260923 17:18:40.245098 12182 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 17:18:40.246471 2041 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "95952d9755eb4eecb26f3c5ec979a337"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56102
I20260923 17:18:40.246723 2041 raft_consensus.cc:482] T 00000000000000000000000000000000 P 95952d9755eb4eecb26f3c5ec979a337 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260923 17:18:40.246848 2041 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 95952d9755eb4eecb26f3c5ec979a337 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:18:40.248991 2041 raft_consensus.cc:504] T 00000000000000000000000000000000 P 95952d9755eb4eecb26f3c5ec979a337 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95952d9755eb4eecb26f3c5ec979a337" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 46377 } } peers { permanent_uuid: "6586a1c966954b849d2974547167c1cb" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 37007 } } peers { permanent_uuid: "151cc712441e407db5efed7abb479ebe" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 42327 } }
I20260923 17:18:40.250188 2041 leader_election.cc:288] T 00000000000000000000000000000000 P 95952d9755eb4eecb26f3c5ec979a337 [CANDIDATE]: Term 1 election: Requested vote from peers 6586a1c966954b849d2974547167c1cb (127.11.229.189:37007), 151cc712441e407db5efed7abb479ebe (127.11.229.188:42327)
I20260923 17:18:40.250669 2117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "95952d9755eb4eecb26f3c5ec979a337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "6586a1c966954b849d2974547167c1cb"
I20260923 17:18:40.250917 2117 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6586a1c966954b849d2974547167c1cb [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:18:40.252226 2117 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6586a1c966954b849d2974547167c1cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95952d9755eb4eecb26f3c5ec979a337 in term 1.
I20260923 17:18:40.254196 2016 leader_election.cc:302] T 00000000000000000000000000000000 P 95952d9755eb4eecb26f3c5ec979a337 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6586a1c966954b849d2974547167c1cb, 95952d9755eb4eecb26f3c5ec979a337; no voters:
I20260923 17:18:40.254549 2226 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 95952d9755eb4eecb26f3c5ec979a337 [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:18:40.254758 2226 raft_consensus.cc:686] T 00000000000000000000000000000000 P 95952d9755eb4eecb26f3c5ec979a337 [term 1 LEADER]: Becoming Leader. State: Replica: 95952d9755eb4eecb26f3c5ec979a337, State: Running, Role: LEADER
W20260923 17:18:40.254876 2252 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6586a1c966954b849d2974547167c1cb: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260923 17:18:40.255092 2226 consensus_queue.cc:237] T 00000000000000000000000000000000 P 95952d9755eb4eecb26f3c5ec979a337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95952d9755eb4eecb26f3c5ec979a337" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 46377 } } peers { permanent_uuid: "6586a1c966954b849d2974547167c1cb" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 37007 } } peers { permanent_uuid: "151cc712441e407db5efed7abb479ebe" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 42327 } }
W20260923 17:18:40.255191 2252 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 17:18:40.252465 2075 master_runner.cc:186] Error getting master registration for 127.11.229.188:42327: OK, instance_id { permanent_uuid: "151cc712441e407db5efed7abb479ebe" instance_seqno: 1790183920176934 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260923 17:18:40.255928 2075 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260923 17:18:40.256863 2226 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95952d9755eb4eecb26f3c5ec979a337 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 95952d9755eb4eecb26f3c5ec979a337. Latest consensus state: current_term: 1 leader_uuid: "95952d9755eb4eecb26f3c5ec979a337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95952d9755eb4eecb26f3c5ec979a337" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 46377 } } peers { permanent_uuid: "6586a1c966954b849d2974547167c1cb" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 37007 } } peers { permanent_uuid: "151cc712441e407db5efed7abb479ebe" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 42327 } } }
I20260923 17:18:40.256970 2226 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95952d9755eb4eecb26f3c5ec979a337 [sys.catalog]: This master's current role is: LEADER
I20260923 17:18:40.258648 2260 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:18:40.259609 2260 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260923 17:18:40.264909 2218 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 151cc712441e407db5efed7abb479ebe: No bootstrap required, opened a new log
I20260923 17:18:40.268334 2117 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6586a1c966954b849d2974547167c1cb [term 1 FOLLOWER]: Refusing update from remote peer 95952d9755eb4eecb26f3c5ec979a337: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:18:40.269383 2258 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 95952d9755eb4eecb26f3c5ec979a337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6586a1c966954b849d2974547167c1cb" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 37007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:18:40.270860 2218 raft_consensus.cc:348] T 00000000000000000000000000000000 P 151cc712441e407db5efed7abb479ebe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95952d9755eb4eecb26f3c5ec979a337" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 46377 } } peers { permanent_uuid: "6586a1c966954b849d2974547167c1cb" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 37007 } } peers { permanent_uuid: "151cc712441e407db5efed7abb479ebe" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 42327 } }
I20260923 17:18:40.271173 2218 raft_consensus.cc:729] T 00000000000000000000000000000000 P 151cc712441e407db5efed7abb479ebe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 151cc712441e407db5efed7abb479ebe, State: Initialized, Role: FOLLOWER
I20260923 17:18:40.271579 2218 consensus_queue.cc:260] T 00000000000000000000000000000000 P 151cc712441e407db5efed7abb479ebe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95952d9755eb4eecb26f3c5ec979a337" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 46377 } } peers { permanent_uuid: "6586a1c966954b849d2974547167c1cb" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 37007 } } peers { permanent_uuid: "151cc712441e407db5efed7abb479ebe" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 42327 } }
I20260923 17:18:40.273092 2218 sys_catalog.cc:564] T 00000000000000000000000000000000 P 151cc712441e407db5efed7abb479ebe [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:18:40.273154 2192 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "95952d9755eb4eecb26f3c5ec979a337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "151cc712441e407db5efed7abb479ebe"
I20260923 17:18:40.273382 2192 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 151cc712441e407db5efed7abb479ebe [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:18:40.274322 2240 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6586a1c966954b849d2974547167c1cb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 95952d9755eb4eecb26f3c5ec979a337. Latest consensus state: current_term: 1 leader_uuid: "95952d9755eb4eecb26f3c5ec979a337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95952d9755eb4eecb26f3c5ec979a337" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 46377 } } peers { permanent_uuid: "6586a1c966954b849d2974547167c1cb" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 37007 } } peers { permanent_uuid: "151cc712441e407db5efed7abb479ebe" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 42327 } } }
I20260923 17:18:40.274475 2240 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6586a1c966954b849d2974547167c1cb [sys.catalog]: This master's current role is: FOLLOWER
I20260923 17:18:40.275282 2192 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 151cc712441e407db5efed7abb479ebe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95952d9755eb4eecb26f3c5ec979a337 in term 1.
I20260923 17:18:40.276268 2188 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 151cc712441e407db5efed7abb479ebe [term 1 FOLLOWER]: Refusing update from remote peer 95952d9755eb4eecb26f3c5ec979a337: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:18:40.276901 2258 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 95952d9755eb4eecb26f3c5ec979a337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "151cc712441e407db5efed7abb479ebe" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 42327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:18:40.289009 2261 mvcc.cc:205] Tried to move back new op lower bound from 7332593337402703872 to 7332593337368485888. Current Snapshot: MvccSnapshot[applied={T|T < 7332593337402703872}]
I20260923 17:18:40.289602 2226 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95952d9755eb4eecb26f3c5ec979a337 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "95952d9755eb4eecb26f3c5ec979a337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95952d9755eb4eecb26f3c5ec979a337" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 46377 } } peers { permanent_uuid: "6586a1c966954b849d2974547167c1cb" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 37007 } } peers { permanent_uuid: "151cc712441e407db5efed7abb479ebe" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 42327 } } }
I20260923 17:18:40.289726 2226 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95952d9755eb4eecb26f3c5ec979a337 [sys.catalog]: This master's current role is: LEADER
I20260923 17:18:40.290335 2071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:40.262422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56104 (local address 127.11.229.190:46377)
0923 17:18:40.262552 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:40.262559 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:40.269388 (+ 6829us) server_negotiation.cc:407] Connection header received
0923 17:18:40.270400 (+ 1012us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:40.270404 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:40.270457 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:40.270513 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:40.275741 (+ 5228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:40.276593 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:40.278379 (+ 1786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:40.278683 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:40.278756 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:40.286248 (+ 7492us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:40.286255 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:40.286261 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:40.286298 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:40.288247 (+ 1949us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:40.288840 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:40.288844 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:40.288846 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:40.288934 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:40.289253 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:40.289257 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:40.289259 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:40.289497 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:40.289616 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:40.289977 (+ 361us) server_negotiation.cc:299] Negotiation successful
0923 17:18:40.290107 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260923 17:18:40.292480 2226 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95952d9755eb4eecb26f3c5ec979a337 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "95952d9755eb4eecb26f3c5ec979a337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95952d9755eb4eecb26f3c5ec979a337" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 46377 } } peers { permanent_uuid: "6586a1c966954b849d2974547167c1cb" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 37007 } } peers { permanent_uuid: "151cc712441e407db5efed7abb479ebe" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 42327 } } }
I20260923 17:18:40.292610 2226 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95952d9755eb4eecb26f3c5ec979a337 [sys.catalog]: This master's current role is: LEADER
I20260923 17:18:40.293453 2263 sys_catalog.cc:455] T 00000000000000000000000000000000 P 151cc712441e407db5efed7abb479ebe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "95952d9755eb4eecb26f3c5ec979a337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95952d9755eb4eecb26f3c5ec979a337" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 46377 } } peers { permanent_uuid: "6586a1c966954b849d2974547167c1cb" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 37007 } } peers { permanent_uuid: "151cc712441e407db5efed7abb479ebe" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 42327 } } }
I20260923 17:18:40.293773 2263 sys_catalog.cc:458] T 00000000000000000000000000000000 P 151cc712441e407db5efed7abb479ebe [sys.catalog]: This master's current role is: FOLLOWER
I20260923 17:18:40.293887 2240 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6586a1c966954b849d2974547167c1cb [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "95952d9755eb4eecb26f3c5ec979a337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95952d9755eb4eecb26f3c5ec979a337" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 46377 } } peers { permanent_uuid: "6586a1c966954b849d2974547167c1cb" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 37007 } } peers { permanent_uuid: "151cc712441e407db5efed7abb479ebe" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 42327 } } }
I20260923 17:18:40.293993 2240 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6586a1c966954b849d2974547167c1cb [sys.catalog]: This master's current role is: FOLLOWER
I20260923 17:18:40.294099 2263 sys_catalog.cc:455] T 00000000000000000000000000000000 P 151cc712441e407db5efed7abb479ebe [sys.catalog]: SysCatalogTable state changed. Reason: New leader 95952d9755eb4eecb26f3c5ec979a337. Latest consensus state: current_term: 1 leader_uuid: "95952d9755eb4eecb26f3c5ec979a337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95952d9755eb4eecb26f3c5ec979a337" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 46377 } } peers { permanent_uuid: "6586a1c966954b849d2974547167c1cb" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 37007 } } peers { permanent_uuid: "151cc712441e407db5efed7abb479ebe" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 42327 } } }
I20260923 17:18:40.294653 2264 mvcc.cc:205] Tried to move back new op lower bound from 7332593337402703872 to 7332593337368485888. Current Snapshot: MvccSnapshot[applied={T|T < 7332593337402703872}]
I20260923 17:18:40.294205 2263 sys_catalog.cc:458] T 00000000000000000000000000000000 P 151cc712441e407db5efed7abb479ebe [sys.catalog]: This master's current role is: FOLLOWER
I20260923 17:18:40.294909 2263 sys_catalog.cc:455] T 00000000000000000000000000000000 P 151cc712441e407db5efed7abb479ebe [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "95952d9755eb4eecb26f3c5ec979a337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95952d9755eb4eecb26f3c5ec979a337" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 46377 } } peers { permanent_uuid: "6586a1c966954b849d2974547167c1cb" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 37007 } } peers { permanent_uuid: "151cc712441e407db5efed7abb479ebe" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 42327 } } }
I20260923 17:18:40.295017 2263 sys_catalog.cc:458] T 00000000000000000000000000000000 P 151cc712441e407db5efed7abb479ebe [sys.catalog]: This master's current role is: FOLLOWER
I20260923 17:18:40.296332 2280 mvcc.cc:205] Tried to move back new op lower bound from 7332593337402703872 to 7332593337368485888. Current Snapshot: MvccSnapshot[applied={T|T < 7332593337402703872}]
I20260923 17:18:40.298601 2260 catalog_manager.cc:1347] Generated new cluster ID: 05c13015c9c24733849fda9d39399f63
I20260923 17:18:40.298714 2260 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:18:40.300657 2146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:40.274640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50418 (local address 127.11.229.189:37007)
0923 17:18:40.274760 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:40.274767 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:40.291021 (+ 16254us) server_negotiation.cc:407] Connection header received
0923 17:18:40.291279 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:40.291282 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:40.291341 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:40.291397 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:40.292352 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:40.293127 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:40.294347 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:40.294714 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:40.294804 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:40.296811 (+ 2007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:40.296816 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:40.296819 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:40.296860 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:40.298686 (+ 1826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:40.299222 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:40.299226 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:40.299228 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:40.299315 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:40.299628 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:40.299632 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:40.299634 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:40.299843 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:40.299960 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:40.300360 (+ 400us) server_negotiation.cc:299] Negotiation successful
0923 17:18:40.300486 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260923 17:18:40.307389 2220 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:40.275383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47770 (local address 127.11.229.188:42327)
0923 17:18:40.275497 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:40.275503 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:40.295344 (+ 19841us) server_negotiation.cc:407] Connection header received
0923 17:18:40.295558 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:40.295565 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:40.295631 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:40.295690 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:40.299095 (+ 3405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:40.299938 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:40.301118 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:40.301458 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:40.301544 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:40.303306 (+ 1762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:40.303311 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:40.303315 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:40.303347 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:40.305144 (+ 1797us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:40.305727 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:40.305731 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:40.305733 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:40.305825 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:40.306144 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:40.306148 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:40.306149 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:40.306510 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:40.306660 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:40.307063 (+ 403us) server_negotiation.cc:299] Negotiation successful
0923 17:18:40.307209 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
W20260923 17:18:40.324584 2278 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 151cc712441e407db5efed7abb479ebe: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 17:18:40.324766 2278 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 17:18:40.336357 2260 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:18:40.337986 2260 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:18:40.365487 2260 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 95952d9755eb4eecb26f3c5ec979a337: Generated new TSK 0
I20260923 17:18:40.366636 2260 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260923 17:18:40.401326 2071 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:18:40.397818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56106 (local address 127.11.229.190:46377)
0923 17:18:40.397959 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:40.397964 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:40.400066 (+ 2102us) server_negotiation.cc:407] Connection header received
0923 17:18:40.400348 (+ 282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:40.400352 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:40.400411 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:40.400471 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:40.401183 (+ 712us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56106: BlockingRecv error: recv got EOF from 127.0.0.1:56106 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
W20260923 17:18:40.403029 2146 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:18:40.398689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50428 (local address 127.11.229.189:37007)
0923 17:18:40.398837 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:40.398841 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:40.402038 (+ 3197us) server_negotiation.cc:407] Connection header received
0923 17:18:40.402241 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:40.402245 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:40.402300 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:40.402355 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:40.402903 (+ 548us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50428: BlockingRecv error: recv got EOF from 127.0.0.1:50428 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
W20260923 17:18:40.404837 2220 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:18:40.399380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47782 (local address 127.11.229.188:42327)
0923 17:18:40.399514 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:40.399520 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:40.403675 (+ 4155us) server_negotiation.cc:407] Connection header received
0923 17:18:40.403968 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:40.403972 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:40.404028 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:40.404088 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:40.404686 (+ 598us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47782: BlockingRecv error: recv got EOF from 127.0.0.1:47782 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260923 17:18:40.409993 2146 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:18:40.408306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50444 (local address 127.11.229.189:37007)
0923 17:18:40.408423 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:40.408428 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:40.408912 (+ 484us) server_negotiation.cc:407] Connection header received
0923 17:18:40.409149 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:40.409152 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:40.409273 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:40.409334 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:40.409883 (+ 549us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50444: BlockingRecv error: recv got EOF from 127.0.0.1:50444 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
W20260923 17:18:40.415807 2146 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:18:40.414110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50454 (local address 127.11.229.189:37007)
0923 17:18:40.414250 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:40.414255 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:40.414771 (+ 516us) server_negotiation.cc:407] Connection header received
0923 17:18:40.414993 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:40.414996 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:40.415050 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:40.415104 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:40.415679 (+ 575us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50454: BlockingRecv error: recv got EOF from 127.0.0.1:50454 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
W20260923 17:18:40.422134 2146 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:18:40.420423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50464 (local address 127.11.229.189:37007)
0923 17:18:40.420545 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:40.420549 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:40.421087 (+ 538us) server_negotiation.cc:407] Connection header received
0923 17:18:40.421299 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:40.421305 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:40.421364 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:40.421421 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:40.422022 (+ 601us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50464: BlockingRecv error: recv got EOF from 127.0.0.1:50464 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260923 17:18:40.439834 2146 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:18:40.434748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50468 (local address 127.11.229.189:37007)
0923 17:18:40.434922 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:40.434928 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:40.438633 (+ 3705us) server_negotiation.cc:407] Connection header received
0923 17:18:40.438901 (+ 268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:40.438905 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:40.438969 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:40.439034 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:40.439695 (+ 661us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50468: BlockingRecv error: recv got EOF from 127.0.0.1:50468 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
W20260923 17:18:40.452613 2146 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:18:40.450739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50474 (local address 127.11.229.189:37007)
0923 17:18:40.450867 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:40.450872 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:40.451558 (+ 686us) server_negotiation.cc:407] Connection header received
0923 17:18:40.451773 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:40.451777 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:40.451833 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:40.451890 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:40.452484 (+ 594us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50474: BlockingRecv error: recv got EOF from 127.0.0.1:50474 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
W20260923 17:18:40.472750 2146 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:18:40.471367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50476 (local address 127.11.229.189:37007)
0923 17:18:40.471500 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:40.471505 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:40.471788 (+ 283us) server_negotiation.cc:407] Connection header received
0923 17:18:40.471972 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:40.471979 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:40.472036 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:40.472142 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:40.472620 (+ 478us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50476: BlockingRecv error: recv got EOF from 127.0.0.1:50476 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260923 17:18:40.508677 2146 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:18:40.507062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50484 (local address 127.11.229.189:37007)
0923 17:18:40.507232 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:40.507235 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:40.507399 (+ 164us) server_negotiation.cc:407] Connection header received
0923 17:18:40.507548 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:40.507550 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:40.507596 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:40.507680 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:40.508406 (+ 726us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50484: BlockingRecv error: recv got EOF from 127.0.0.1:50484 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
W20260923 17:18:40.576180 2146 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:18:40.575103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50498 (local address 127.11.229.189:37007)
0923 17:18:40.575266 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:40.575270 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:40.575288 (+ 18us) server_negotiation.cc:407] Connection header received
0923 17:18:40.575373 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:40.575375 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:40.575418 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:40.575512 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:40.576037 (+ 525us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50498: BlockingRecv error: recv got EOF from 127.0.0.1:50498 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
W20260923 17:18:40.707880 2146 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:18:40.706546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50506 (local address 127.11.229.189:37007)
0923 17:18:40.706728 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:40.706735 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:40.706891 (+ 156us) server_negotiation.cc:407] Connection header received
0923 17:18:40.707094 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:40.707098 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:40.707167 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:40.707259 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:40.707738 (+ 479us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50506: BlockingRecv error: recv got EOF from 127.0.0.1:50506 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
W20260923 17:18:40.967803 2146 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:18:40.966427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50510 (local address 127.11.229.189:37007)
0923 17:18:40.966680 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:40.966685 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:40.966756 (+ 71us) server_negotiation.cc:407] Connection header received
0923 17:18:40.966888 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:40.966891 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:40.966951 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:40.967054 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:40.967630 (+ 576us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50510: BlockingRecv error: recv got EOF from 127.0.0.1:50510 (error 108)
Metrics: {"server-negotiator.queue_time_us":93}
I20260923 17:18:41.256659 2252 catalog_manager.cc:1259] Loaded cluster ID: 05c13015c9c24733849fda9d39399f63
I20260923 17:18:41.256750 2252 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 6586a1c966954b849d2974547167c1cb: loading cluster ID for follower catalog manager: success
I20260923 17:18:41.258412 2252 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 6586a1c966954b849d2974547167c1cb: acquiring CA information for follower catalog manager: success
I20260923 17:18:41.259491 2252 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 6586a1c966954b849d2974547167c1cb: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260923 17:18:41.326283 2278 catalog_manager.cc:1259] Loaded cluster ID: 05c13015c9c24733849fda9d39399f63
I20260923 17:18:41.326362 2278 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 151cc712441e407db5efed7abb479ebe: loading cluster ID for follower catalog manager: success
I20260923 17:18:41.328164 2278 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 151cc712441e407db5efed7abb479ebe: acquiring CA information for follower catalog manager: success
I20260923 17:18:41.329344 2278 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 151cc712441e407db5efed7abb479ebe: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260923 17:18:41.486228 2353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:41.481960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50514 (local address 127.11.229.189:37007)
0923 17:18:41.482187 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:41.482191 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:41.482216 (+ 25us) server_negotiation.cc:407] Connection header received
0923 17:18:41.482441 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:41.482444 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:41.482584 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:41.482701 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 17:18:41.482941 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:41.483521 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:41.484485 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:41.484775 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:41.484923 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:41.485231 (+ 308us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 17:18:41.485775 (+ 544us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 17:18:41.485877 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:41.485943 (+ 66us) server_negotiation.cc:299] Negotiation successful
0923 17:18:41.486005 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":69,"threads_started":1}
I20260923 17:18:41.494710 2359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:41.490315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47792 (local address 127.11.229.188:42327)
0923 17:18:41.490592 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:41.490600 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:41.490623 (+ 23us) server_negotiation.cc:407] Connection header received
0923 17:18:41.490866 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:41.490870 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:41.490996 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:41.491203 (+ 207us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 17:18:41.491459 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:41.492043 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:41.493010 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:41.493259 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:41.493382 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:41.493736 (+ 354us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 17:18:41.494209 (+ 473us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 17:18:41.494400 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:41.494464 (+ 64us) server_negotiation.cc:299] Negotiation successful
0923 17:18:41.494529 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":84,"threads_started":1}
I20260923 17:18:41.502967 2353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:41.498196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50526 (local address 127.11.229.189:37007)
0923 17:18:41.498436 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:41.498440 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:41.498687 (+ 247us) server_negotiation.cc:407] Connection header received
0923 17:18:41.498923 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:41.498927 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:41.498981 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:41.499039 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 17:18:41.499455 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:41.500206 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:41.501548 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:41.501782 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:41.501840 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:41.502378 (+ 538us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 17:18:41.502471 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 17:18:41.502549 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:41.502732 (+ 183us) server_negotiation.cc:299] Negotiation successful
0923 17:18:41.502790 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142}
I20260923 17:18:41.503167 2359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:41.498744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47802 (local address 127.11.229.188:42327)
0923 17:18:41.498878 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:41.498885 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:41.499107 (+ 222us) server_negotiation.cc:407] Connection header received
0923 17:18:41.499193 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:41.499196 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:41.499247 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:41.499325 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 17:18:41.499683 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:41.500283 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:41.501545 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:41.501831 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:41.501912 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:41.502616 (+ 704us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 17:18:41.502690 (+ 74us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 17:18:41.502757 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:41.502920 (+ 163us) server_negotiation.cc:299] Negotiation successful
0923 17:18:41.502987 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260923 17:18:41.503628 2365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:41.498025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56120 (local address 127.11.229.190:46377)
0923 17:18:41.498444 (+ 419us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:41.498449 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:41.498478 (+ 29us) server_negotiation.cc:407] Connection header received
0923 17:18:41.498581 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:41.498586 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:41.498759 (+ 173us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:41.498888 (+ 129us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 17:18:41.499296 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:41.500126 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:41.501159 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:41.501429 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:41.501552 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:41.502494 (+ 942us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 17:18:41.502894 (+ 400us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 17:18:41.502978 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:41.503128 (+ 150us) server_negotiation.cc:299] Negotiation successful
0923 17:18:41.503460 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":309,"thread_start_us":83,"threads_started":1}
I20260923 17:18:41.507066 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 2000
I20260923 17:18:41.514823 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 2075
I20260923 17:18:41.521123 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 2150
2026-09-23T17:18:41Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3245 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 23 17:18:41 dist-test-slave-1x1f krb5kdc[2370](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 23 17:18:41 dist-test-slave-1x1f krb5kdc[2370](info): set up 2 sockets
Sep 23 17:18:41 dist-test-slave-1x1f krb5kdc[2370](info): commencing operation
krb5kdc: starting...
W20260923 17:18:42.583745 12182 mini_kdc.cc:121] Time spent starting KDC: real 1.039s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/krb5kdc/test-user.keytab.
Sep 23 17:18:42 dist-test-slave-1x1f krb5kdc[2370](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183922, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-23T17:18:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-23T17:18:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.229.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
Entry for principal kudu/127.11.229.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab.
I20260923 17:18:42.710183 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:43897
--webserver_interface=127.11.229.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:36015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:43897,127.11.229.189:45969,127.11.229.188:41179
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260923 17:18:42.819720 2383 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260923 17:18:42.820039 2383 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:18:42.820117 2383 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:18:42.820199 2383 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260923 17:18:42.824277 2383 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:18:42.824365 2383 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:18:42.824400 2383 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:18:42.824460 2383 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:18:42.824515 2383 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:18:42.829902 2383 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:36015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:43897,127.11.229.189:45969,127.11.229.188:41179
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.190.keytab
--principal=kudu/127.11.229.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.190:43897
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.229.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2383
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:18:42.831111 2383 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:18:42.832194 2383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260923 17:18:42.841344 2383 server_base.cc:1034] running on GCE node
W20260923 17:18:42.841291 2388 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:42.841291 2391 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:42.841327 2389 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:42.842432 2383 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:18:42.843627 2383 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:18:42.844861 2383 hybrid_clock.cc:648] HybridClock initialized: now 1790183922844834 us; error 41 us; skew 500 ppm
Sep 23 17:18:42 dist-test-slave-1x1f krb5kdc[2370](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183922, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:18:42.852270 2383 init.cc:377] Logged in from keytab as kudu/127.11.229.190@KRBTEST.COM (short username kudu)
I20260923 17:18:42.853267 2383 webserver.cc:460] Webserver started at http://127.11.229.190:42997/ using document root <none> and password file <none>
I20260923 17:18:42.853874 2383 fs_manager.cc:359] Metadata directory not provided
I20260923 17:18:42.853974 2383 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:18:42.854276 2383 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:18:42.856518 2383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/minicluster-data/master-0/data/instance:
uuid: "5f90b7e3252841a8ad945d582811366b"
format_stamp: "Formatted at 2026-09-23 17:18:42 on dist-test-slave-1x1f"
server_key: "18938e40861171e2de176a14809139bb"
server_key_iv: "848e325721482507c318516bfb2ed256"
server_key_version: "encryptionkey@0"
I20260923 17:18:42.857146 2383 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/minicluster-data/master-0/wal/instance:
uuid: "5f90b7e3252841a8ad945d582811366b"
format_stamp: "Formatted at 2026-09-23 17:18:42 on dist-test-slave-1x1f"
server_key: "18938e40861171e2de176a14809139bb"
server_key_iv: "848e325721482507c318516bfb2ed256"
server_key_version: "encryptionkey@0"
I20260923 17:18:42.861579 2383 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260923 17:18:42.864411 2398 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:42.865834 2383 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260923 17:18:42.866003 2383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/minicluster-data/master-0/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/minicluster-data/master-0/wal
uuid: "5f90b7e3252841a8ad945d582811366b"
format_stamp: "Formatted at 2026-09-23 17:18:42 on dist-test-slave-1x1f"
server_key: "18938e40861171e2de176a14809139bb"
server_key_iv: "848e325721482507c318516bfb2ed256"
server_key_version: "encryptionkey@0"
I20260923 17:18:42.866185 2383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:18:42.900206 2383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:18:42.903612 2383 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:18:42.903856 2383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:18:42.911782 2383 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.190:43897
I20260923 17:18:42.912088 2450 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.190:43897 every 8 connection(s)
I20260923 17:18:42.912917 2383 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/minicluster-data/master-0/data/info.pb
I20260923 17:18:42.915762 2451 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:18:42.917004 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 2383
I20260923 17:18:42.917104 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/minicluster-data/master-0/wal/instance
I20260923 17:18:42.917446 12182 external_mini_cluster.cc:1428] Setting key 32b9a46aac3b5bc8f43d403eaabb1391
I20260923 17:18:42.919670 2451 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43897 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.11.229.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.189@KRBTEST.COM" created.
Sep 23 17:18:42 dist-test-slave-1x1f krb5kdc[2370](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183922, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:18:42.936151 2454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:42.922479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:43897 (local address 127.0.0.1:54016)
0923 17:18:42.922977 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:42.923027 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:42.923870 (+ 843us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:42.924680 (+ 810us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:42.924685 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:42.925001 (+ 316us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:18:42.925294 (+ 293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:42.925306 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:42.926775 (+ 1469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:42.926780 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:42.927552 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:42.927562 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:42.928322 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:42.928325 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:42.928468 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:42.929100 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:18:42.929116 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:18:42.930934 (+ 1818us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:18:42.932930 (+ 1996us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:42.932941 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:42.932954 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:42.933277 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:42.933672 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:42.933678 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:42.933682 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:42.933842 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:42.934621 (+ 779us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:18:42.934630 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:18:42.934795 (+ 165us) client_negotiation.cc:769] Sending connection context
0923 17:18:42.934992 (+ 197us) client_negotiation.cc:240] Negotiation successful
0923 17:18:42.935409 (+ 417us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"mutex_wait_us":102,"thread_start_us":148,"threads_started":1}
I20260923 17:18:42.936158 2455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:42.922480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54016 (local address 127.11.229.190:43897)
0923 17:18:42.923044 (+ 564us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:42.923059 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:42.923111 (+ 52us) server_negotiation.cc:407] Connection header received
0923 17:18:42.924193 (+ 1082us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:42.924203 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:42.924458 (+ 255us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:42.924685 (+ 227us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:42.925442 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:42.926633 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:42.927731 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:42.928140 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:42.928258 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:42.931085 (+ 2827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:42.931090 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:42.931100 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:42.931121 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:42.932815 (+ 1694us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:42.933430 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:42.933436 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:42.933444 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:42.933562 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:42.933953 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:42.933955 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:42.933957 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:42.934467 (+ 510us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:42.934607 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:42.935066 (+ 459us) server_negotiation.cc:299] Negotiation successful
0923 17:18:42.935308 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":62,"server-negotiator.queue_time_us":436,"thread_start_us":149,"threads_started":1}
I20260923 17:18:42.939688 2451 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.229.189" port: 45969 } has no permanent_uuid. Determining permanent_uuid...
I20260923 17:18:42.940727 2454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:42.940413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.189:45969 (local address 127.0.0.1:39622)
0923 17:18:42.940559 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:42.940655 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.189:45969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260923 17:18:42.940939 2401 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.229.189:45969: connect: Connection refused (error 111)
I20260923 17:18:42.942196 2454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:42.941885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.189:45969 (local address 127.0.0.1:39636)
0923 17:18:42.942033 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:42.942100 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.189:45969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260923 17:18:42.942548 2451 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.229.189:45969: Network error: Client connection negotiation failed: client connection to 127.11.229.189:45969: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.189.keytab.
Entry for principal kudu/127.11.229.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.189.keytab.
I20260923 17:18:42.946077 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.189:45969
--webserver_interface=127.11.229.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.189.keytab
--principal=kudu/127.11.229.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:36015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:43897,127.11.229.189:45969,127.11.229.188:41179
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 17:18:42.991904 2451 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.229.189" port: 45969 } attempt: 1
I20260923 17:18:42.992884 2454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:42.992518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.189:45969 (local address 127.0.0.1:39652)
0923 17:18:42.992719 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:42.992792 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.189:45969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260923 17:18:42.993620 2454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:42.993395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.189:45969 (local address 127.0.0.1:39658)
0923 17:18:42.993500 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:42.993550 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.189:45969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260923 17:18:42.993796 2451 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.229.189:45969: Network error: Client connection negotiation failed: client connection to 127.11.229.189:45969: connect: Connection refused (error 111)
W20260923 17:18:43.060693 2458 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260923 17:18:43.061002 2458 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:18:43.061026 2458 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:18:43.061161 2458 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260923 17:18:43.062008 2451 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.229.189" port: 45969 } attempt: 2
I20260923 17:18:43.063210 2454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:43.062677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.189:45969 (local address 127.0.0.1:39662)
0923 17:18:43.062987 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:43.063093 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.189:45969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145}
I20260923 17:18:43.064407 2454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:43.064021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.189:45969 (local address 127.0.0.1:39666)
0923 17:18:43.064241 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:43.064305 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.189:45969: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
W20260923 17:18:43.064602 2451 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.229.189:45969: Network error: Client connection negotiation failed: client connection to 127.11.229.189:45969: connect: Connection refused (error 111)
W20260923 17:18:43.065956 2458 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:18:43.066040 2458 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:18:43.066113 2458 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:18:43.066171 2458 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:18:43.066211 2458 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260923 17:18:43.072045 2458 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:36015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:43897,127.11.229.189:45969,127.11.229.188:41179
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.189.keytab
--principal=kudu/127.11.229.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.189:45969
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.229.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2458
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:18:43.073186 2458 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:18:43.074198 2458 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:18:43.082495 2463 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:43.082504 2464 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:43.082620 2458 server_base.cc:1034] running on GCE node
W20260923 17:18:43.082474 2466 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:43.083271 2458 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:18:43.084486 2458 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:18:43.085737 2458 hybrid_clock.cc:648] HybridClock initialized: now 1790183923085703 us; error 45 us; skew 500 ppm
Sep 23 17:18:43 dist-test-slave-1x1f krb5kdc[2370](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183923, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:18:43.089198 2458 init.cc:377] Logged in from keytab as kudu/127.11.229.189@KRBTEST.COM (short username kudu)
I20260923 17:18:43.090270 2458 webserver.cc:460] Webserver started at http://127.11.229.189:46341/ using document root <none> and password file <none>
I20260923 17:18:43.090893 2458 fs_manager.cc:359] Metadata directory not provided
I20260923 17:18:43.090945 2458 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:18:43.091153 2458 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:18:43.093813 2458 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/minicluster-data/master-1/data/instance:
uuid: "6b075a4722224f3eae75b59c218839d9"
format_stamp: "Formatted at 2026-09-23 17:18:43 on dist-test-slave-1x1f"
server_key: "273bff3e1a1799ec291a16c356c33192"
server_key_iv: "a9c7d29d13f49abb6ae7fb5791681faf"
server_key_version: "encryptionkey@0"
I20260923 17:18:43.094483 2458 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/minicluster-data/master-1/wal/instance:
uuid: "6b075a4722224f3eae75b59c218839d9"
format_stamp: "Formatted at 2026-09-23 17:18:43 on dist-test-slave-1x1f"
server_key: "273bff3e1a1799ec291a16c356c33192"
server_key_iv: "a9c7d29d13f49abb6ae7fb5791681faf"
server_key_version: "encryptionkey@0"
I20260923 17:18:43.098948 2458 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260923 17:18:43.101462 2473 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:43.102816 2458 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260923 17:18:43.102954 2458 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/minicluster-data/master-1/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/minicluster-data/master-1/wal
uuid: "6b075a4722224f3eae75b59c218839d9"
format_stamp: "Formatted at 2026-09-23 17:18:43 on dist-test-slave-1x1f"
server_key: "273bff3e1a1799ec291a16c356c33192"
server_key_iv: "a9c7d29d13f49abb6ae7fb5791681faf"
server_key_version: "encryptionkey@0"
I20260923 17:18:43.103075 2458 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:18:43.117873 2458 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:18:43.121568 2458 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:18:43.121794 2458 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:18:43.129417 2458 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.189:45969
I20260923 17:18:43.129747 2525 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.189:45969 every 8 connection(s)
I20260923 17:18:43.130769 2458 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/minicluster-data/master-1/data/info.pb
I20260923 17:18:43.133073 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 2458
I20260923 17:18:43.133337 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/minicluster-data/master-1/wal/instance
I20260923 17:18:43.133682 12182 external_mini_cluster.cc:1428] Setting key 0d11d514303db3c603303ce97ce91bb8
I20260923 17:18:43.134153 2526 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:18:43.138741 2526 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43897 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.11.229.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.229.188@KRBTEST.COM" created.
Sep 23 17:18:43 dist-test-slave-1x1f krb5kdc[2370](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183923, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.189@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:18:43.155792 2451 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.229.189" port: 45969 } attempt: 3
I20260923 17:18:43.156778 2455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:43.141295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54030 (local address 127.11.229.190:43897)
0923 17:18:43.141478 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:43.141485 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:43.142322 (+ 837us) server_negotiation.cc:407] Connection header received
0923 17:18:43.143501 (+ 1179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:43.143505 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:43.143592 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:43.143723 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:43.145118 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:43.145927 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:43.147372 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:43.147771 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:43.147903 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:43.151330 (+ 3427us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:43.151334 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:43.151337 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:43.151370 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:43.153821 (+ 2451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:43.154758 (+ 937us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:43.154762 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:43.154763 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:43.154842 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:43.155356 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:43.155368 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:43.155370 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:43.155599 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:43.155693 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:43.156450 (+ 757us) server_negotiation.cc:299] Negotiation successful
0923 17:18:43.156603 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260923 17:18:43.158381 2529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:43.141655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:43897 (local address 127.0.0.1:54030)
0923 17:18:43.142129 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:43.142189 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:43.143075 (+ 886us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:43.143892 (+ 817us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:43.143899 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:43.144338 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:18:43.144955 (+ 617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:43.144970 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:43.146129 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:43.146132 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:43.147231 (+ 1099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:43.147242 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:43.147952 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:43.147955 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:43.148114 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:43.148838 (+ 724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:18:43.148858 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:18:43.151110 (+ 2252us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:18:43.154003 (+ 2893us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:43.154009 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:43.154023 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:43.154601 (+ 578us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:43.154961 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:43.154967 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:43.154972 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:43.155160 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:43.155720 (+ 560us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:18:43.155757 (+ 37us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:18:43.156103 (+ 346us) client_negotiation.cc:769] Sending connection context
0923 17:18:43.157004 (+ 901us) client_negotiation.cc:240] Negotiation successful
0923 17:18:43.157397 (+ 393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":131,"threads_started":1}
I20260923 17:18:43.159787 2526 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.229.189" port: 45969 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 17:18:43 dist-test-slave-1x1f krb5kdc[2370](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183922, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for kudu/127.11.229.189@KRBTEST.COM
Sep 23 17:18:43 dist-test-slave-1x1f krb5kdc[2370](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183923, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.189@KRBTEST.COM for kudu/127.11.229.189@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.229.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.188.keytab.
Entry for principal kudu/127.11.229.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.188.keytab.
I20260923 17:18:43.166325 12182 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskks427P/build/debug/bin/kudu
/tmp/dist-test-taskks427P/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.188:41179
--webserver_interface=127.11.229.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.188.keytab
--principal=kudu/127.11.229.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.229.148:36015
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.229.190:43897,127.11.229.189:45969,127.11.229.188:41179
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260923 17:18:43.167762 2531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:43.156437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39680 (local address 127.11.229.189:45969)
0923 17:18:43.156768 (+ 331us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:43.156783 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:43.156809 (+ 26us) server_negotiation.cc:407] Connection header received
0923 17:18:43.156861 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:43.156871 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:43.157127 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:43.157287 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:43.157794 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:43.158852 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:43.159830 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:43.160367 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:43.160606 (+ 239us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:43.162936 (+ 2330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:43.162948 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:43.162968 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:43.162988 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:43.164870 (+ 1882us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:43.165437 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:43.165444 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:43.165447 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:43.165559 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:43.165905 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:43.165910 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:43.165913 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:43.166308 (+ 395us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:43.166449 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:43.167383 (+ 934us) server_negotiation.cc:299] Negotiation successful
0923 17:18:43.167527 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":217,"spinlock_wait_cycles":5376,"thread_start_us":126,"threads_started":1}
I20260923 17:18:43.167764 2454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:43.156308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.189:45969 (local address 127.0.0.1:39680)
0923 17:18:43.156504 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:43.156519 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:43.156593 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:43.157294 (+ 701us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:43.157297 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:43.157470 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:18:43.157581 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:43.157588 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:43.158974 (+ 1386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:43.158980 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:43.159706 (+ 726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:43.159715 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:43.160602 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:43.160606 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:43.160737 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:43.161287 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:18:43.161302 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:18:43.162803 (+ 1501us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:18:43.164982 (+ 2179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:43.164986 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:43.164990 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:43.165317 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:43.165671 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:43.165674 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:43.165678 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:43.165788 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:43.166707 (+ 919us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:18:43.166714 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:18:43.166850 (+ 136us) client_negotiation.cc:769] Sending connection context
0923 17:18:43.167268 (+ 418us) client_negotiation.cc:240] Negotiation successful
0923 17:18:43.167459 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123}
I20260923 17:18:43.169368 2529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:43.160275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.189:45969 (local address 127.0.0.1:39694)
0923 17:18:43.160487 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:43.160500 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:43.160577 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:43.160982 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:43.160984 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:43.161256 (+ 272us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:18:43.161382 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:43.161393 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:43.162206 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:43.162209 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:43.162811 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:43.162819 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:43.163383 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:43.163386 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:43.163527 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:43.163967 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:18:43.163978 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:18:43.165366 (+ 1388us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:18:43.167909 (+ 2543us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:43.167912 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:43.167914 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:43.168125 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:43.168378 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:43.168380 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:43.168382 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:43.168445 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:43.168801 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:18:43.168803 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:18:43.168878 (+ 75us) client_negotiation.cc:769] Sending connection context
0923 17:18:43.168995 (+ 117us) client_negotiation.cc:240] Negotiation successful
0923 17:18:43.169129 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"mutex_wait_us":25}
I20260923 17:18:43.169381 2532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:43.160421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39694 (local address 127.11.229.189:45969)
0923 17:18:43.160789 (+ 368us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:43.160795 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:43.160804 (+ 9us) server_negotiation.cc:407] Connection header received
0923 17:18:43.160828 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:43.160829 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:43.160860 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:43.160964 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:43.161514 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:43.162090 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:43.162964 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:43.163266 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:43.163386 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:43.165506 (+ 2120us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:43.165510 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:43.165512 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:43.165540 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:43.167804 (+ 2264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:43.168227 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:43.168230 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:43.168231 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:43.168300 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:43.168525 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:43.168527 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:43.168529 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:43.168717 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:43.168801 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:43.169036 (+ 235us) server_negotiation.cc:299] Negotiation successful
0923 17:18:43.169179 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":78,"server-negotiator.queue_time_us":320,"spinlock_wait_cycles":1792,"thread_start_us":184,"threads_started":1}
I20260923 17:18:43.170146 2451 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.229.188" port: 41179 } has no permanent_uuid. Determining permanent_uuid...
I20260923 17:18:43.170612 2526 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.229.188" port: 41179 } has no permanent_uuid. Determining permanent_uuid...
I20260923 17:18:43.171105 2454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:43.170733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:41179 (local address 127.0.0.1:36714)
0923 17:18:43.170944 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:43.171008 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.188:41179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118}
I20260923 17:18:43.171290 2529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:43.171019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:41179 (local address 127.0.0.1:36728)
0923 17:18:43.171134 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:43.171226 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.188:41179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260923 17:18:43.171504 2477 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.229.188:41179: connect: Connection refused (error 111)
I20260923 17:18:43.171880 2454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:43.171563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:41179 (local address 127.0.0.1:36744)
0923 17:18:43.171744 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:43.171804 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.188:41179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
W20260923 17:18:43.172070 2451 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.229.188:41179: Network error: Client connection negotiation failed: client connection to 127.11.229.188:41179: connect: Connection refused (error 111)
I20260923 17:18:43.172351 2529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:43.172152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:41179 (local address 127.0.0.1:36746)
0923 17:18:43.172274 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:43.172308 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.188:41179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260923 17:18:43.172535 2526 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.229.188:41179: Network error: Client connection negotiation failed: client connection to 127.11.229.188:41179: connect: Connection refused (error 111)
I20260923 17:18:43.203258 2451 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.229.188" port: 41179 } attempt: 1
I20260923 17:18:43.204241 2454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:43.203898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:41179 (local address 127.0.0.1:36748)
0923 17:18:43.204076 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:43.204148 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.188:41179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260923 17:18:43.205267 2454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:43.205043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:41179 (local address 127.0.0.1:36764)
0923 17:18:43.205156 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:43.205208 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.188:41179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260923 17:18:43.205469 2451 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.229.188:41179: Network error: Client connection negotiation failed: client connection to 127.11.229.188:41179: connect: Connection refused (error 111)
I20260923 17:18:43.221843 2526 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.229.188" port: 41179 } attempt: 1
I20260923 17:18:43.222756 2529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:43.222447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:41179 (local address 127.0.0.1:36778)
0923 17:18:43.222609 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:43.222679 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.188:41179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260923 17:18:43.223518 2529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:43.223287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:41179 (local address 127.0.0.1:36786)
0923 17:18:43.223413 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:43.223456 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.188:41179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260923 17:18:43.223664 2526 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.229.188:41179: Network error: Client connection negotiation failed: client connection to 127.11.229.188:41179: connect: Connection refused (error 111)
I20260923 17:18:43.280654 2451 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.229.188" port: 41179 } attempt: 2
I20260923 17:18:43.281504 2454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:43.281177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:41179 (local address 127.0.0.1:36790)
0923 17:18:43.281342 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:43.281411 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.188:41179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260923 17:18:43.282475 2454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:43.282111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:41179 (local address 127.0.0.1:36806)
0923 17:18:43.282317 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:43.282386 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.188:41179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260923 17:18:43.282692 2451 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.229.188:41179: Network error: Client connection negotiation failed: client connection to 127.11.229.188:41179: connect: Connection refused (error 111)
W20260923 17:18:43.288671 2533 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260923 17:18:43.288930 2533 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260923 17:18:43.288987 2533 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260923 17:18:43.289078 2533 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260923 17:18:43.291832 2526 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.229.188" port: 41179 } attempt: 2
I20260923 17:18:43.292675 2529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:43.292362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:41179 (local address 127.0.0.1:36818)
0923 17:18:43.292519 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:43.292587 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.188:41179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260923 17:18:43.293399 2529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:43.293205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:41179 (local address 127.0.0.1:36830)
0923 17:18:43.293302 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:43.293347 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.229.188:41179: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260923 17:18:43.293421 2533 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260923 17:18:43.293464 2533 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260923 17:18:43.293509 2533 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260923 17:18:43.293545 2533 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260923 17:18:43.293567 2533 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260923 17:18:43.293550 2526 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.229.188:41179: Network error: Client connection negotiation failed: client connection to 127.11.229.188:41179: connect: Connection refused (error 111)
I20260923 17:18:43.299126 2533 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.229.148:36015
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.229.190:43897,127.11.229.189:45969,127.11.229.188:41179
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/krb5kdc/kudu_127.11.229.188.keytab
--principal=kudu/127.11.229.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.229.188:41179
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.229.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2533
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 23 Sep 2026 16:09:16 UTC on ccycloud.quasar-aignqz.root.comops.site
build id 4667495
I20260923 17:18:43.300230 2533 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260923 17:18:43.301239 2533 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260923 17:18:43.310314 2542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:43.310576 2540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260923 17:18:43.310602 2539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260923 17:18:43.310564 2533 server_base.cc:1034] running on GCE node
I20260923 17:18:43.311290 2533 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260923 17:18:43.312436 2533 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260923 17:18:43.313630 2533 hybrid_clock.cc:648] HybridClock initialized: now 1790183923313604 us; error 40 us; skew 500 ppm
Sep 23 17:18:43 dist-test-slave-1x1f krb5kdc[2370](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183923, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260923 17:18:43.316509 2533 init.cc:377] Logged in from keytab as kudu/127.11.229.188@KRBTEST.COM (short username kudu)
I20260923 17:18:43.317445 2533 webserver.cc:460] Webserver started at http://127.11.229.188:44027/ using document root <none> and password file <none>
I20260923 17:18:43.317997 2533 fs_manager.cc:359] Metadata directory not provided
I20260923 17:18:43.318132 2533 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260923 17:18:43.318400 2533 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260923 17:18:43.320415 2533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/minicluster-data/master-2/data/instance:
uuid: "c007fb9a689b430989f2d7b8743a01b9"
format_stamp: "Formatted at 2026-09-23 17:18:43 on dist-test-slave-1x1f"
server_key: "47070423e09f72ab50ca359097f1a609"
server_key_iv: "f4f794bf8d65575129b8e00d7ed11dc4"
server_key_version: "encryptionkey@0"
I20260923 17:18:43.320974 2533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/minicluster-data/master-2/wal/instance:
uuid: "c007fb9a689b430989f2d7b8743a01b9"
format_stamp: "Formatted at 2026-09-23 17:18:43 on dist-test-slave-1x1f"
server_key: "47070423e09f72ab50ca359097f1a609"
server_key_iv: "f4f794bf8d65575129b8e00d7ed11dc4"
server_key_version: "encryptionkey@0"
I20260923 17:18:43.324891 2533 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260923 17:18:43.327308 2549 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260923 17:18:43.328460 2533 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260923 17:18:43.328624 2533 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/minicluster-data/master-2/data,/tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/minicluster-data/master-2/wal
uuid: "c007fb9a689b430989f2d7b8743a01b9"
format_stamp: "Formatted at 2026-09-23 17:18:43 on dist-test-slave-1x1f"
server_key: "47070423e09f72ab50ca359097f1a609"
server_key_iv: "f4f794bf8d65575129b8e00d7ed11dc4"
server_key_version: "encryptionkey@0"
I20260923 17:18:43.328735 2533 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260923 17:18:43.338142 2533 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260923 17:18:43.341120 2533 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260923 17:18:43.341320 2533 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260923 17:18:43.348536 2533 rpc_server.cc:307] RPC server started. Bound to: 127.11.229.188:41179
I20260923 17:18:43.348873 2601 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.229.188:41179 every 8 connection(s)
I20260923 17:18:43.349502 2533 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/minicluster-data/master-2/data/info.pb
I20260923 17:18:43.352471 2602 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260923 17:18:43.354993 12182 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskks427P/build/debug/bin/kudu as pid 2533
I20260923 17:18:43.355187 12182 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskks427P/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790183633736342-12182-0/minicluster-data/master-2/wal/instance
I20260923 17:18:43.355502 12182 external_mini_cluster.cc:1428] Setting key 6d2d2e09cab558817ae01fbabddb8c23
I20260923 17:18:43.356693 2602 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43897 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 17:18:43 dist-test-slave-1x1f krb5kdc[2370](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183923, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.188@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
Sep 23 17:18:43 dist-test-slave-1x1f krb5kdc[2370](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183922, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.229.188@KRBTEST.COM
I20260923 17:18:43.368250 2455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:43.358447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54038 (local address 127.11.229.190:43897)
0923 17:18:43.358589 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:43.358597 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:43.358849 (+ 252us) server_negotiation.cc:407] Connection header received
0923 17:18:43.359043 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:43.359060 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:43.359116 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:43.359160 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:43.359971 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:43.360453 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:43.361408 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:43.361632 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:43.361745 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:43.364353 (+ 2608us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:43.364357 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:43.364360 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:43.364387 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:43.366063 (+ 1676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:43.366735 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:43.366739 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:43.366741 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:43.366823 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:43.367173 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:43.367176 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:43.367178 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:43.367358 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:43.367466 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:43.367936 (+ 470us) server_negotiation.cc:299] Negotiation successful
0923 17:18:43.368066 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260923 17:18:43.369055 2606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:43.358391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.190:43897 (local address 127.0.0.1:54038)
0923 17:18:43.358728 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:43.358774 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:43.358933 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:43.359312 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:43.359315 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:43.359629 (+ 314us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:18:43.359827 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:43.359837 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:43.360564 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:43.360568 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:43.361281 (+ 713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:43.361290 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:43.361777 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:43.361781 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:43.361912 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:43.362563 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:18:43.362587 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:18:43.364158 (+ 1571us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:18:43.366178 (+ 2020us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:43.366189 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:43.366199 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:43.366631 (+ 432us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:43.366917 (+ 286us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:43.366921 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:43.366923 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:43.367068 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:43.367479 (+ 411us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:18:43.367491 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:18:43.367701 (+ 210us) client_negotiation.cc:769] Sending connection context
0923 17:18:43.367865 (+ 164us) client_negotiation.cc:240] Negotiation successful
0923 17:18:43.368185 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"spinlock_wait_cycles":768,"thread_start_us":117,"threads_started":1}
I20260923 17:18:43.369057 2605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:43.356860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36834 (local address 127.11.229.188:41179)
0923 17:18:43.357305 (+ 445us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:43.357321 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:43.357355 (+ 34us) server_negotiation.cc:407] Connection header received
0923 17:18:43.357991 (+ 636us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:43.358007 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:43.358416 (+ 409us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:43.358767 (+ 351us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:43.359530 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:43.360558 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:43.361384 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:43.361756 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:43.361917 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:43.364819 (+ 2902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:43.364824 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:43.364833 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:43.364852 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:43.366514 (+ 1662us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:43.366909 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:43.366915 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:43.366917 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:43.367064 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:43.367354 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:43.367364 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:43.367365 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:43.367684 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:43.367898 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:43.368079 (+ 181us) server_negotiation.cc:299] Negotiation successful
0923 17:18:43.368248 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":24,"server-negotiator.queue_time_us":292,"spinlock_wait_cycles":10880,"thread_start_us":127,"threads_started":1}
I20260923 17:18:43.370420 2602 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.229.189" port: 45969 } has no permanent_uuid. Determining permanent_uuid...
Sep 23 17:18:43 dist-test-slave-1x1f krb5kdc[2370](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183923, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.188@KRBTEST.COM for kudu/127.11.229.189@KRBTEST.COM
Sep 23 17:18:43 dist-test-slave-1x1f krb5kdc[2370](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183922, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.229.190@KRBTEST.COM
I20260923 17:18:43.381337 2606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:43.370953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.189:45969 (local address 127.0.0.1:39706)
0923 17:18:43.371199 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:43.371216 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:43.371301 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:43.371558 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:43.371561 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:43.371786 (+ 225us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:18:43.371916 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:43.371924 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:43.373318 (+ 1394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:43.373322 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:43.374178 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:43.374189 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:43.374899 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:43.374903 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:43.375013 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:43.375615 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:18:43.375632 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:18:43.377386 (+ 1754us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:18:43.379849 (+ 2463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:43.379852 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:43.379854 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:43.380049 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:43.380338 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:43.380342 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:43.380344 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:43.380433 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:43.380811 (+ 378us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:18:43.380814 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:18:43.380912 (+ 98us) client_negotiation.cc:769] Sending connection context
0923 17:18:43.381015 (+ 103us) client_negotiation.cc:240] Negotiation successful
0923 17:18:43.381150 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108}
I20260923 17:18:43.381366 2532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:43.371046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39706 (local address 127.11.229.189:45969)
0923 17:18:43.371206 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:43.371210 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:43.371258 (+ 48us) server_negotiation.cc:407] Connection header received
0923 17:18:43.371402 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:43.371406 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:43.371458 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:43.371530 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:43.372171 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:43.373153 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:43.374346 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:43.374760 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:43.374870 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:43.377555 (+ 2685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:43.377560 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:43.377568 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:43.377593 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:43.379720 (+ 2127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:43.380150 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:43.380154 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:43.380156 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:43.380244 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:43.380526 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:43.380531 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:43.380533 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:43.380714 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:43.380820 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:43.381087 (+ 267us) server_negotiation.cc:299] Negotiation successful
0923 17:18:43.381199 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260923 17:18:43.381786 2455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:43.371372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54044 (local address 127.11.229.190:43897)
0923 17:18:43.371480 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:43.371484 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:43.371572 (+ 88us) server_negotiation.cc:407] Connection header received
0923 17:18:43.371669 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:43.371671 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:43.371715 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:43.371772 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:43.372437 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:43.373165 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:43.374346 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:43.374747 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:43.374870 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:43.378345 (+ 3475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:43.378349 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:43.378353 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:43.378381 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:43.379922 (+ 1541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:43.380377 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:43.380381 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:43.380384 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:43.380461 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:43.380747 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:43.380750 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:43.380752 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:43.380922 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:43.381149 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:43.381288 (+ 139us) server_negotiation.cc:299] Negotiation successful
0923 17:18:43.381620 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260923 17:18:43.381860 2451 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.229.188" port: 41179 } attempt: 3
I20260923 17:18:43.382351 2602 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.229.188" port: 41179 } has no permanent_uuid. Determining permanent_uuid...
I20260923 17:18:43.384723 2526 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.229.188" port: 41179 } attempt: 3
Sep 23 17:18:43 dist-test-slave-1x1f krb5kdc[2370](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183922, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.190@KRBTEST.COM for kudu/127.11.229.188@KRBTEST.COM
Sep 23 17:18:43 dist-test-slave-1x1f krb5kdc[2370](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183923, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.188@KRBTEST.COM for kudu/127.11.229.188@KRBTEST.COM
Sep 23 17:18:43 dist-test-slave-1x1f krb5kdc[2370](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183922, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.229.189@KRBTEST.COM
Sep 23 17:18:43 dist-test-slave-1x1f krb5kdc[2370](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790183923, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.229.189@KRBTEST.COM for kudu/127.11.229.188@KRBTEST.COM
I20260923 17:18:43.393316 2454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:43.382356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:41179 (local address 127.0.0.1:36844)
0923 17:18:43.382485 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:43.382500 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:43.382575 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:43.383097 (+ 522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:43.383102 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:43.383297 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:18:43.383378 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:43.383383 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:43.384469 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:43.384473 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:43.385196 (+ 723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:43.385205 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:43.385798 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:43.385802 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:43.385888 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:43.386869 (+ 981us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:18:43.386886 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:18:43.389326 (+ 2440us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:18:43.391685 (+ 2359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:43.391689 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:43.391691 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:43.391983 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:43.392296 (+ 313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:43.392299 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:43.392301 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:43.392390 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:43.392806 (+ 416us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:18:43.392811 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:18:43.392906 (+ 95us) client_negotiation.cc:769] Sending connection context
0923 17:18:43.392989 (+ 83us) client_negotiation.cc:240] Negotiation successful
0923 17:18:43.393130 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260923 17:18:43.393630 2606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:43.382846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:41179 (local address 127.0.0.1:36856)
0923 17:18:43.383246 (+ 400us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:43.383260 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:43.383326 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:43.383803 (+ 477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:43.383806 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:43.383967 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:18:43.384022 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:43.384027 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:43.385457 (+ 1430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:43.385462 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:43.386286 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:43.386299 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:43.386926 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:43.386931 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:43.387039 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:43.387462 (+ 423us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:18:43.387477 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:18:43.388902 (+ 1425us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:18:43.391109 (+ 2207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:43.391113 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:43.391118 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:43.391475 (+ 357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:43.392240 (+ 765us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:43.392244 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:43.392248 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:43.392330 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:43.392830 (+ 500us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:18:43.392833 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:18:43.392905 (+ 72us) client_negotiation.cc:769] Sending connection context
0923 17:18:43.393005 (+ 100us) client_negotiation.cc:240] Negotiation successful
0923 17:18:43.393455 (+ 450us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":342}
I20260923 17:18:43.394094 2607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:43.383011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36856 (local address 127.11.229.188:41179)
0923 17:18:43.383626 (+ 615us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:43.383633 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:43.383642 (+ 9us) server_negotiation.cc:407] Connection header received
0923 17:18:43.383667 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:43.383668 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:43.383696 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:43.383795 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:43.384130 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:43.385353 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:43.386387 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:43.386735 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:43.386827 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:43.389086 (+ 2259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:43.389090 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:43.389093 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:43.389116 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:43.390931 (+ 1815us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:43.391579 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:43.391582 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:43.391584 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:43.392139 (+ 555us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:43.392422 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:43.392428 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:43.392432 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:43.392689 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:43.392799 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:43.393157 (+ 358us) server_negotiation.cc:299] Negotiation successful
0923 17:18:43.393909 (+ 752us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":412,"server-negotiator.queue_time_us":566,"thread_start_us":116,"threads_started":1}
I20260923 17:18:43.394515 2532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:43.383121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39716 (local address 127.11.229.189:45969)
0923 17:18:43.383246 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:43.383251 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:43.383265 (+ 14us) server_negotiation.cc:407] Connection header received
0923 17:18:43.383303 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:43.383307 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:43.383346 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:43.383423 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:43.384240 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:43.385063 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:43.386323 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:43.386641 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:43.386741 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:43.390358 (+ 3617us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:43.390364 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:43.390366 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:43.390397 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:43.392025 (+ 1628us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:43.392540 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:43.392544 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:43.392547 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:43.392639 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:43.392964 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:43.392968 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:43.392970 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:43.393204 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:43.393376 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:43.393732 (+ 356us) server_negotiation.cc:299] Negotiation successful
0923 17:18:43.393851 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":30,"server-negotiator.queue_time_us":65}
I20260923 17:18:43.395071 2605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:43.382714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36844 (local address 127.11.229.188:41179)
0923 17:18:43.382844 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:43.382848 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:43.382861 (+ 13us) server_negotiation.cc:407] Connection header received
0923 17:18:43.382893 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:43.382896 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:43.382960 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:43.383523 (+ 563us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:43.383618 (+ 95us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:43.384367 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:43.385321 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:43.385667 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:43.386088 (+ 421us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:43.389469 (+ 3381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:43.389472 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:43.389473 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:43.389517 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:43.391601 (+ 2084us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:43.392099 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:43.392103 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:43.392104 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:43.392177 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:43.392496 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:43.392499 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:43.392502 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:43.392689 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:43.393619 (+ 930us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:43.393694 (+ 75us) server_negotiation.cc:299] Negotiation successful
0923 17:18:43.394923 (+ 1229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1095,"server-negotiator.queue_time_us":53,"spinlock_wait_cycles":32896}
I20260923 17:18:43.395582 2529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:43.385041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.229.188:41179 (local address 127.0.0.1:36866)
0923 17:18:43.385215 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0923 17:18:43.385227 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0923 17:18:43.385277 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0923 17:18:43.385904 (+ 627us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0923 17:18:43.385907 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0923 17:18:43.386383 (+ 476us) client_negotiation.cc:189] Negotiated authn=SASL
0923 17:18:43.386477 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:43.386482 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:43.387629 (+ 1147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:43.387633 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:43.388552 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0923 17:18:43.388572 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0923 17:18:43.389206 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0923 17:18:43.389211 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0923 17:18:43.389304 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:43.389814 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0923 17:18:43.389830 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0923 17:18:43.391371 (+ 1541us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0923 17:18:43.393869 (+ 2498us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:43.393873 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:43.393875 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:43.394297 (+ 422us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:43.394643 (+ 346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0923 17:18:43.394646 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0923 17:18:43.394648 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0923 17:18:43.394738 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0923 17:18:43.395131 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0923 17:18:43.395134 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0923 17:18:43.395221 (+ 87us) client_negotiation.cc:769] Sending connection context
0923 17:18:43.395302 (+ 81us) client_negotiation.cc:240] Negotiation successful
0923 17:18:43.395434 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114}
I20260923 17:18:43.396052 2608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:43.385397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36866 (local address 127.11.229.188:41179)
0923 17:18:43.385654 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:43.385661 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:43.385673 (+ 12us) server_negotiation.cc:407] Connection header received
0923 17:18:43.385703 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:43.385706 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:43.385775 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:43.386559 (+ 784us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:43.386665 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:43.387483 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:43.388734 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:43.389081 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:43.389493 (+ 412us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:43.391521 (+ 2028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:43.391526 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:43.391529 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:43.391555 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:43.393318 (+ 1763us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:43.394429 (+ 1111us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:43.394432 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:43.394434 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:43.394515 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:43.394844 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:43.394847 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:43.394849 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:43.395020 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:43.395705 (+ 685us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:43.395802 (+ 97us) server_negotiation.cc:299] Negotiation successful
0923 17:18:43.395897 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":201,"spinlock_wait_cycles":9600,"thread_start_us":94,"threads_started":1}
I20260923 17:18:43.397301 2602 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c007fb9a689b430989f2d7b8743a01b9: Bootstrap starting.
I20260923 17:18:43.397739 2451 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f90b7e3252841a8ad945d582811366b: Bootstrap starting.
I20260923 17:18:43.399149 12182 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260923 17:18:43.399854 2602 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c007fb9a689b430989f2d7b8743a01b9: Neither blocks nor log segments found. Creating new log.
I20260923 17:18:43.399986 2451 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5f90b7e3252841a8ad945d582811366b: Neither blocks nor log segments found. Creating new log.
I20260923 17:18:43.400636 2602 log.cc:824] T 00000000000000000000000000000000 P c007fb9a689b430989f2d7b8743a01b9: Log is configured to *not* fsync() on all Append() calls
I20260923 17:18:43.400831 2451 log.cc:824] T 00000000000000000000000000000000 P 5f90b7e3252841a8ad945d582811366b: Log is configured to *not* fsync() on all Append() calls
I20260923 17:18:43.402588 2526 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b075a4722224f3eae75b59c218839d9: Bootstrap starting.
I20260923 17:18:43.402675 2451 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f90b7e3252841a8ad945d582811366b: No bootstrap required, opened a new log
I20260923 17:18:43.402695 2602 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c007fb9a689b430989f2d7b8743a01b9: No bootstrap required, opened a new log
I20260923 17:18:43.402410 2425 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "5f90b7e3252841a8ad945d582811366b"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54044
I20260923 17:18:43.405037 2526 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6b075a4722224f3eae75b59c218839d9: Neither blocks nor log segments found. Creating new log.
I20260923 17:18:43.405575 2451 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5f90b7e3252841a8ad945d582811366b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f90b7e3252841a8ad945d582811366b" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43897 } } peers { permanent_uuid: "6b075a4722224f3eae75b59c218839d9" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 45969 } } peers { permanent_uuid: "c007fb9a689b430989f2d7b8743a01b9" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 41179 } }
I20260923 17:18:43.405911 2526 log.cc:824] T 00000000000000000000000000000000 P 6b075a4722224f3eae75b59c218839d9: Log is configured to *not* fsync() on all Append() calls
I20260923 17:18:43.405951 2451 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5f90b7e3252841a8ad945d582811366b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f90b7e3252841a8ad945d582811366b, State: Initialized, Role: FOLLOWER
I20260923 17:18:43.406381 2451 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5f90b7e3252841a8ad945d582811366b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f90b7e3252841a8ad945d582811366b" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43897 } } peers { permanent_uuid: "6b075a4722224f3eae75b59c218839d9" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 45969 } } peers { permanent_uuid: "c007fb9a689b430989f2d7b8743a01b9" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 41179 } }
I20260923 17:18:43.406946 2612 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f90b7e3252841a8ad945d582811366b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f90b7e3252841a8ad945d582811366b" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43897 } } peers { permanent_uuid: "6b075a4722224f3eae75b59c218839d9" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 45969 } } peers { permanent_uuid: "c007fb9a689b430989f2d7b8743a01b9" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 41179 } } }
I20260923 17:18:43.407294 2612 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f90b7e3252841a8ad945d582811366b [sys.catalog]: This master's current role is: FOLLOWER
I20260923 17:18:43.407454 2602 raft_consensus.cc:348] T 00000000000000000000000000000000 P c007fb9a689b430989f2d7b8743a01b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f90b7e3252841a8ad945d582811366b" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43897 } } peers { permanent_uuid: "6b075a4722224f3eae75b59c218839d9" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 45969 } } peers { permanent_uuid: "c007fb9a689b430989f2d7b8743a01b9" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 41179 } }
I20260923 17:18:43.407671 2602 raft_consensus.cc:729] T 00000000000000000000000000000000 P c007fb9a689b430989f2d7b8743a01b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c007fb9a689b430989f2d7b8743a01b9, State: Initialized, Role: FOLLOWER
I20260923 17:18:43.407853 2451 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5f90b7e3252841a8ad945d582811366b [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:18:43.407884 2425 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5f90b7e3252841a8ad945d582811366b [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260923 17:18:43.407970 2425 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5f90b7e3252841a8ad945d582811366b [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:18:43.407980 2602 consensus_queue.cc:260] T 00000000000000000000000000000000 P c007fb9a689b430989f2d7b8743a01b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f90b7e3252841a8ad945d582811366b" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43897 } } peers { permanent_uuid: "6b075a4722224f3eae75b59c218839d9" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 45969 } } peers { permanent_uuid: "c007fb9a689b430989f2d7b8743a01b9" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 41179 } }
I20260923 17:18:43.408087 2526 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6b075a4722224f3eae75b59c218839d9: No bootstrap required, opened a new log
I20260923 17:18:43.409189 2602 sys_catalog.cc:564] T 00000000000000000000000000000000 P c007fb9a689b430989f2d7b8743a01b9 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:18:43.409271 2425 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5f90b7e3252841a8ad945d582811366b [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f90b7e3252841a8ad945d582811366b" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43897 } } peers { permanent_uuid: "6b075a4722224f3eae75b59c218839d9" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 45969 } } peers { permanent_uuid: "c007fb9a689b430989f2d7b8743a01b9" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 41179 } }
I20260923 17:18:43.411319 2576 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5f90b7e3252841a8ad945d582811366b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "c007fb9a689b430989f2d7b8743a01b9"
I20260923 17:18:43.411664 2576 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c007fb9a689b430989f2d7b8743a01b9 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:18:43.410320 2425 leader_election.cc:288] T 00000000000000000000000000000000 P 5f90b7e3252841a8ad945d582811366b [CANDIDATE]: Term 1 election: Requested vote from peers 6b075a4722224f3eae75b59c218839d9 (127.11.229.189:45969), c007fb9a689b430989f2d7b8743a01b9 (127.11.229.188:41179)
I20260923 17:18:43.412971 2576 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c007fb9a689b430989f2d7b8743a01b9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f90b7e3252841a8ad945d582811366b in term 1.
I20260923 17:18:43.413691 2402 leader_election.cc:302] T 00000000000000000000000000000000 P 5f90b7e3252841a8ad945d582811366b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f90b7e3252841a8ad945d582811366b, c007fb9a689b430989f2d7b8743a01b9; no voters:
W20260923 17:18:43.414356 2624 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5f90b7e3252841a8ad945d582811366b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260923 17:18:43.415046 2613 sys_catalog.cc:455] T 00000000000000000000000000000000 P c007fb9a689b430989f2d7b8743a01b9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f90b7e3252841a8ad945d582811366b" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43897 } } peers { permanent_uuid: "6b075a4722224f3eae75b59c218839d9" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 45969 } } peers { permanent_uuid: "c007fb9a689b430989f2d7b8743a01b9" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 41179 } } }
I20260923 17:18:43.415457 2613 sys_catalog.cc:458] T 00000000000000000000000000000000 P c007fb9a689b430989f2d7b8743a01b9 [sys.catalog]: This master's current role is: FOLLOWER
W20260923 17:18:43.415596 2624 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 17:18:43.415596 2612 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5f90b7e3252841a8ad945d582811366b [term 1 FOLLOWER]: Leader election won for term 1
I20260923 17:18:43.415997 2612 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5f90b7e3252841a8ad945d582811366b [term 1 LEADER]: Becoming Leader. State: Replica: 5f90b7e3252841a8ad945d582811366b, State: Running, Role: LEADER
I20260923 17:18:43.416464 2612 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5f90b7e3252841a8ad945d582811366b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f90b7e3252841a8ad945d582811366b" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43897 } } peers { permanent_uuid: "6b075a4722224f3eae75b59c218839d9" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 45969 } } peers { permanent_uuid: "c007fb9a689b430989f2d7b8743a01b9" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 41179 } }
I20260923 17:18:43.413427 2383 master_runner.cc:186] Error getting master registration for 127.11.229.189:45969: OK, instance_id { permanent_uuid: "6b075a4722224f3eae75b59c218839d9" instance_seqno: 1790183923126902 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260923 17:18:43.416921 2383 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260923 17:18:43.417217 2635 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c007fb9a689b430989f2d7b8743a01b9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 17:18:43.417287 2635 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 17:18:43.418715 2612 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f90b7e3252841a8ad945d582811366b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5f90b7e3252841a8ad945d582811366b. Latest consensus state: current_term: 1 leader_uuid: "5f90b7e3252841a8ad945d582811366b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f90b7e3252841a8ad945d582811366b" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43897 } } peers { permanent_uuid: "6b075a4722224f3eae75b59c218839d9" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 45969 } } peers { permanent_uuid: "c007fb9a689b430989f2d7b8743a01b9" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 41179 } } }
I20260923 17:18:43.418889 2612 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f90b7e3252841a8ad945d582811366b [sys.catalog]: This master's current role is: LEADER
I20260923 17:18:43.418978 2526 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6b075a4722224f3eae75b59c218839d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f90b7e3252841a8ad945d582811366b" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43897 } } peers { permanent_uuid: "6b075a4722224f3eae75b59c218839d9" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 45969 } } peers { permanent_uuid: "c007fb9a689b430989f2d7b8743a01b9" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 41179 } }
I20260923 17:18:43.419241 2526 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6b075a4722224f3eae75b59c218839d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b075a4722224f3eae75b59c218839d9, State: Initialized, Role: FOLLOWER
I20260923 17:18:43.419572 2526 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6b075a4722224f3eae75b59c218839d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f90b7e3252841a8ad945d582811366b" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43897 } } peers { permanent_uuid: "6b075a4722224f3eae75b59c218839d9" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 45969 } } peers { permanent_uuid: "c007fb9a689b430989f2d7b8743a01b9" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 41179 } }
I20260923 17:18:43.420794 2526 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6b075a4722224f3eae75b59c218839d9 [sys.catalog]: configured and running, proceeding with master startup.
I20260923 17:18:43.421268 2500 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5f90b7e3252841a8ad945d582811366b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "6b075a4722224f3eae75b59c218839d9"
I20260923 17:18:43.421512 2500 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6b075a4722224f3eae75b59c218839d9 [term 0 FOLLOWER]: Advancing to term 1
I20260923 17:18:43.423257 2500 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6b075a4722224f3eae75b59c218839d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f90b7e3252841a8ad945d582811366b in term 1.
I20260923 17:18:43.424067 2645 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b075a4722224f3eae75b59c218839d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f90b7e3252841a8ad945d582811366b" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43897 } } peers { permanent_uuid: "6b075a4722224f3eae75b59c218839d9" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 45969 } } peers { permanent_uuid: "c007fb9a689b430989f2d7b8743a01b9" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 41179 } } }
I20260923 17:18:43.426846 2645 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b075a4722224f3eae75b59c218839d9 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 17:18:43.427834 2533 master_runner.cc:263] No leader master found from master c007fb9a689b430989f2d7b8743a01b9
I20260923 17:18:43.427903 2533 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260923 17:18:43.430707 2644 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260923 17:18:43.431635 2644 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260923 17:18:43.431754 2656 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6b075a4722224f3eae75b59c218839d9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260923 17:18:43.431818 2656 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260923 17:18:43.438411 2500 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6b075a4722224f3eae75b59c218839d9 [term 1 FOLLOWER]: Refusing update from remote peer 5f90b7e3252841a8ad945d582811366b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:18:43.438460 2576 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c007fb9a689b430989f2d7b8743a01b9 [term 1 FOLLOWER]: Refusing update from remote peer 5f90b7e3252841a8ad945d582811366b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260923 17:18:43.439072 2612 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5f90b7e3252841a8ad945d582811366b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b075a4722224f3eae75b59c218839d9" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 45969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:18:43.439273 2608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:43.427482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36882 (local address 127.11.229.188:41179)
0923 17:18:43.427623 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:43.427629 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:43.427909 (+ 280us) server_negotiation.cc:407] Connection header received
0923 17:18:43.428190 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:43.428194 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:43.428250 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:43.428310 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:43.429440 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:43.430353 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:43.431837 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:43.432256 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:43.432339 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:43.434422 (+ 2083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:43.434426 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:43.434429 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:43.434458 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:43.436363 (+ 1905us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:43.436881 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:43.436884 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:43.436887 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:43.436983 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:43.437351 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:43.437355 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:43.437357 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:43.438017 (+ 660us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:43.438158 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:43.438950 (+ 792us) server_negotiation.cc:299] Negotiation successful
0923 17:18:43.439084 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260923 17:18:43.439553 2612 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 5f90b7e3252841a8ad945d582811366b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c007fb9a689b430989f2d7b8743a01b9" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260923 17:18:43.442173 2532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:43.428289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39724 (local address 127.11.229.189:45969)
0923 17:18:43.428406 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:43.428413 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:43.431309 (+ 2896us) server_negotiation.cc:407] Connection header received
0923 17:18:43.433592 (+ 2283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:43.433595 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:43.433653 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:43.433735 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:43.434680 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:43.435431 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:43.436589 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:43.436951 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:43.437026 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:43.438697 (+ 1671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:43.438700 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:43.438703 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:43.438727 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:43.440410 (+ 1683us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:43.440889 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:43.440892 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:43.440894 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:43.440973 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:43.441274 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:43.441277 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:43.441280 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:43.441475 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:43.441579 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:43.441903 (+ 324us) server_negotiation.cc:299] Negotiation successful
0923 17:18:43.442013 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260923 17:18:43.443298 2645 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b075a4722224f3eae75b59c218839d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5f90b7e3252841a8ad945d582811366b. Latest consensus state: current_term: 1 leader_uuid: "5f90b7e3252841a8ad945d582811366b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f90b7e3252841a8ad945d582811366b" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43897 } } peers { permanent_uuid: "6b075a4722224f3eae75b59c218839d9" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 45969 } } peers { permanent_uuid: "c007fb9a689b430989f2d7b8743a01b9" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 41179 } } }
I20260923 17:18:43.443403 2645 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b075a4722224f3eae75b59c218839d9 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 17:18:43.444195 2613 sys_catalog.cc:455] T 00000000000000000000000000000000 P c007fb9a689b430989f2d7b8743a01b9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5f90b7e3252841a8ad945d582811366b. Latest consensus state: current_term: 1 leader_uuid: "5f90b7e3252841a8ad945d582811366b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f90b7e3252841a8ad945d582811366b" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43897 } } peers { permanent_uuid: "6b075a4722224f3eae75b59c218839d9" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 45969 } } peers { permanent_uuid: "c007fb9a689b430989f2d7b8743a01b9" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 41179 } } }
I20260923 17:18:43.444325 2613 sys_catalog.cc:458] T 00000000000000000000000000000000 P c007fb9a689b430989f2d7b8743a01b9 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 17:18:43.446103 2612 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f90b7e3252841a8ad945d582811366b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5f90b7e3252841a8ad945d582811366b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f90b7e3252841a8ad945d582811366b" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43897 } } peers { permanent_uuid: "6b075a4722224f3eae75b59c218839d9" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 45969 } } peers { permanent_uuid: "c007fb9a689b430989f2d7b8743a01b9" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 41179 } } }
I20260923 17:18:43.446111 2645 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6b075a4722224f3eae75b59c218839d9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5f90b7e3252841a8ad945d582811366b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f90b7e3252841a8ad945d582811366b" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43897 } } peers { permanent_uuid: "6b075a4722224f3eae75b59c218839d9" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 45969 } } peers { permanent_uuid: "c007fb9a689b430989f2d7b8743a01b9" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 41179 } } }
I20260923 17:18:43.446250 2612 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f90b7e3252841a8ad945d582811366b [sys.catalog]: This master's current role is: LEADER
I20260923 17:18:43.446507 2645 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6b075a4722224f3eae75b59c218839d9 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 17:18:43.446520 2661 mvcc.cc:205] Tried to move back new op lower bound from 7332593350396203008 to 7332593350319083520. Current Snapshot: MvccSnapshot[applied={T|T < 7332593350396203008}]
I20260923 17:18:43.448522 2612 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f90b7e3252841a8ad945d582811366b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5f90b7e3252841a8ad945d582811366b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f90b7e3252841a8ad945d582811366b" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43897 } } peers { permanent_uuid: "6b075a4722224f3eae75b59c218839d9" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 45969 } } peers { permanent_uuid: "c007fb9a689b430989f2d7b8743a01b9" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 41179 } } }
I20260923 17:18:43.448655 2612 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f90b7e3252841a8ad945d582811366b [sys.catalog]: This master's current role is: LEADER
I20260923 17:18:43.449234 2613 sys_catalog.cc:455] T 00000000000000000000000000000000 P c007fb9a689b430989f2d7b8743a01b9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5f90b7e3252841a8ad945d582811366b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5f90b7e3252841a8ad945d582811366b" member_type: VOTER last_known_addr { host: "127.11.229.190" port: 43897 } } peers { permanent_uuid: "6b075a4722224f3eae75b59c218839d9" member_type: VOTER last_known_addr { host: "127.11.229.189" port: 45969 } } peers { permanent_uuid: "c007fb9a689b430989f2d7b8743a01b9" member_type: VOTER last_known_addr { host: "127.11.229.188" port: 41179 } } }
I20260923 17:18:43.449352 2613 sys_catalog.cc:458] T 00000000000000000000000000000000 P c007fb9a689b430989f2d7b8743a01b9 [sys.catalog]: This master's current role is: FOLLOWER
I20260923 17:18:43.450887 2663 mvcc.cc:205] Tried to move back new op lower bound from 7332593350396203008 to 7332593350319083520. Current Snapshot: MvccSnapshot[applied={T|T < 7332593350396203008}]
I20260923 17:18:43.451736 2665 mvcc.cc:205] Tried to move back new op lower bound from 7332593350396203008 to 7332593350319083520. Current Snapshot: MvccSnapshot[applied={T|T < 7332593350396203008}]
I20260923 17:18:43.455464 2644 catalog_manager.cc:1347] Generated new cluster ID: 0b6a78e5663741a3a5ffefb64a33b3bd
I20260923 17:18:43.455544 2644 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260923 17:18:43.460032 2455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:43.426596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54048 (local address 127.11.229.190:43897)
0923 17:18:43.426718 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:43.426723 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:43.429771 (+ 3048us) server_negotiation.cc:407] Connection header received
0923 17:18:43.429954 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:43.429957 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:43.430002 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:43.430067 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:43.431381 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:43.432199 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:43.433608 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:43.434067 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:43.434152 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:43.442429 (+ 8277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0923 17:18:43.442433 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0923 17:18:43.442437 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0923 17:18:43.442466 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0923 17:18:43.444371 (+ 1905us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:43.458419 (+ 14048us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:43.458424 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:43.458426 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:43.458565 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0923 17:18:43.458955 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0923 17:18:43.458958 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0923 17:18:43.458961 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0923 17:18:43.459196 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0923 17:18:43.459322 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:43.459705 (+ 383us) server_negotiation.cc:299] Negotiation successful
0923 17:18:43.459858 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260923 17:18:43.497354 2644 catalog_manager.cc:1370] Generated new certificate authority record
I20260923 17:18:43.501171 2644 catalog_manager.cc:1504] Loading token signing keys...
I20260923 17:18:43.514564 2644 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5f90b7e3252841a8ad945d582811366b: Generated new TSK 0
I20260923 17:18:43.515542 2644 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260923 17:18:43.555608 2608 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:18:43.552281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36894 (local address 127.11.229.188:41179)
0923 17:18:43.552443 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:43.552449 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:43.554365 (+ 1916us) server_negotiation.cc:407] Connection header received
0923 17:18:43.554657 (+ 292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:43.554661 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:43.554717 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:43.554778 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:43.555441 (+ 663us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36894: BlockingRecv error: recv got EOF from 127.0.0.1:36894 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260923 17:18:43.557366 2455 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:18:43.553051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54064 (local address 127.11.229.190:43897)
0923 17:18:43.553177 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:43.553182 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:43.556006 (+ 2824us) server_negotiation.cc:407] Connection header received
0923 17:18:43.556531 (+ 525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:43.556535 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:43.556606 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:43.556663 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:43.557240 (+ 577us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54064: BlockingRecv error: recv got EOF from 127.0.0.1:54064 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260923 17:18:43.558530 2532 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:18:43.553716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39726 (local address 127.11.229.189:45969)
0923 17:18:43.553833 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:43.553838 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:43.556443 (+ 2605us) server_negotiation.cc:407] Connection header received
0923 17:18:43.557747 (+ 1304us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:43.557753 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:43.557807 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:43.557866 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:43.558411 (+ 545us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39726: BlockingRecv error: recv got EOF from 127.0.0.1:39726 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260923 17:18:43.562827 2532 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:18:43.561127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39738 (local address 127.11.229.189:45969)
0923 17:18:43.561235 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:43.561239 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:43.561744 (+ 505us) server_negotiation.cc:407] Connection header received
0923 17:18:43.561971 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:43.561974 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:43.562052 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:43.562108 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:43.562722 (+ 614us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39738: BlockingRecv error: recv got EOF from 127.0.0.1:39738 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
W20260923 17:18:43.568215 2532 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:18:43.566616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39742 (local address 127.11.229.189:45969)
0923 17:18:43.566718 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:43.566723 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:43.567289 (+ 566us) server_negotiation.cc:407] Connection header received
0923 17:18:43.567478 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:43.567481 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:43.567532 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:43.567602 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:43.568111 (+ 509us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39742: BlockingRecv error: recv got EOF from 127.0.0.1:39742 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
W20260923 17:18:43.574103 2532 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:18:43.572494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39754 (local address 127.11.229.189:45969)
0923 17:18:43.572615 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:43.572620 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:43.573158 (+ 538us) server_negotiation.cc:407] Connection header received
0923 17:18:43.573356 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:43.573360 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:43.573411 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:43.573466 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:43.573994 (+ 528us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39754: BlockingRecv error: recv got EOF from 127.0.0.1:39754 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
W20260923 17:18:43.582093 2532 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:18:43.580399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39760 (local address 127.11.229.189:45969)
0923 17:18:43.580552 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:43.580557 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:43.581119 (+ 562us) server_negotiation.cc:407] Connection header received
0923 17:18:43.581319 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:43.581323 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:43.581379 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:43.581435 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:43.581978 (+ 543us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39760: BlockingRecv error: recv got EOF from 127.0.0.1:39760 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
W20260923 17:18:43.594002 2532 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:18:43.592316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39772 (local address 127.11.229.189:45969)
0923 17:18:43.592427 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:43.592431 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:43.593010 (+ 579us) server_negotiation.cc:407] Connection header received
0923 17:18:43.593219 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:43.593223 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:43.593277 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:43.593332 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:43.593887 (+ 555us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39772: BlockingRecv error: recv got EOF from 127.0.0.1:39772 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260923 17:18:43.614583 2532 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:18:43.612626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39784 (local address 127.11.229.189:45969)
0923 17:18:43.612755 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:43.612762 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:43.613403 (+ 641us) server_negotiation.cc:407] Connection header received
0923 17:18:43.613657 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:43.613662 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:43.613726 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:43.613784 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:43.614450 (+ 666us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39784: BlockingRecv error: recv got EOF from 127.0.0.1:39784 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260923 17:18:43.651223 2532 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:18:43.649423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39798 (local address 127.11.229.189:45969)
0923 17:18:43.649553 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:43.649558 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:43.650149 (+ 591us) server_negotiation.cc:407] Connection header received
0923 17:18:43.650395 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:43.650399 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:43.650457 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:43.650514 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:43.651096 (+ 582us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39798: BlockingRecv error: recv got EOF from 127.0.0.1:39798 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260923 17:18:43.719110 2532 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:18:43.717758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39808 (local address 127.11.229.189:45969)
0923 17:18:43.717986 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:43.717990 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:43.718185 (+ 195us) server_negotiation.cc:407] Connection header received
0923 17:18:43.718345 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:43.718348 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:43.718399 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:43.718481 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:43.718941 (+ 460us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39808: BlockingRecv error: recv got EOF from 127.0.0.1:39808 (error 108)
Metrics: {"server-negotiator.queue_time_us":116}
W20260923 17:18:43.850694 2532 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:18:43.849375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39822 (local address 127.11.229.189:45969)
0923 17:18:43.849542 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:43.849547 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:43.849694 (+ 147us) server_negotiation.cc:407] Connection header received
0923 17:18:43.849867 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:43.849872 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:43.849926 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:43.850020 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:43.850543 (+ 523us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39822: BlockingRecv error: recv got EOF from 127.0.0.1:39822 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
W20260923 17:18:44.110455 2532 negotiation.cc:337] Failed RPC negotiation. Trace:
0923 17:18:44.109386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39828 (local address 127.11.229.189:45969)
0923 17:18:44.109523 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:44.109527 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:44.109540 (+ 13us) server_negotiation.cc:407] Connection header received
0923 17:18:44.109597 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:44.109649 (+ 52us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:44.109721 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:44.109814 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0923 17:18:44.110288 (+ 474us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39828: BlockingRecv error: recv got EOF from 127.0.0.1:39828 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
I20260923 17:18:44.418614 2635 catalog_manager.cc:1259] Loaded cluster ID: 0b6a78e5663741a3a5ffefb64a33b3bd
I20260923 17:18:44.418699 2635 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c007fb9a689b430989f2d7b8743a01b9: loading cluster ID for follower catalog manager: success
I20260923 17:18:44.420497 2635 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c007fb9a689b430989f2d7b8743a01b9: acquiring CA information for follower catalog manager: success
I20260923 17:18:44.421833 2635 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c007fb9a689b430989f2d7b8743a01b9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260923 17:18:44.433075 2656 catalog_manager.cc:1259] Loaded cluster ID: 0b6a78e5663741a3a5ffefb64a33b3bd
I20260923 17:18:44.433198 2656 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 6b075a4722224f3eae75b59c218839d9: loading cluster ID for follower catalog manager: success
I20260923 17:18:44.434926 2656 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 6b075a4722224f3eae75b59c218839d9: acquiring CA information for follower catalog manager: success
I20260923 17:18:44.436074 2656 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 6b075a4722224f3eae75b59c218839d9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260923 17:18:44.629540 2734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:44.624773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39838 (local address 127.11.229.189:45969)
0923 17:18:44.625024 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:44.625028 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:44.625081 (+ 53us) server_negotiation.cc:407] Connection header received
0923 17:18:44.625237 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:44.625240 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:44.625374 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:44.625518 (+ 144us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 17:18:44.626018 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:44.626960 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:44.628002 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:44.628262 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:44.628349 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:44.628663 (+ 314us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 17:18:44.629125 (+ 462us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 17:18:44.629219 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:44.629353 (+ 134us) server_negotiation.cc:299] Negotiation successful
0923 17:18:44.629410 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":180,"thread_start_us":112,"threads_started":1}
I20260923 17:18:44.636649 2740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:44.632940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36906 (local address 127.11.229.188:41179)
0923 17:18:44.633191 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:44.633194 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:44.633209 (+ 15us) server_negotiation.cc:407] Connection header received
0923 17:18:44.633288 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:44.633290 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:44.633402 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:44.633499 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 17:18:44.633750 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:44.634340 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:44.635250 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:44.635474 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:44.635573 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:44.635855 (+ 282us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 17:18:44.636287 (+ 432us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 17:18:44.636379 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:44.636470 (+ 91us) server_negotiation.cc:299] Negotiation successful
0923 17:18:44.636523 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":100,"threads_started":1}
I20260923 17:18:44.644351 2740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:44.640468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36912 (local address 127.11.229.188:41179)
0923 17:18:44.640568 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:44.640573 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:44.640688 (+ 115us) server_negotiation.cc:407] Connection header received
0923 17:18:44.640876 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:44.640879 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:44.640932 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:44.640980 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 17:18:44.641401 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:44.641966 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:44.643168 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:44.643493 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:44.643600 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:44.643899 (+ 299us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 17:18:44.643970 (+ 71us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 17:18:44.644035 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:44.644199 (+ 164us) server_negotiation.cc:299] Negotiation successful
0923 17:18:44.644245 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260923 17:18:44.644330 2734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:44.640437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39846 (local address 127.11.229.189:45969)
0923 17:18:44.640539 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:44.640543 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:44.640790 (+ 247us) server_negotiation.cc:407] Connection header received
0923 17:18:44.640881 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:44.640884 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:44.640932 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:44.641020 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 17:18:44.641266 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:44.642019 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:44.642996 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:44.643315 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:44.643422 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:44.643833 (+ 411us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 17:18:44.643933 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 17:18:44.644009 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:44.644125 (+ 116us) server_negotiation.cc:299] Negotiation successful
0923 17:18:44.644193 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260923 17:18:44.645181 2747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0923 17:18:44.640095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54080 (local address 127.11.229.190:43897)
0923 17:18:44.640345 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0923 17:18:44.640350 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0923 17:18:44.640689 (+ 339us) server_negotiation.cc:407] Connection header received
0923 17:18:44.640940 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0923 17:18:44.640942 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0923 17:18:44.641114 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0923 17:18:44.641212 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0923 17:18:44.641600 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:44.642375 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:44.643408 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0923 17:18:44.643737 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0923 17:18:44.643846 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0923 17:18:44.644261 (+ 415us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0923 17:18:44.644639 (+ 378us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0923 17:18:44.644724 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0923 17:18:44.644991 (+ 267us) server_negotiation.cc:299] Negotiation successful
0923 17:18:44.645048 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":76,"threads_started":1}
I20260923 17:18:44.648209 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 2383
I20260923 17:18:44.655192 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 2458
I20260923 17:18:44.661356 12182 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskks427P/build/debug/bin/kudu with pid 2533
2026-09-23T17:18:44Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3139 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6385 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (290916 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST